I have created a new project, created a new table, setup a new layout for backend and I am not able to add dummy info because hte "new item" button doesn't show up. Any ideas why not? It says I am logged in as a "Mr. Super User" and as "Mr. Admin"

This is because you must create a FORM layout.

Create an item layout.

per default, the form brick is instancied in back
if you want a form in the front, you will need to instance the form brick in your layout.

Simply doing this, your buttons will appear.
Simple, but not explained very weel, I know...

I have spent 2 hours looking for this, I created item layout, but it had 'Fly" brick, which i assumed was form.

Please make it obvoius, as I was very close of declaring this tool 'buggy' and stoppping research if I can use it for my project.