Private pages still viewable when not logged in

Despite having a certain page marked as Private in my Manage Page Access settings, I am still able to view that page when not logged in. I would have expected to be forwarded to a login page or the home page.

What might I be doing wrong?

You are possibly forgetting securePage, call this on your pages and you should be good!