Can I limit the access to some categories only?

No, you can only limit the access at the blog level.

Related questions