You can designate who can make access to specific Folders.

The members who are not joining a Folder cannot access, read or edit the data because they don’t even know the existence of the Folder.

Check this article about how to change members joining to a Folder.