How to restrict download any attached files to the login user.

I am looking a way to restrict the downloads of attached files from the guest users, I don't find any simple way to achive it, I was expecting some rules for files under Role and Permission. May be by impleaminting this feature can be a good option.