No, there is no way to accomplish in direct manner. When you give rights/permission to the resource in Web UI, the same permission is inherited in the Visual Explorer and Pivot Viewer. Suppose for some resource you have denied all permissions than that resource
won't come is search or pivot viewer for guest user of other user except the adminstartor and Owner.
Let me know if this helps.
-Regards