Other users only have access to shares that you define they have access to. If you are using HomeGroup, remove your Server from it and use the Server Dashboard to limit who sees what.
Phil P.S. If you find my comment helpful or if it answers your question, please mark it as such.