(assuming SPS 2003) Have you given the users more than Reader rights? Contributors can modify documents, although you can specify more granular settings for individual Document Libraries. If people are Readers, they can see all documents; you can't deny access to individual documents either.