You'll need four document libraries: one for each group that should beviewed individually and another for the group that should be viewed byall.