Here's one data point from an SPS colleague:
"...when Office 2003 is installed the client components that are needed to
access the SPS 2001 server are removed. My response at this point would be
that it is best to use the client components from SPS 2003 - as these will
be the bits that will be updated (Hotfixes, SP's, etc.)."