People find information in a Portal in two ways: Browse and Search.
That said, Departments are one potential method of organization. Be cautious
however, that is only one slice of the overall taxonomy of your Portal. You
need to ask yourself, what hierarchical structures will people need in place
to find the content that they will be looking for. This will take some
research and some planning. Fortunately, SharePoint Portal Server is fairly
forgiving (bucket Webs aside) when you want to reorganize your Areas.
You also want to consider how people will actually collaborate with one
another, how cross-functional teams will be served, security considerations
that impact access, etc.