The indexer puts an enormous amount of weight on your server.
If your sites are exceeding capacity planning guidelines, then these
hits can actually cause the sites to go down and cause an excessive
about of virtual memory to be consumed.
Do you know someone who can help? Share a link to this thread on twitter, or facebook.