Sharepoint Forum

Ask Question   UnAnswered
Home » Forum » Sharepoint       RSS Feeds

Crawling multiple hostnames

  Asked By: Lucas    Date: Feb 23    Category: Sharepoint    Views: 1216

Our SP crawler crawls intranet content stored on 2 web servers using a
content source for each. 1 server is SP itself, the other is an old
intranet server which still houses a lot of content.

The problem that has come up is, hyperlinks on our SP server that
point to our old server, are not crawled by the SP content source
since it is a different hostname. The old server's content source
won't crawl them either because the crawler can't reach them, because
the content is linked to only from pages on the Sharepoint server.

Is there any setting changes I can make to fix this, I.E. telling
Sharepoint to crawl URLs on SP sites of a specific domain (my old
intranet server)? I know I can't have it crawl all URLs (parts of the
web could be crawled via external links), but this local
external-to-SP server seems like it could be a common issue.



1 Answer Found

Answer #1    Answered By: Daamodar Bhadranavar     Answered On: Feb 23

try creating a content  source for your new Web application. Then, in the
content source  creation page, choose '1' server  hop. This should allow it to
follow links  for 1 hop.

beware it will crawl  all servers  via 1 hop. I don't know a way to scope it to
your old SP server.

Didn't find what you were looking for? Find more on Crawling multiple hostnames Or get search suggestion and latest updates.