Well, I've not followed this thread, but you need to check  two things:
your default content  access account and the site path rule  for the
content source. If the default  content access  account doesn't have read
priviledges, then you'll need to configure a site path rule to specify a
username/password combination that will have read access to the content
source.

Also, if the content source is a web page, it may be that the
administrator is blocking you via the robots.txt file.

Sometimes this problem  seems to be connected with the proxy-server. Try enabling Basic authentication for your content  indexes:
Site Settings > Configure Search and Indexing > Manage Content indexes  > Manage Index Properties > Exclude and Include Content
It helped in our case.

It worked the way you said..........