I am trying to create a content source for the secured website. I
started by selecting add content source from the workspace management and
selected website and added the site name. In the additional settings I
clicked site paths and added the site name by clicking add new site path
rule .inside the options I checked enable complex links checkbox. After that
I specified the domain name ie, www.xxx.com username: fddsfsd and password
which is used to login the secured site and selected basic authentication.


Problem is indexing is not working. It is showing update failed.

I got following errors.

URL is excluded because the URL protocol is not recognized or restricted

URL is excluded by the server (robots.txt, no-index attribute on the URL,
encrypted file, or a search folder), or redirected to an excluded URL