Has anyone crawled a Wix.com with sucess

Discussion in English language.
Forumsregeln
You can start and continue with posts in english language in all other forums as well, but if you are looking for a forum to start a discussion in english, this is the right choice.

Has anyone crawled a Wix.com with sucess

Beitragvon smokingwheels » Fr Okt 16, 2015 9:09 am

I have been trying to crawl http://www.justiceparty.com.au and can only seem to receive 1 URL even though there are more pages.
Yahoo has the links.
Google does not.
Msn Does not.

Even tried http://www.justiceparty.com.au/#!domest ... form/i8yml
Yacy may have been blocked but the robots.txt does no say that.
smokingwheels
 
Beiträge: 129
Registriert: Sa Aug 31, 2013 7:16 am

Zurück zu English

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast