Crawling big websites by different users

Discussion in English language.
Forumsregeln
You can start and continue with posts in english language in all other forums as well, but if you are looking for a forum to start a discussion in english, this is the right choice.

Crawling big websites by different users

Beitragvon bubul » Di Mai 09, 2017 2:37 pm

I think crawling big websites like youtube, archive.org, archive.is, dailymotion, pinterest, etc can be good because yacy provide different search results but because yacy is limited and user disk space too, it can be done only if different user crawl theses websites.
bubul
 
Beiträge: 25
Registriert: Mo Okt 24, 2016 11:57 am

Zurück zu English

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast

cron