Crawl Websites I visit

Discussion in English language.
Forumsregeln
You can start and continue with posts in english language in all other forums as well, but if you are looking for a forum to start a discussion in english, this is the right choice.

Crawl Websites I visit

Beitragvon Huppi » Di Mär 31, 2015 10:26 pm

https://plus.google.com/b/110283375734521017806/109098684258584576851/posts/fDED7CZRWyF

+YaCy Search Engine Hi, is there a way to have YaCy automatically crawl the websites I visit? I'm way too lazy to crawl every website manually, I wish it was done automatically... or is this being done already? I don't really understand how this works.
Thank you
Huppi
 
Beiträge: 898
Registriert: Fr Jun 29, 2007 9:49 am
Wohnort: Kürten

Re: Crawl Websites I visit

Beitragvon biolizard89 » Mi Apr 01, 2015 6:59 pm

Huppi hat geschrieben:https://plus.google.com/b/110283375734521017806/109098684258584576851/posts/fDED7CZRWyF

+YaCy Search Engine Hi, is there a way to have YaCy automatically crawl the websites I visit? I'm way too lazy to crawl every website manually, I wish it was done automatically... or is this being done already? I don't really understand how this works.
Thank you


Hi,

There are two ways to do this: (1) using the YaCy HTTP proxy, or (2) using YaCyIndexerGreasemonkey. The proxy doesn't need any extra software, you just need to set your browser to use a proxy server. However, the proxy can't index pages that have cookies or use HTTPS, and its crawldepth is always 0. YaCyIndexerGreasemonkey requires a browser or browser extension that can run user scripts (e.g. Greasemonkey on Firefox), but it supports pages with cookies or HTTPS, and you can customize the crawldepth.

(I'm the author of YaCyIndexerGreasemonkey.)

Hope this helps.
biolizard89
 
Beiträge: 61
Registriert: Do Jan 03, 2013 12:42 am

Re: Crawl Websites I visit

Beitragvon Huppi » So Apr 26, 2015 10:06 am

Prima. Muß ich auch mal ausprobieren.
Huppi
 
Beiträge: 898
Registriert: Fr Jun 29, 2007 9:49 am
Wohnort: Kürten


Zurück zu English

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste

cron