Greasemonkey Script for Initiating Crawls

Forum for developers

Greasemonkey Script for Initiating Crawls

Beitragvon biolizard89 » Sa Feb 02, 2013 6:38 am

The proxy is a cool way to automatically fill the index, but as I understand it, it doesn't play well with sites which use cookies. I've thrown together a proof-of-concept alternative which uses a Greasemonkey script to initiate crawls of all URL's which are visited. It also allows the crawls to have a customizable depth, which I think the proxy doesn't support (I believe the proxy only indexes the single page which is visited).

The code is at https://github.com/JeremyRand/YaCyIndexerGreasemonkey . Just thought people might be interested in it.

(Sorry if this is the wrong place to post this; feel free to move this thread to a different area if necessary.)
biolizard89
 
Beiträge: 58
Registriert: Do Jan 03, 2013 12:42 am

Re: Greasemonkey Script for Initiating Crawls

Beitragvon Orbiter » Sa Feb 23, 2013 2:45 pm

Wondeful! I linked your script in http://yacy.net/en/API.html
If possible please write a little more description into your readme and please put a backling to http://yacy.net into the readme as well, if you like.
Orbiter
 
Beiträge: 5786
Registriert: Di Jun 26, 2007 10:58 pm
Wohnort: Frankfurt am Main

Re: Greasemonkey Script for Initiating Crawls

Beitragvon biolizard89 » Sa Feb 23, 2013 10:59 pm

Orbiter hat geschrieben:Wondeful! I linked your script in http://yacy.net/en/API.html
If possible please write a little more description into your readme and please put a backling to http://yacy.net into the readme as well, if you like.

Done, now the readme has a link to the YaCy site and has some installation/customization instructions. If there's anything else you think the readme should specify, let me know. :)
biolizard89
 
Beiträge: 58
Registriert: Do Jan 03, 2013 12:42 am

Re: Greasemonkey Script for Initiating Crawls

Beitragvon Yududi » Fr Dez 13, 2013 11:20 am

Well done.
I like it ;-)
Yududi
 
Beiträge: 64
Registriert: Di Dez 10, 2013 12:30 pm


Zurück zu YaCy Coding & Architecture

Wer ist online?

Mitglieder in diesem Forum: Yahoo [Bot] und 1 Gast

cron