index cleaner - Indexing Queue

Ideen und Vorschläge sind willkommen.

index cleaner - Indexing Queue

Beitragvon streetfighter » Mi Jan 07, 2009 8:33 pm

I am using big url list to make crawler busy :). Sometimes fore one domain I have few thousands entries and past few I am adding domain to blacklist. So in Indexing Queue I have a lot of URL is in blacklist. That is ok but this slow down a lot indexing. I think yacy should have option to clean also Indexing Queue (when indexing is stopped). Of course I can do it via Local Crawl Queue and delete entries but this is not handy when importing fresh and big blacklist
streetfighter
 
Beiträge: 37
Registriert: Sa Jan 03, 2009 9:40 am

Zurück zu Wunschliste

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste

cron