Balancer "tot"

Hier finden YaCy User Hilfe wenn was nicht funktioniert oder anders funktioniert als man dachte. Bei offensichtlichen Fehlern diese bitte gleich in die Bugs (http://bugs.yacy.net) eintragen.
Forumsregeln
In diesem Forum geht es um Benutzungsprobleme und Anfragen für Hilfe. Wird dabei ein Bug identifiziert, wird der thread zur Bearbeitung in die Bug-Sektion verschoben. Wer hier also einen Thread eingestellt hat und ihn vermisst, wird ihn sicherlich in der Bug-Sektion wiederfinden.

Balancer "tot"

Beitragvon Lotus » Do Jun 18, 2009 8:38 pm

Das ist die letzte Log-Zeile bevor nichts mehr passiert außer Peer-Ping und DHT-in:
Code: Alles auswählen
D 2009/06/18 21:10:04 CRAWLER LOCALCRAWL[6902, 0, 0, 0]: URL=http://ad.de.doubleclick.net/jump/www.zeit.de/reisen;tile%3D1;sz%3D728x90;ord%3D123456789?, initiator=blubb, crawlOrder=false, depth=3, crawlDepth=3, must-match=.*, must-not-match=, permission=true
D 2009/06/18 21:10:04 CRAWLER Crawling of URL 'http://ad.de.doubleclick.net/jump/www.zeit.de/reisen;tile%3D1;sz%3D728x90;ord%3D123456789?' disallowed by robots.txt.
I 2009/06/18 21:10:04 BALANCER forcing crawl-delay of 6 seconds for ad.de.doubleclick.net (forced latency)

Allerdings habe ich das vorher auch bekommen ohne eine robots.txt Einschränkung. Da habe ich einen Neustart gemacht.
Code: Alles auswählen
************* Start Thread Dump Thu Jun 18 21:31:43 CEST 2009 *******************

YaCy Version: 0.850/06091
Total Memory = 624361472
Used  Memory = 342969240
Free  Memory = 281392232


THREADS WITH STATES: BLOCKED


THREADS WITH STATES: RUNNABLE

**

Thread= Session_127.0.0.1:1152#89 id=2377 RUNNABLE
at java.lang.Thread.getAllStackTraces(Unknown Source)
at Threaddump_p.respond(Threaddump_p.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1171)
at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:751)
at de.anomic.http.httpdFileHandler.doGet(httpdFileHandler.java:240)
at de.anomic.http.httpd.GET(httpd.java:490)
at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at de.anomic.server.serverCore$Session.listen(serverCore.java:741)
at de.anomic.server.serverCore$Session.run(serverCore.java:620)


Thread= AWT-Windows daemon id=13 RUNNABLE
at java.lang.Thread.run(Unknown Source)


Thread= httpd:8090 id=118 RUNNABLE
at java.net.ServerSocket.accept(Unknown Source)
at de.anomic.server.serverCore.job(serverCore.java:331)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:143)



THREADS WITH STATES: TIMED_WAITING

Thread= de.anomic.plasma.plasmaSwitchboard.cleanupJob id=108 TIMED_WAITING
Thread= de.anomic.crawler.CrawlQueues.remoteCrawlLoaderJob id=113 TIMED_WAITING
Thread= de.anomic.yacy.yacyCore.peerPing id=116 TIMED_WAITING
Thread= de.anomic.plasma.plasmaSwitchboard.deQueueProcess id=111 TIMED_WAITING
Thread= de.anomic.data.bookmarksDB.autoReCrawl id=68 TIMED_WAITING
Thread= de.anomic.crawler.CrawlQueues.remoteTriggeredCrawlJob id=112 TIMED_WAITING
Thread= de.anomic.plasma.plasmaSwitchboard.dhtTransferJob id=117 TIMED_WAITING
Thread= de.anomic.yacy.yacyCore.publishSeedList id=115 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:199)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:164)


Thread= Thread-1 id=11 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverProfiling.run(serverProfiling.java:64)


Thread= sorting_pool-1-thread-111 id=2506 TIMED_WAITING
Thread= partition_pool-1-thread-108 id=2503 TIMED_WAITING
Thread= sorting_pool-1-thread-110 id=2505 TIMED_WAITING
Thread= sorting_pool-1-thread-112 id=2507 TIMED_WAITING
Thread= partition_pool-1-thread-109 id=2504 TIMED_WAITING
Thread= sorting_pool-1-thread-113 id=2508 TIMED_WAITING
at java.lang.Thread.run(Unknown Source)



THREADS WITH STATES: WAITING

Thread= Thread-4 id=19 WAITING
at java.util.concurrent.Semaphore.acquire(Unknown Source)
at de.anomic.kelondro.text.IODispatcher.run(IODispatcher.java:132)


Thread= MultiThreadedHttpConnectionManager cleanup daemon id=49 WAITING
at java.lang.ref.ReferenceQueue.remove(Unknown Source)
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)


Thread= Finalizer daemon id=3 WAITING
at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)


Thread= Log Runner id=9 WAITING
at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
at de.anomic.yacy.logging.Log$logRunner.run(Log.java:316)


Thread= AWT-EventQueue-0 id=16 WAITING
at java.awt.EventDispatchThread.run(Unknown Source)


Thread= storeDocumentIndex_pool-1-thread-12 id=40 WAITING
Thread= condenseDocument_pool-1-thread-29 id=95 WAITING
Thread= storeDocumentIndex_pool-1-thread-7 id=30 WAITING
Thread= webStructureAnalysis_pool-1-thread-27 id=91 WAITING
Thread= parseDocument_pool-1-thread-32 id=101 WAITING
Thread= parseDocument_pool-1-thread-35 id=107 WAITING
Thread= storeDocumentIndex_pool-1-thread-24 id=85 WAITING
Thread= parseDocument_pool-1-thread-33 id=103 WAITING
Thread= storeDocumentIndex_pool-1-thread-9 id=34 WAITING
Thread= storeDocumentIndex_pool-1-thread-15 id=46 WAITING
Thread= webStructureAnalysis_pool-1-thread-26 id=89 WAITING
Thread= job_pool-1-thread-18 id=73 WAITING
Thread= condenseDocument_pool-1-thread-30 id=97 WAITING
Thread= storeDocumentIndex_pool-1-thread-16 id=48 WAITING
Thread= storeDocumentIndex_pool-1-thread-14 id=44 WAITING
Thread= storeDocumentIndex_pool-1-thread-10 id=36 WAITING
Thread= job_pool-1-thread-19 id=75 WAITING
Thread= job_pool-1-thread-17 id=71 WAITING
Thread= storeDocumentIndex_pool-1-thread-11 id=38 WAITING
Thread= job_pool-1-thread-22 id=81 WAITING
Thread= condenseDocument_pool-1-thread-28 id=93 WAITING
Thread= storeDocumentIndex_pool-1-thread-13 id=42 WAITING
Thread= job_pool-1-thread-23 id=83 WAITING
Thread= storeDocumentIndex_pool-1-thread-8 id=32 WAITING
Thread= webStructureAnalysis_pool-1-thread-25 id=87 WAITING
Thread= job_pool-1-thread-20 id=77 WAITING
Thread= job_pool-1-thread-21 id=79 WAITING
Thread= parseDocument_pool-1-thread-34 id=105 WAITING
Thread= parseDocument_pool-1-thread-31 id=99 WAITING
at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
at de.anomic.server.serverProcessor.take(serverProcessor.java:97)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:55)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)


Thread= urls_pool-1-thread-36 id=124 WAITING
Thread= urls_pool-1-thread-37 id=125 WAITING
Thread= Java2D Disposer daemon id=12 WAITING
Thread= AWT-Shutdown id=14 WAITING
Thread= urls_pool-1-thread-38 id=126 WAITING
at java.lang.Thread.run(Unknown Source)


Thread= main id=1 WAITING
at java.lang.Object.wait(Object.java:485)
at de.anomic.server.serverSemaphore.P(serverSemaphore.java:63)
at de.anomic.plasma.plasmaSwitchboard.waitForShutdown(plasmaSwitchboard.java:2272)
at yacy.startup(yacy.java:422)
at yacy.main(yacy.java:1058)


Thread= Reference Handler daemon id=2 WAITING
at java.lang.ref.Reference$ReferenceHandler.run(Unknown Source)


Thread= de.anomic.crawler.CrawlQueues.coreCrawlJob id=114 WAITING
at java.lang.Object.wait(Native Method)
at de.anomic.crawler.Balancer.pop(Balancer.java:368)
at de.anomic.crawler.NoticedURL.pop(NoticedURL.java:227)
at de.anomic.crawler.NoticedURL.pop(NoticedURL.java:194)
at de.anomic.crawler.CrawlQueues.coreCrawlJob(CrawlQueues.java:211)
at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at de.anomic.server.serverInstantBusyThread.job(serverInstantBusyThread.java:96)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:143)



THREADS WITH STATES: NEW


THREADS WITH STATES: TERMINATED


************* End Thread Dump Thu Jun 18 21:31:43 CEST 2009 *******************
Lotus
 
Beiträge: 1699
Registriert: Mi Jun 27, 2007 3:33 pm
Wohnort: Hamburg

Re: Balancer "tot"

Beitragvon Hermes » Do Sep 24, 2009 12:38 pm

Fix in SVN 6341
Hermes
 
Beiträge: 50
Registriert: Mi Jun 27, 2007 11:10 pm
Wohnort: Ratingen

Re: Balancer "tot"

Beitragvon Quix0r » Fr Sep 25, 2009 1:12 am

Sollte man doubleclick.net nicht eh blacklisten? Nur so angemerkt. #privacy
Quix0r
 
Beiträge: 1345
Registriert: Di Jul 31, 2007 9:22 am
Wohnort: Krefeld


Zurück zu Fragen und Antworten

Wer ist online?

Mitglieder in diesem Forum: Bing [Bot] und 2 Gäste