Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Hier finden YaCy User Hilfe wenn was nicht funktioniert oder anders funktioniert als man dachte. Bei offensichtlichen Fehlern diese bitte gleich in die Bugs (http://bugs.yacy.net) eintragen.
Forumsregeln
In diesem Forum geht es um Benutzungsprobleme und Anfragen für Hilfe. Wird dabei ein Bug identifiziert, wird der thread zur Bearbeitung in die Bug-Sektion verschoben. Wer hier also einen Thread eingestellt hat und ihn vermisst, wird ihn sicherlich in der Bug-Sektion wiederfinden.

Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Vega » Do Nov 20, 2008 7:45 pm

Hallo allerseits, ich habe gestern meinen Peer neu installiert, SVN 0.614/05349 , 1024 MB Speicher zugewiesen, im Statusfenster werden 580 MB frei angezeigt,
und trotzdem ist das LOG voll mit OutOfMemory Fehlern. Java Version ist:

java version "1.6.0_10"
Java(TM) SE Runtime Environment (build 1.6.0_10-b33)
Java HotSpot(TM) 64-Bit Server VM (build 11.0-b15, mixed mode)

Kann sich das mal jemand ansehen oder nachvollziehen ??????

Code: Alles auswählen
E 2008/11/20 19:17:41 BUSYTHREAD Runtime Error in serverInstantThread.job, thread 'de.anomic.plasma.plasmaSwitchboard.deQueueProcess': null; target exception: Java heap space
java.lang.OutOfMemoryError: Java heap space
E 2008/11/20 19:17:42 YACY yacyClient.permissionTransfer error:Connection refused
I 2008/11/20 19:17:42 PLASMA RankingDistribution - error transmitting file /media/Data/yacy1/DATA/RANKING/GLOBAL/014_othercr/CRG-A-20081120180630016.xSlcb5bkRnYQ.cr.gz to kaskelix.de:8080: no connection to remote address kaskelix.de:8080; phase 1
I 2008/11/20 19:17:42 PLASMA RankingDistribution - error transmitting file /media/Data/yacy1/DATA/RANKING/GLOBAL/014_othercr/CRG-A-20081120180630016.xSlcb5bkRnYQ.cr.gz to yacy.dyndns.org:8000: remote peer rejected transfer: denied
I 2008/11/20 19:17:43 PLASMA RankingDistribution - error transmitting file /media/Data/yacy1/DATA/RANKING/GLOBAL/014_othercr/CRG-A-20081120180630016.xSlcb5bkRnYQ.cr.gz to 131.246.103.123:12000: remote peer failed with transfer: transfer failure
I 2008/11/20 19:17:44 PLASMA RankingDistribution - transmitted file /media/Data/yacy1/DATA/RANKING/GLOBAL/014_othercr/CRG-A-20081120180630016.xSlcb5bkRnYQ.cr.gz to 87.187.77.104:8080 successfully in 0 seconds
D 2008/11/20 19:17:44 KELONDRO file '/media/Data/yacy1/DATA/INDEX/freeworld/NETWORK/newsProcessed.stack' closed.
D 2008/11/20 19:17:44 KELONDRO file '/media/Data/yacy1/DATA/INDEX/freeworld/NETWORK/newsPublished.stack' closed.
I 2008/11/20 19:17:44 YACY rulebasedUpdateInfo: not an automatic update selected
I 2008/11/20 19:17:44 RESOURCE OBSERVER df of Volume /media/Data: 283728 MB
I 2008/11/20 19:17:44 RESOURCE OBSERVER run completed; everything in order
I 2008/11/20 19:17:59 PLASMA Collecting DHT target peers for first_hash = bpYDI8HnD_OC, last_hash = bqRGXQrdRoVl
I 2008/11/20 19:17:59 PLASMA Selected DHT target peer ubuntu:d5gyHgAFbOCu, distance2first = 324566474306825848, distance2last = 322559192811705136
I 2008/11/20 19:17:59 PLASMA Selected DHT target peer kupferhammer-keller:d5mo-DnL5jS2, distance2first = 324772551617309472, distance2last = 322765270122188760
I 2008/11/20 19:17:59 PLASMA Selected DHT target peer underground-02:gmE_DHf6kFMY, distance2first = 713149788833038384, distance2last = 711142507337917672
I 2008/11/20 19:18:01 PLASMA Index transfer of 960 entries 75 words [bpYDI8HnD_OC .. bqRGXQrdRoVl] and 943 URLs to peer ubuntu:d5gyHgAFbOCu in 1 seconds successful (615 words/s, 200135 Bytes)
I 2008/11/20 19:18:01 PLASMA DHT distribution: transfer to peer ubuntu finished.
I 2008/11/20 19:18:01 PLASMA Index transfer of 960 entries 75 words [bpYDI8HnD_OC .. bqRGXQrdRoVl] and 943 URLs to peer underground-02:gmE_DHf6kFMY in 2 seconds successful (476 words/s, 342359 Bytes)
I 2008/11/20 19:18:01 PLASMA DHT distribution: transfer to peer underground-02 finished.
W 2008/11/20 19:18:03 FILEHANDLER Unexpected error while processing query.
Session: Session_91.64.85.195:64382#0
Query:   /yacy/hello.html
Client:  91.64.85.195
Reason:  java.io.IOException: FileUploadException Stream ended unexpectedly
java.io.IOException: FileUploadException Stream ended unexpectedly
   at de.anomic.http.httpd.parseMultipart(httpd.java:907)
   at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:345)
   at de.anomic.http.httpdFileHandler.doPost(httpdFileHandler.java:251)
   at de.anomic.http.httpd.POST(httpd.java:627)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
   at de.anomic.server.serverCore$Session.run(serverCore.java:626)
W 2008/11/20 19:18:04 PLASMA Transfer to peer kupferhammer-keller:d5mo-DnL5jS2 failed:'no_result_2', Trying to reconnect ...
I 2008/11/20 19:18:04 PLASMA Selected DHT target peer KSBA-YaCy:grjH7GYu__lo, distance2first = 725469197997701120, distance2last = 723461916502580408
I 2008/11/20 19:18:05 PLASMA Peer KSBA-YaCy:grjH7GYu__lo is busy. Waiting 30000 ms.
I 2008/11/20 19:18:05 PLASMA Selected DHT target peer KIT002F:iS7NivAgXU93, distance2first = 958252092976047784, distance2last = 956244811480927072
I 2008/11/20 19:18:07 PLASMA Received 309 Entries 14 Words [juha7MKmtWvk .. jvmuMuexNR8T]/1565010764184316300 from SDDd7JlhUIO3:burkhardYACY/0.6140535, processed in 53 milliseconds, requesting 84/302 URLs, blocked 0 RWIs
E 2008/11/20 19:18:11 FILEHANDLER INTERNAL ERROR: java.lang.reflect.InvocationTargetException:null target exception at /media/Data/yacy1/htroot/yacy/transferURL.class: java.lang.OutOfMemoryError: Java heap space:Java heap space
java.lang.reflect.InvocationTargetException
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1017)
   at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:601)
   at de.anomic.http.httpdFileHandler.doPost(httpdFileHandler.java:251)
   at de.anomic.http.httpd.POST(httpd.java:627)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
   at de.anomic.server.serverCore$Session.run(serverCore.java:626)
Caused by: java.lang.OutOfMemoryError: Java heap space
W 2008/11/20 19:18:11 FILEHANDLER Unexpected error while processing query.
Session: Session_88.76.199.81:63332#1
Query:   /yacy/transferURL.html
Client:  88.76.199.81
Reason:  java.lang.reflect.InvocationTargetException
java.lang.reflect.InvocationTargetException
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1017)
   at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:601)
   at de.anomic.http.httpdFileHandler.doPost(httpdFileHandler.java:251)
   at de.anomic.http.httpd.POST(httpd.java:627)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
   at de.anomic.server.serverCore$Session.run(serverCore.java:626)
Caused by: java.lang.OutOfMemoryError: Java heap space
I 2008/11/20 19:18:11 PLASMA Received 997 Entries 310 Words [nSRCAILUUMuB .. saA5eo-Ho7Ki]/684384865316857612 from sKnZAPtjfivM:BluumiONE/0.6130534, processed in 94 milliseconds, requesting 61/61 URLs, blocked 0 RWIs
E 2008/11/20 19:18:13 FILEHANDLER INTERNAL ERROR: java.lang.reflect.InvocationTargetException:null target exception at /media/Data/yacy1/htroot/yacy/transferURL.class: java.lang.OutOfMemoryError: Java heap space:Java heap space
java.lang.reflect.InvocationTargetException
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1017)
   at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:601)
   at de.anomic.http.httpdFileHandler.doPost(httpdFileHandler.java:251)
   at de.anomic.http.httpd.POST(httpd.java:627)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
   at de.anomic.server.serverCore$Session.run(serverCore.java:626)
Caused by: java.lang.OutOfMemoryError: Java heap space
Zuletzt geändert von Vega am So Nov 23, 2008 11:36 pm, insgesamt 1-mal geändert.
Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon auser » Do Nov 20, 2008 8:50 pm

Genau das gleiche hatte ich auch, noch 300MB frei aber ständig OutOfMemoryError beim Aufruf von /yacy/transferURL.html. Bei den RWIs gab es keine Probleme nur mit den URLs. Ein Neustart hat bei mir aber geholfen. Vielleicht ist der Speicher zu stark fragmentiert und der freie Speicher setzt sich nur aus ganz vielen kleinen Blöcken zusammen.

Aber die java version "1.6.0_10" scheint auch nicht stabil zu sein, habe hier ein anderes java Programm was immer ohne Probleme mit dem Schalter "-server" lief, jetzt crasht java und läuft nur noch ohne "-server".
auser
 

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Vega » Fr Nov 21, 2008 10:46 pm

Hier mal ein Screenshot + Threaddump dazu:
Memory.png
Memory.png (236.5 KiB) 1583-mal betrachtet


Code: Alles auswählen
************* Start Thread Dump Fri Nov 21 22:50:08 CET 2008 *******************

YaCy Version: 0.614/05349
Total Memory = 1070596096
Used  Memory = 361464904
Free  Memory = 709131192


THREADS WITH STATES: BLOCKED


THREADS WITH STATES: RUNNABLE

Thread= Session_127.0.0.1:33703#5045 id=65 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_127.0.0.1:33704#4893 id=67 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_127.0.0.1:33705#4893 id=68 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_127.0.0.1:38529#3862 id=4471 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= httpd:8080 id=62 RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at de.anomic.server.serverCore.job(serverCore.java:330)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:142)

Thread= Session_127.0.0.1:38528#3863 id=4470 RUNNABLE
at java.lang.Thread.dumpThreads(Native Method)
at java.lang.Thread.getAllStackTraces(Thread.java:1487)
at Threaddump_p.respond(Threaddump_p.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1017)
at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:601)
at de.anomic.http.httpdFileHandler.doGet(httpdFileHandler.java:243)
at de.anomic.http.httpd.GET(httpd.java:486)
at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_127.0.0.1:38527#3863 id=4469 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_85.178.115.119:43240#0 id=26634 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_134.107.24.49:57082#1 id=26617 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_79.233.74.29:3878#1 id=26667 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_84.62.61.204:1812#0 id=26658 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_212.227.94.119:42636#1 id=26704 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_195.202.180.115:49421#1 id=26715 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)

Thread= Session_80.108.179.39:59910#0 id=26687 RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.net.SocketInputStream.read(SocketInputStream.java:182)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at java.io.PushbackInputStream.read(PushbackInputStream.java:122)
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)


THREADS WITH STATES: TIMED_WAITING

Thread= Timer-0 id=52 TIMED_WAITING
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:509)
at java.util.TimerThread.run(Timer.java:462)

Thread= de.anomic.yacy.yacyCore.publishSeedList id=59 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= de.anomic.data.bookmarksDB.autoReCrawl id=18 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= de.anomic.yacy.yacyCore.peerPing id=60 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= sorting_pool-1-thread-1647 id=26718 TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= Thread-1 id=9 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverProfiling.run(serverProfiling.java:61)

Thread= de.anomic.crawler.CrawlStacker.job id=54 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= partition_pool-1-thread-1646 id=26717 TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= de.anomic.plasma.plasmaSwitchboard.dhtTransferJob id=61 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= de.anomic.plasma.plasmaSwitchboard.deQueueProcess id=55 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= partition_pool-1-thread-1645 id=26716 TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= de.anomic.crawler.CrawlQueues.coreCrawlJob id=58 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= sorting_pool-1-thread-1649 id=26723 TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= de.anomic.crawler.CrawlQueues.remoteCrawlLoaderJob id=57 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= de.anomic.plasma.plasmaSwitchboard.cleanupJob id=53 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)

Thread= sorting_pool-1-thread-1648 id=26719 TIMED_WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:945)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= de.anomic.crawler.CrawlQueues.remoteTriggeredCrawlJob id=56 TIMED_WAITING
at java.lang.Thread.sleep(Native Method)
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)


THREADS WITH STATES: WAITING

Thread= Reference Handler daemon id=2 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)

Thread= Thread-10 id=27 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at de.anomic.crawler.CrawlStacker.run(CrawlStacker.java:131)

Thread= condenseDocument_pool-1-thread-13 id=41 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= MultiThreadedHttpConnectionManager cleanup daemon id=26 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)

Thread= Java2D Disposer daemon id=69 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at sun.java2d.Disposer.run(Disposer.java:125)
at java.lang.Thread.run(Thread.java:619)

Thread= webStructureAnalysis_pool-1-thread-11 id=37 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= Finalizer daemon id=3 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

Thread= parseDocument_pool-1-thread-18 id=51 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= condenseDocument_pool-1-thread-14 id=43 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= parseDocument_pool-1-thread-17 id=49 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= main id=1 WAITING
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:485)
at de.anomic.server.serverSemaphore.P(serverSemaphore.java:63)
at de.anomic.plasma.plasmaSwitchboard.waitForShutdown(plasmaSwitchboard.java:2245)
at yacy.startup(yacy.java:420)
at yacy.main(yacy.java:1037)

Thread= urls_pool-1-thread-20 id=97 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= webStructureAnalysis_pool-1-thread-12 id=39 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= storeDocumentIndex_pool-1-thread-8 id=31 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= condenseDocument_pool-1-thread-15 id=45 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= webStructureAnalysis_pool-1-thread-10 id=35 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= urls_pool-1-thread-21 id=98 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)

Thread= parseDocument_pool-1-thread-16 id=47 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= storeDocumentIndex_pool-1-thread-7 id=29 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= storeDocumentIndex_pool-1-thread-9 id=33 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

Thread= urls_pool-1-thread-19 id=96 WAITING
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)


THREADS WITH STATES: NEW


THREADS WITH STATES: TERMINATED


************* End Thread Dump Fri Nov 21 22:50:08 CET 2008 *******************
Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Vega » So Nov 23, 2008 5:26 pm

So, ich habe mal kurz getestet, mit folgenden änderungen läuft mein Peer seit 2 Tagen durchgehen:

Änderungen in der yacy.conf

javastart_Xms=Xms384m
javastart_Xmx=Xmx1024m

Änderung in der startYACY.sh

Code: Alles auswählen
#get javastart args
JAVA_ARGS="-server -XX:+UseConcMarkSweepGC";
#JAVA_ARGS="-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails $JAVA_ARGS";

#check if Linux system supports large memory pages or if OS is Solaris which
#supports large memory pages since version 9
#(according to http://java.sun.com/javase/technologies/hotspot/largememory.jsp)
ENABLEHUGEPAGES=0;


Ich werde mal noch ein wenig testen, vielleicht hilft das ja schon jemandem.

Gruß,
Thomas
Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Vega » Mo Nov 24, 2008 9:59 pm

Nach ein wenig Documentation lesen, suchen im Internet, habe ich mir folgende Java-Start Parameter in die startYACY.sh eingetragen:

Code: Alles auswählen
#get javastart args
JAVA_ARGS="-server -XX:+UseParNewGC -XX:ParallelGCThreads=2 -XX:+UseConcMarkSweepGC";


-XX:+UseAdaptiveSizePolicy habe ich entfernt, ich hatte in einem Artikel über Java gelesen das diese Funktion manchmal etwas "eigenartig arbeitet,
siehe: http://www.angelikalanger.com/Articles/EffectiveJava/27.GCTuning/27.GCTuning.html

-XX:ParallelGCThreads=2 - Ist nur sinvoll bei Rechnern mit mehreren Kernen/CPU's, - entsprechen der Anzahl der Cores die zum GC benutzt werden sollen setzen.

Vielleicht könnte sich mal jemand von euch an der Start-Datei versuchen, so das man mit "jconsole" http://java.sun.com/j2se/1.5.0/docs/guide/management/jconsole.html sich zu Yacy verbinden kann, damit bekommt man recht nette Aussagen zur Speichernutzung etc.

Könnte man in Yacy auf der Seite "Hauptmenü">>"Speicher" - eine Anzeige einbauen die die momentan aktiven Java-Parameter zeigt ?

Gruß,
Thomas
Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Vega » So Dez 21, 2008 10:17 pm

Das Problem, dass dem Peer der Speicher ausgeht, besteht noch immer, außerdem lässt sich der Yacy gerade nicht beenden - ich hab mal einen Dump (aus dem Webinterface - der Peer lässt sich gerade nicht herunterfahren. ) angehängt - bitte schaut mal drüber, diese Geschichte ist lästig :(

Code: Alles auswählen
************* Start Thread Dump Sun Dec 21 22:11:01 CET 2008 *******************

YaCy Version: 0.616/05398
Total Memory = 2089811968
Used  Memory = 815319928
Free  Memory = 1274492040


THREADS WITH STATES: BLOCKED


THREADS WITH STATES: RUNNABLE

Thread= process reaper daemon id=73 RUNNABLE


Thread= Session_130.75.2.39:45046#3 id=34120 RUNNABLE
Thread= Session_212.227.94.119:37608#1 id=34109 RUNNABLE
Thread= Session_141.52.175.82:56122#0 id=34223 RUNNABLE
Thread= Session_84.143.97.92:35468#3 id=34221 RUNNABLE
Thread= Session_91.6.94.19:40025#0 id=34103 RUNNABLE
Thread= Session_91.55.91.236:60919#9 id=34097 RUNNABLE
Thread= Session_212.117.110.162:3278#0 id=34239 RUNNABLE
Thread= Session_141.52.175.83:60088#0 id=34238 RUNNABLE
Thread= Session_141.52.175.25:55672#0 id=34246 RUNNABLE
Thread= Session_212.117.110.167:10806#0 id=34245 RUNNABLE
Thread= Session_92.205.19.191:46748#1 id=34228 RUNNABLE
Thread= Session_85.176.250.120:4511#0 id=34227 RUNNABLE
Thread= Session_91.2.247.191:12853#0 id=34231 RUNNABLE
Thread= Session_127.0.0.1:58999#38 id=34058 RUNNABLE
Thread= Session_127.0.0.1:45502#39 id=34063 RUNNABLE
Thread= Session_127.0.0.1:58998#44 id=34057 RUNNABLE
Thread= Session_213.239.204.8:17121#2 id=34075 RUNNABLE
Thread= Session_127.0.0.1:45504#33 id=34066 RUNNABLE
Thread= Session_85.5.129.154:56420#3 id=34034 RUNNABLE
Thread= Session_85.5.129.154:56385#3 id=33959 RUNNABLE
Thread= Session_79.206.196.101:55316#0 id=34248 RUNNABLE
at de.anomic.server.serverCore.receive(serverCore.java:863)
at de.anomic.server.serverCore$Session.readLine(serverCore.java:572)
at de.anomic.server.serverCore$Session.listen(serverCore.java:694)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)


Thread= Session_127.0.0.1:45503#37 id=34064 RUNNABLE
at com.sun.imageio.plugins.png.IDATOutputStream.deflate(PNGImageWriter.java:203)
at com.sun.imageio.plugins.png.IDATOutputStream.write(PNGImageWriter.java:197)
at com.sun.imageio.plugins.png.PNGImageWriter.encodePass(PNGImageWriter.java:893)
at com.sun.imageio.plugins.png.PNGImageWriter.write_IDAT(PNGImageWriter.java:927)
at com.sun.imageio.plugins.png.PNGImageWriter.write(PNGImageWriter.java:1142)
at javax.imageio.ImageWriter.write(ImageWriter.java:598)
at javax.imageio.ImageIO.write(ImageIO.java:1479)
at javax.imageio.ImageIO.write(ImageIO.java:1565)
at de.anomic.ymage.ymageMatrix.exportImage(ymageMatrix.java:706)
at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:523)
at de.anomic.http.httpdFileHandler.doGet(httpdFileHandler.java:243)
at de.anomic.http.httpd.GET(httpd.java:487)
at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)


Thread= Session_127.0.0.1:58997#39 id=34056 RUNNABLE
at Threaddump_p.respond(Threaddump_p.java:90)
at de.anomic.http.httpdFileHandler.invokeServlet(httpdFileHandler.java:1018)
at de.anomic.http.httpdFileHandler.doResponse(httpdFileHandler.java:602)
at de.anomic.http.httpdFileHandler.doGet(httpdFileHandler.java:243)
at de.anomic.http.httpd.GET(httpd.java:487)
at de.anomic.server.serverCore$Session.listen(serverCore.java:762)
at de.anomic.server.serverCore$Session.run(serverCore.java:626)


Thread= httpd:8080 id=71 RUNNABLE
at de.anomic.server.serverCore.job(serverCore.java:330)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:142)



THREADS WITH STATES: TIMED_WAITING

Thread= Timer-0 id=60 TIMED_WAITING


Thread= de.anomic.plasma.plasmaSwitchboard.deQueueProcess id=64 TIMED_WAITING
Thread= de.anomic.crawler.CrawlStacker.job id=63 TIMED_WAITING
Thread= de.anomic.plasma.plasmaSwitchboard.cleanupJob id=61 TIMED_WAITING
Thread= de.anomic.crawler.CrawlQueues.coreCrawlJob id=67 TIMED_WAITING
Thread= de.anomic.yacy.yacyCore.peerPing id=69 TIMED_WAITING
Thread= de.anomic.crawler.CrawlQueues.remoteCrawlLoaderJob id=66 TIMED_WAITING
Thread= de.anomic.data.bookmarksDB.autoReCrawl id=32 TIMED_WAITING
Thread= de.anomic.plasma.plasmaSwitchboard.dhtTransferJob id=70 TIMED_WAITING
Thread= de.anomic.crawler.CrawlQueues.remoteTriggeredCrawlJob id=65 TIMED_WAITING
Thread= de.anomic.crawler.CrawlStacker.job id=62 TIMED_WAITING
Thread= de.anomic.yacy.yacyCore.publishSeedList id=68 TIMED_WAITING
at de.anomic.server.serverAbstractBusyThread.ratz(serverAbstractBusyThread.java:198)
at de.anomic.server.serverAbstractBusyThread.run(serverAbstractBusyThread.java:163)


Thread= Thread-1 id=9 TIMED_WAITING
at de.anomic.server.serverProfiling.run(serverProfiling.java:61)



THREADS WITH STATES: WAITING

Thread= MultiThreadedHttpConnectionManager cleanup daemon id=23 WAITING
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1122)


Thread= Reference Handler daemon id=2 WAITING
Thread= urls_pool-1-thread-18 id=95 WAITING
Thread= urls_pool-1-thread-19 id=96 WAITING
Thread= Finalizer daemon id=3 WAITING
Thread= Java2D Disposer daemon id=105 WAITING
Thread= urls_pool-1-thread-17 id=94 WAITING


Thread= webStructureAnalysis_pool-1-thread-8 id=43 WAITING
Thread= condenseDocument_pool-1-thread-13 id=53 WAITING
Thread= condenseDocument_pool-1-thread-12 id=51 WAITING
Thread= webStructureAnalysis_pool-1-thread-10 id=47 WAITING
Thread= webStructureAnalysis_pool-1-thread-9 id=45 WAITING
Thread= parseDocument_pool-1-thread-14 id=55 WAITING
Thread= storeDocumentIndex_pool-1-thread-7 id=41 WAITING
Thread= parseDocument_pool-1-thread-15 id=57 WAITING
Thread= condenseDocument_pool-1-thread-11 id=49 WAITING
Thread= parseDocument_pool-1-thread-16 id=59 WAITING
at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:63)


Thread= main id=1 WAITING
at de.anomic.server.serverSystem.openBrowser(serverSystem.java:306)
at yacy.startup(yacy.java:350)
at yacy.main(yacy.java:1037)



THREADS WITH STATES: NEW


THREADS WITH STATES: TERMINATED


************* End Thread Dump Sun Dec 21 22:11:01 CET 2008 *******************


Das erscheint an der Konsole:

I 2008/12/21 22:15:43 PLASMA Collecting DHT target peers for first_hash = b7f1UqP7RjDr, last_hash = b8xLfTYYS6Mz
I 2008/12/21 22:15:44 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:15:46 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:15:48 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:15:50 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:15:52 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:15:53 PLASMA Collecting DHT target peers for first_hash = F7Q6CfGfPzE-, last_hash = LKY83dVPlJDv
I 2008/12/21 22:15:58 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:00 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:02 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:03 PLASMA Collecting DHT target peers for first_hash = T8mv6hzO3FuG, last_hash = UC9MkKpZqk3v
I 2008/12/21 22:16:06 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:07 PLASMA Rejecting RWIs from peer QYD0ax_A8ed3:KIT050F300liebel-lab/0.61605406. We are too busy (buffersize=10029).
I 2008/12/21 22:16:08 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:10 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:12 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:13 PLASMA Collecting DHT target peers for first_hash = AVR9LI2e2acJ, last_hash = Diwn6rTwa90f
I 2008/12/21 22:16:15 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:17 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:19 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:21 PLASMA DEQUEUE: Shutdown detected.
I 2008/12/21 22:16:23 PLASMA Collecting DHT target peers for first_hash = U4j86hObKBQ3, last_hash = VO-dKfV7Pc1h
I 2008/12/21 22:16:24 PLASMA DEQUEUE: Shutdown detected.

Gruß,
Thomas
Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon whitecloud » Di Dez 23, 2008 5:08 pm

Hallo,

nur um dem Problem ein bisschen Nachdruck zu verleihen:

Ich habe das Problem aktuell auch. Nach spätestens 48 Stunden ist der Heap-Speicher zu.

Die Daten zum System:

OS X 10.5.6 mit Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_16-b06-284)
Yacy Version 0.616/05390

Speicherfreigabe für Yacy aktuell 1024 MB (von 2,5 GB)

Abhilfe und oder ein Feature zum (täglichen) automatischen Neustart der Engine wäre nett.
whitecloud
 
Beiträge: 38
Registriert: Mi Nov 05, 2008 4:24 pm

Out of Memory - Blödsinn

Beitragvon lulabad » Mi Dez 24, 2008 9:48 am

Was ist dass denn wieder für ein Blödsinn?
Habe yacy 1000MB zugewiesen (2000 insgesammt verfügbar). Heute morgen bekomme ich dann die Exception
Code: Alles auswählen
2008/12/24 09:31:01 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 4]: enqueued for load http://www.supershareware.com/software/free-drum-maker.html [oOvHxy34Iapa]
D 2008/12/24 09:31:02 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 3]: URL=http://www.softlist.net/program/macrium_reflect-software.html, initiator=ZaNAGdLdzVfc, crawlOrder=false, depth=0, crawlDepth=0, must-match=.*, must-not-match=, permission=true
I 2008/12/24 09:31:02 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 3]: enqueued for load http://www.softlist.net/program/macrium_reflect-software.html [7Jng1gdzT1FQ]
I 2008/12/24 09:31:03 PARSER Charset transformation needed from 'UTF-8' to 'ISO-8859-1' for URL = http://www.supershareware.com/software/free-drum-maker.html
I 2008/12/24 09:31:03 PLASMA Excluded 0 words in URL http://www.supershareware.com/software/free-drum-maker.html
*** DEBUG LANGUAGE-BY-STATISTICS: http://www.supershareware.com/software/free-drum-maker.html FAILED, taking TLD: en
java.lang.OutOfMemoryError: Java heap space
java.lang.reflect.InvocationTargetException
        at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at de.anomic.server.serverInstantBlockingThread.job(serverInstantBlockingThread.java:87)
        at de.anomic.server.serverAbstractBlockingThread.run(serverAbstractBlockingThread.java:64)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:269)
        at java.util.concurrent.FutureTask.run(FutureTask.java:123)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
        at java.lang.Thread.run(Thread.java:595)
Caused by: java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
E 2008/12/24 09:31:04 BLOCKINGTHREAD Runtime Error in serverInstantThread.job, thread 'java.lang.reflect.Method.storeDocumentIndex.7': null; target exception: Java heap space
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
D 2008/12/24 09:31:04 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 2]: URL=http://depo.hu/kenwood/a998a, initiator=ZaNAGdLdzVfc, crawlOrder=false, depth=0, crawlDepth=0, must-match=.*, must-not-match=, permission=true
I 2008/12/24 09:31:04 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 2]: enqueued for load http://depo.hu/kenwood/a998a [OjxOxtcuqu6A]
D 2008/12/24 09:31:05 CRAWLER REMOTETRIGGEREDCRAWL[0, 0, 0, 1]: URL=http://www.tomshardware.com/forum/profile-362944.htm, initiator=ZaNAGdLdzVfc, crawlOrder=false, depth=0, crawlDepth=0, must-match=.*, must-not-match=, permission=true
I 2008/12/24 09:31:05 PARSER Charset transformation needed from 'UTF-8' to 'ISO-8859-1' for URL = http://www.

Ein Blick auf das Webinterface offenbart mir folgendes.

Lauf Grafik braucht der Peer nur 600MB. Desweiteren befinden sich 816 Elemente in der Indexer Queue, tendenz steigend.
Threaddump gibts unter http://yacystats.de/~afieg/threaddump.txt
lulabad
 
Beiträge: 709
Registriert: Mi Jun 27, 2007 11:40 am
Wohnort: Im Herzen Bayerns

Re: Out of Memory - Blödsinn

Beitragvon Vega » Mi Dez 24, 2008 10:10 am

Vega
 
Beiträge: 824
Registriert: Mi Jun 27, 2007 3:34 pm
Wohnort: Dresden

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon lulabad » Mi Dez 24, 2008 2:36 pm

[x] Threads gemerged
lulabad
 
Beiträge: 709
Registriert: Mi Jun 27, 2007 11:40 am
Wohnort: Im Herzen Bayerns

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon LA_FORGE » So Dez 28, 2008 11:50 am

Habe das Problem jetzt auch, habe 480 MB RAM zugewiesen und bekomme die gleiche Fehlermeldung. Gibt's schon einen Lösungsansatz?
LA_FORGE
 
Beiträge: 557
Registriert: Sa Okt 11, 2008 5:24 pm

Re: Neuer Peer und java.lang.OutOfMemoryError: Java heap space

Beitragvon Orbiter » So Dez 28, 2008 7:45 pm

ich werde aus den OOM Fällen nicht ganz schlau, und der Thread dump zeigt als einzige Anomalie relativ viele, aber auch nicht viel zu viele offene Server Sessions. Es ist dann auch das Öffnen einer neuen Server Session die den OOM erzeugt. Wenn keine neue Server Sessions mehr gestartet werden können, kann man auch kein Shutdown über das Webinterface mehr machen. Insofern passt das alles zusammen. Ich weiss aber nicht warum es jetzt gerade ein Problem mit dem HTTPD/Session Handler geben soll, da hat ja keiner in der letzten Zeit was dran geändert. Für eine Lösung müssten wir mal gucken was das für Zugriffe sind, die die vielen Sessions öffnen.
Orbiter
 
Beiträge: 5792
Registriert: Di Jun 26, 2007 10:58 pm
Wohnort: Frankfurt am Main


Zurück zu Fragen und Antworten

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste

cron