[CLOSE] SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Hier finden YaCy User Hilfe wenn was nicht funktioniert oder anders funktioniert als man dachte. Bei offensichtlichen Fehlern diese bitte gleich in die Bugs (http://bugs.yacy.net) eintragen.
Forumsregeln
In diesem Forum geht es um Benutzungsprobleme und Anfragen für Hilfe. Wird dabei ein Bug identifiziert, wird der thread zur Bearbeitung in die Bug-Sektion verschoben. Wer hier also einen Thread eingestellt hat und ihn vermisst, wird ihn sicherlich in der Bug-Sektion wiederfinden.

[CLOSE] SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Beitragvon Quix0r » Fr Apr 09, 2010 2:49 am

Seit dem Update auf 6790 habe ich folgende NPEs beim Crawlen, sowohl lokale als auch Remote-Crawls:
Code: Alles auswählen
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@bca3d30aError: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@ce6bcd90Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@2ba5381dError: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@a2c24bf7Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@4dc13605Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@66259f88Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@ede60f05Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@a5fece5fError: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@e03d59d0Error: java.lang.NullPointerException
java.lang.NullPointerException
W 2010/04/09 03:19:53 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@34920787Error: java.lang.NullPointerException
java.lang.NullPointerException


Und diese Exception:
Code: Alles auswählen
W 2010/04/09 03:19:54 StackTrace NULs may not be present in string parts
java.lang.IllegalArgumentException: NULs may not be present in string parts
        at org.apache.commons.httpclient.methods.multipart.StringPart.<init>(StringPart.java:91)
        at de.anomic.http.client.DefaultCharsetStringPart.<init>(DefaultCharsetStringPart.java:47)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1047)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:200)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:397)
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
W 2010/04/09 03:19:54 StackTrace null
java.lang.reflect.InvocationTargetException
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalArgumentException: NULs may not be present in string parts
        at org.apache.commons.httpclient.methods.multipart.StringPart.<init>(StringPart.java:91)
        at de.anomic.http.client.DefaultCharsetStringPart.<init>(DefaultCharsetStringPart.java:47)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1047)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:200)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:397)
        ... 11 more
Zuletzt geändert von Quix0r am Do Sep 23, 2010 4:46 am, insgesamt 1-mal geändert.
Quix0r
 
Beiträge: 1345
Registriert: Di Jul 31, 2007 9:22 am
Wohnort: Krefeld

Re: SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Beitragvon sixcooler » Sa Apr 10, 2010 1:24 am

ich finde diesen Fehler ja recht spooky - konnte es auch kaum glauben bis einer meiner peers auch damit anfing...

@Quix0r checke mal bitte revision 6791

eigentlich weiss ich nicht wo da 'ne Null herkommen sollte - in 6790 hat Orbiter so viele asserts dazu gesetzt...
sixcooler
 
Beiträge: 494
Registriert: Do Aug 14, 2008 5:22 pm

Re: SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Beitragvon Hermes » Sa Apr 10, 2010 1:27 am

Quix0r hat geschrieben:Seit dem Update auf 6790 [...]

Und diese Exception:
Code: Alles auswählen
W 2010/04/09 03:19:54 StackTrace NULs may not be present in string parts
java.lang.IllegalArgumentException: NULs may not be present in string parts
        at org.apache.commons.httpclient.methods.multipart.StringPart.<init>(StringPart.java:91)
        at de.anomic.http.client.DefaultCharsetStringPart.<init>(DefaultCharsetStringPart.java:47)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1047)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:200)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:397)
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
W 2010/04/09 03:19:54 StackTrace null
java.lang.reflect.InvocationTargetException
        at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalArgumentException: NULs may not be present in string parts
        at org.apache.commons.httpclient.methods.multipart.StringPart.<init>(StringPart.java:91)
        at de.anomic.http.client.DefaultCharsetStringPart.<init>(DefaultCharsetStringPart.java:47)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1047)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:200)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:397)
        ... 11 more

Mit eingeschalteten Asserts kommt dieser Fehler etwas früher und bei einem großen Anteil der DHT-out Versuche:
Code: Alles auswählen
W 2010/04/10 01:54:06 StackTrace null
java.lang.AssertionError
        at net.yacy.kelondro.data.meta.URIMetadataRow.corePropList(URIMetadataRow.java:333)
        at net.yacy.kelondro.data.meta.URIMetadataRow.toString(URIMetadataRow.java:532)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1044)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:222)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:431)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
W 2010/04/10 01:54:06 StackTrace null
java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.AssertionError
        at net.yacy.kelondro.data.meta.URIMetadataRow.corePropList(URIMetadataRow.java:333)
        at net.yacy.kelondro.data.meta.URIMetadataRow.toString(URIMetadataRow.java:532)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1044)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:222)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:431)
        ... 12 more
E 2010/04/10 01:54:06 BLOCKINGTHREAD Runtime Error in serverInstantThread.job, thread 'java.lang.reflect.Method.storeDocumentIndex.0': null; target exception: null
java.lang.AssertionError
        at net.yacy.kelondro.data.meta.URIMetadataRow.corePropList(URIMetadataRow.java:333)
        at net.yacy.kelondro.data.meta.URIMetadataRow.toString(URIMetadataRow.java:532)
        at de.anomic.yacy.yacyClient.transferURL(yacyClient.java:1044)
        at de.anomic.yacy.yacyClient.transferIndex(yacyClient.java:943)
        at de.anomic.yacy.dht.Transmission$Chunk.transmit(Transmission.java:222)
        at de.anomic.yacy.dht.Dispatcher.storeDocumentIndex(Dispatcher.java:431)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:616)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)

Der Fehler scheint in der Behandlung von leeren Referrern zu liegen (at net.yacy.kelondro.data.meta.URIMetadataRow.corePropList(URIMetadataRow.java:333)):
Code: Alles auswählen
s.append(",referrer=").append(referrerHash() == null ? "" : new String(referrerHash()));
referrerHash() scheint unter bestimmten Umständen Arrays mit null-Bytes zurückzugeben, anstatt null selber.
Hermes
 
Beiträge: 50
Registriert: Mi Jun 27, 2007 11:10 pm
Wohnort: Ratingen

Re: SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Beitragvon Quix0r » Sa Apr 10, 2010 5:30 am

Hmmm, ich hatte leider wegen voller Festplatte einige Dateien (u.a. webstructure und die stacks) loeschen muessen, da diese fehlerhaft waren (wegen Plattenmangel). Auch ist ein weiterer grosser Blob kaputt gegangen (bzw. macht wie der andere beim Hochfahren Warnings). Ich koennte den auch hochladen, nur bei Bedarf.

Und dass die NPE kommt ist okay?

Edit: Leider war ein killYACY.sh noetig:
Code: Alles auswählen
I 2010/04/10 08:05:45 STEERING log-in attempt for steering from 127.0.0.1
I 2010/04/10 08:05:45 STEERING shutdown request from 127.0.0.1
I 2010/04/10 08:05:45 PLASMA caught delayed terminate request: shutdown request from Steering; ip = 127.0.0.1
I 2010/04/10 08:05:45 PLASMA crawlReceipt: RECEIVED RECEIPT from mflNQDx6Wn__:westpol/0.9400679 for URL lWcBjQPzJsJR:http://www.fotonkusagi.net/
I 2010/04/10 08:05:46 PLASMA caught terminate request: shutdown request from Steering; ip = 127.0.0.1
S 2010/04/10 08:05:46 SHUTDOWN caught termination signal
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.Segment$ReferenceCleaner
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.MetadataRepository$BlacklistCleaner
I 2010/04/10 08:05:46 SERVER Closing server socket ...
I 2010/04/10 08:05:46 SERVER Closing server sessions ...
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.Segment$ReferenceCleaner
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.MetadataRepository$BlacklistCleaner
D 2010/04/10 08:05:46 BusyThread socket-job interrupted: Socket closed
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.Segment$ReferenceCleaner
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.MetadataRepository$BlacklistCleaner
I 2010/04/10 08:05:46 SERVER Closing server socket ...
I 2010/04/10 08:05:46 SERVER Closing server sessions ...
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.Segment$ReferenceCleaner
E 2010/04/10 08:05:46 SERVER serverCore.getJobList - thread is not Session: de.anomic.search.MetadataRepository$BlacklistCleaner
S 2010/04/10 08:05:46 BusyThread thread 'httpd:8080' terminated.
W 2010/04/10 08:05:46 HTTPC wget(http://localhost:8080/) failed: Connection refused
S 2010/04/10 08:05:46 SHUTDOWN sent termination signal to server socket
I 2010/04/10 08:05:50 INDEX-TRANSFER-DISPATCHER selectContainersEnqueueToCloud: selectedContainerCache was filled with 41 entries
I 2010/04/10 08:05:50 INDEX-TRANSFER-DISPATCHER splitContainersFromCache: splittedContainerCache filled with 16 partitions, deleting selectedContainerCache
I 2010/04/10 08:05:50 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Bc0nkvMHxu__/0 with 41 index containers.
I 2010/04/10 08:05:51 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Fc0nkvMHxu__/1 with 41 index containers.
I 2010/04/10 08:05:51 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Jc0nkvMHxu__/2 with 41 index containers.
W 2010/04/10 08:05:53 Digest using generic instead of pooled digest
W 2010/04/10 08:05:53 Digest using generic instead of pooled digest
I 2010/04/10 08:05:53 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Nc0nkvMHxu__/3 with 41 index containers.
I 2010/04/10 08:05:54 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Rc0nkvMHxu__/4 with 41 index containers.
I 2010/04/10 08:05:54 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Vc0nkvMHxu__/5 with 41 index containers.
I 2010/04/10 08:05:55 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key Zc0nkvMHxu__/6 with 41 index containers.
I 2010/04/10 08:05:55 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key dc0nkvMHxu__/7 with 41 index containers.
I 2010/04/10 08:05:55 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key hc0nkvMHxu__/8 with 41 index containers.
I 2010/04/10 08:05:55 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key lc0nkvMHxu__/9 with 41 index containers.
I 2010/04/10 08:05:55 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key pc0nkvMHxu__/10 with 41 index containers.
D 2010/04/10 08:05:56 ROBOTS Trying to download the robots.txt file from URL 'http://www.childrensillustrators.com/robots.txt'.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key tc0nkvMHxu__/11 with 41 index containers.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key xc0nkvMHxu__/12 with 41 index containers.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 1c0nkvMHxu__/13 with 41 index containers.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 5c0nkvMHxu__/14 with 41 index containers.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 9c0nkvMHxu__/15 with 41 index containers.
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER selectContainersEnqueueToCloud: splittedContainerCache enqueued to cloud array which has now 80 entries.
I 2010/04/10 08:05:56 PLASMA dhtTransferJob: result from enqueueing: true
I 2010/04/10 08:05:56 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:05:56 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Jc0nkvMHxu__
I 2010/04/10 08:05:59 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 79
I 2010/04/10 08:05:59 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:05:59 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Nc0nkvMHxu__
I 2010/04/10 08:06:01 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 78
I 2010/04/10 08:06:01 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:01 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Vc0nkvMHxu__
I 2010/04/10 08:06:04 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 77
I 2010/04/10 08:06:04 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:04 INDEX-TRANSFER-DISPATCHER starting new index transmission request to pc0nkvMHxu__
I 2010/04/10 08:06:06 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 76
I 2010/04/10 08:06:06 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:06 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Bc0nkvMHxu__
I 2010/04/10 08:06:09 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:06:09 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:09 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Zc0nkvMHxu__
I 2010/04/10 08:06:11 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 74
I 2010/04/10 08:06:11 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:11 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Rc0nkvMHxu__
D 2010/04/10 08:06:14 URLDBCLEANER 332 blacklisted (0.007646999750320852%): ErCYbFEIRTEY http://aika.tinig.com/wp-trackback.php?p=36
I 2010/04/10 08:06:14 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 73
I 2010/04/10 08:06:14 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:14 INDEX-TRANSFER-DISPATCHER starting new index transmission request to dc0nkvMHxu__
I 2010/04/10 08:06:16 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 72
I 2010/04/10 08:06:16 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:16 INDEX-TRANSFER-DISPATCHER starting new index transmission request to Fc0nkvMHxu__
I 2010/04/10 08:06:19 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 71
I 2010/04/10 08:06:19 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:21 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 70
I 2010/04/10 08:06:21 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:24 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 69
I 2010/04/10 08:06:24 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:26 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 68
I 2010/04/10 08:06:26 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:29 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 67
I 2010/04/10 08:06:29 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:31 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 66
I 2010/04/10 08:06:31 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:34 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 65
I 2010/04/10 08:06:34 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:36 PLASMA dhtTransferJob: selected QJv73Q3IlSI6 as start hash
I 2010/04/10 08:06:36 PLASMA dhtTransferJob: selected Wgfbb_pYT7AM as limit hash
D 2010/04/10 08:06:37 URLDBCLEANER 333 blacklisted (0.007667405009371272%): ErFYIrqx2bQZ http://blog.songbirdnest.com/2009/06/18/songbird-12-is-here/trackback/
I 2010/04/10 08:06:40 INDEX-TRANSFER-DISPATCHER selectContainersEnqueueToCloud: selectedContainerCache was filled with 17 entries
I 2010/04/10 08:06:40 INDEX-TRANSFER-DISPATCHER splitContainersFromCache: splittedContainerCache filled with 16 partitions, deleting selectedContainerCache
I 2010/04/10 08:06:40 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key AJwCek9mld__/0 with 17 index containers.
I 2010/04/10 08:06:40 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key EJwCek9mld__/1 with 17 index containers.
I 2010/04/10 08:06:40 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key IJwCek9mld__/2 with 17 index containers.
I 2010/04/10 08:06:41 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key MJwCek9mld__/3 with 17 index containers.
I 2010/04/10 08:06:41 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key QJwCek9mld__/4 with 17 index containers.
I 2010/04/10 08:06:41 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key UJwCek9mld__/5 with 17 index containers.
I 2010/04/10 08:06:42 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key YJwCek9mld__/6 with 17 index containers.
I 2010/04/10 08:06:42 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key cJwCek9mld__/7 with 17 index containers.
I 2010/04/10 08:06:42 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key gJwCek9mld__/8 with 17 index containers.
I 2010/04/10 08:06:42 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key kJwCek9mld__/9 with 17 index containers.
I 2010/04/10 08:06:42 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key oJwCek9mld__/10 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key sJwCek9mld__/11 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key wJwCek9mld__/12 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 0JwCek9mld__/13 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 4JwCek9mld__/14 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER enqueueContainers: selected 9 targets for primary target key 8JwCek9mld__/15 with 17 index containers.
I 2010/04/10 08:06:43 INDEX-TRANSFER-DISPATCHER selectContainersEnqueueToCloud: splittedContainerCache enqueued to cloud array which has now 78 entries.
I 2010/04/10 08:06:43 PLASMA dhtTransferJob: result from enqueueing: true
I 2010/04/10 08:06:43 PLASMA dhtTransferJob: result from dequeueing: true
D 2010/04/10 08:06:43 URLDBCLEANER 334 blacklisted (0.007689835327011399%): ErGDzUqCDqsD http://regenbogenfamilie.eu/2009/05/27/vollzahlig-2/trackback/
I 2010/04/10 08:06:46 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 77
I 2010/04/10 08:06:46 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:48 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 76
I 2010/04/10 08:06:48 PLASMA dhtTransferJob: result from dequeueing: true
I 2010/04/10 08:06:51 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:06:51 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:07:06 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:07:06 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:07:21 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:07:21 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:07:36 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:07:36 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:07:51 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:07:51 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
D 2010/04/10 08:07:52 URLDBCLEANER 335 blacklisted (0.007704792818121121%): ErPSWqhfx3GR http://clayton.ctr4process.org/2009/09/12/religion-and-science-toward-a-postmodern-truce/trackback/
I 2010/04/10 08:08:06 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:08:06 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
D 2010/04/10 08:08:15 URLDBCLEANER 336 blacklisted (0.007725024088970206%): ErSUKUs8lqsC http://piraten-sachsen.de/2009/08/08/irc-interview/trackback/
I 2010/04/10 08:08:21 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:08:21 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:08:36 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:08:36 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:08:51 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:08:51 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
D 2010/04/10 08:08:58 URLDBCLEANER 337 blacklisted (0.007742833169286364%): ErYOUq-89uWR http://www.netzpolitik.org/2009/jim-09-nicht-einmal-50-der-jugendlichen-nutzen-privatsphaere-optionen/trackback/
D 2010/04/10 08:09:00 URLDBCLEANER 338 blacklisted (0.007765559147828676%): ErYf_qnM8WqR http://www.christisall.org/2009/10/18/the-kingdom-of-christ-from-commencement-to-completion-video-series-chapter-6-revealing-the-annointed-king-part-5/trackback/
D 2010/04/10 08:09:01 URLDBCLEANER 339 blacklisted (0.0077884572306865215%): ErYmPw561Jya http://www.blendernation.com/about/trackback/
D 2010/04/10 08:09:02 URLDBCLEANER 340 blacklisted (0.00781134409338324%): ErYslGnP-G7Z http://kikuelo.wordpress.com/2008/08/31/%c2%bfcomo-darse-de-baja-de-orange-sin-penalizaciones/trackback/
I 2010/04/10 08:09:06 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:09:06 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:09:21 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:09:21 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
D 2010/04/10 08:09:27 URLDBCLEANER 341 blacklisted (0.007831362516986134%): Erb3IqGqfdrC http://www.alkoholpolitik.ch/2009/11/30/mixing-alcohol-and-sex-puts-young-people-at-risk/7769/trackback/
I 2010/04/10 08:09:36 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:09:36 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
I 2010/04/10 08:09:51 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:09:51 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
D 2010/04/10 08:10:03 URLDBCLEANER 342 blacklisted (0.007849915131400004%): ErgysMu0EQ6Z http://www.visionmobile.com/blog/2009/03/carnival-of-the-mobilists-165/trackback/
I 2010/04/10 08:10:06 PLASMA dhtTransferJob: no selection, too many entries in transmission cloud: 75
I 2010/04/10 08:10:06 PLASMA dhtTransferJob: no dequeueing from cloud to transmission: too many concurrent sessions: 10
Quix0r
 
Beiträge: 1345
Registriert: Di Jul 31, 2007 9:22 am
Wohnort: Krefeld

Re: SVN 6790: NPEs beim Crawlen und "NULs may not be..."

Beitragvon Quix0r » Sa Apr 10, 2010 8:57 am

Nein ist mit 6791 nicht gefixt:
Code: Alles auswählen
W 2010/04/10 09:58:44 STACKCRAWL Error while processing stackCrawl entry.
Entry: de.anomic.crawler.retrieval.Request@ab1ac889Error: java.lang.NullPointerException
java.lang.NullPointerException
        at java.lang.String.<init>(String.java:593)
        at de.anomic.crawler.CrawlStacker.stackCrawl(CrawlStacker.java:318)
        at de.anomic.crawler.CrawlStacker.job(CrawlStacker.java:142)
        at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at net.yacy.kelondro.workflow.InstantBlockingThread.job(InstantBlockingThread.java:103)
        at net.yacy.kelondro.workflow.AbstractBlockingThread.run(AbstractBlockingThread.java:66)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)

Betroffen scheint wohl nur der lokale Crawl-Stacker zu sein, der Remote-Crawler laeuft bis jetzt wieder brav. :twisted:
Quix0r
 
Beiträge: 1345
Registriert: Di Jul 31, 2007 9:22 am
Wohnort: Krefeld


Zurück zu Fragen und Antworten

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast

cron