IOException NIOFSIndexInput

Keine Scheu, hier darf alles gefragt und diskutiert werden. Das ist das Forum für YaCy-Anfänger. Hier kann man 'wo muss man klicken' fragen und sich über Grundlagen zur Suchmaschinentechnik unterhalten.
Forumsregeln
Hier werden Fragen beantwortet und wir versuchen die Probleme von YaCy-Newbies zu klären. Bitte beantwortete Fragen im YaCy-Wiki http://wiki.yacy.de dokumentieren!

IOException NIOFSIndexInput

Beitragvon dennisn » Do Jan 31, 2013 3:25 pm

After about a day or so of uptime, I get a continuous (the log files start getting swamped, with timestamps showing that this error occurs over 100 times per second) stream of IOException's. My CPU goes to 100%, so it's not just an IO issue. I think I set my yacy to use only 300MB, and my data directory to 2G. I'm using the 1.3 pre-compiled linux jar. I had to pkill the process.

E 2013/01/31 06:40:08 org.apache.solr.core.SolrCore java.io.IOException: null: NIOFSIndexInput(path="/opt/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_40/data/index/_65f_Lucene40_0. tim")
at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.readInternal(NIOFSDirectory.java:190)
at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:272)
at org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:51)
at org.apache.lucene.store.DataInput.readVInt(DataInput.java:108)
at org.apache.lucene.store.BufferedIndexInput.readVInt(BufferedIndexInput.java:219)
at org.apache.lucene.codecs.BlockTreeTermsReader$FieldReader$SegmentTermsEnum$Frame.loadBlock(BlockTreeTermsReader.java:2342)
at org.apache.lucene.codecs.BlockTreeTermsReader$FieldReader$SegmentTermsEnum.seekExact(BlockTreeTermsReader.java:1678)
at org.apache.lucene.index.TermContext.build(TermContext.java:95)
at org.apache.lucene.search.TermQuery.createWeight(TermQuery.java:167)
at org.apache.lucene.search.IndexSearcher.createNormalizedWeight(IndexSearcher.java:647)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:280)
at org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1385)
at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1260)
at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:390)
at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:411)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:206)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1699)
at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:150)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at net.yacy.cora.federate.solr.connector.EmbeddedSolrConnector.query(EmbeddedSolrConnector.java:199)
at net.yacy.cora.federate.solr.connector.SolrServerConnector.getQueryCount(SolrServerConnector.java:330)
at net.yacy.cora.federate.solr.connector.AbstractSolrConnector.exists(AbstractSolrConnector.java:65)
at net.yacy.cora.federate.solr.connector.MirrorSolrConnector.exists(MirrorSolrConnector.java:257)
at net.yacy.search.index.Fulltext.exists(Fulltext.java:474)
at transferRWI.respond(transferRWI.java:204)
at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at net.yacy.server.http.HTTPDFileHandler.invokeServlet(HTTPDFileHandler.java:1419)
at net.yacy.server.http.HTTPDFileHandler.doResponse(HTTPDFileHandler.java:953)
at net.yacy.server.http.HTTPDFileHandler.doPost(HTTPDFileHandler.java:258)
at net.yacy.server.http.HTTPDemon.POST(HTTPDemon.java:537)
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at net.yacy.server.serverCore$Session.listen(serverCore.java:767)
at net.yacy.server.serverCore$Session.run(serverCore.java:658)
Caused by: java.nio.channels.ClosedChannelException
at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:94)
at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:665)
at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.readInternal(NIOFSDirectory.java:175)
... 38 more


I also get a handful of OutOfMemoryError's:

E 2013/01/31 06:40:26 org.apache.solr.update.CommitTracker auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit
at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2717)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2875)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2855)
at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:531)
at org.apache.solr.update.CommitTracker.run(CommitTracker.java:215)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)

Ideas?
dennisn
 
Beiträge: 1
Registriert: Mi Jan 30, 2013 4:28 am

Re: IOException NIOFSIndexInput

Beitragvon Orbiter » Di Feb 26, 2013 5:24 pm

the NIOFSIndexInput could be caused by a synchronization problem (or not-synchronized access to a not-synchronized method) which is fixed in yacy_v1.3_20130226_9150. Please try this.
Orbiter
 
Beiträge: 5786
Registriert: Di Jun 26, 2007 10:58 pm
Wohnort: Frankfurt am Main


Zurück zu Hilfe für Einsteiger und Anwender

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast

cron