Yacy startet nur sporadisch

Hier finden YaCy User Hilfe wenn was nicht funktioniert oder anders funktioniert als man dachte. Bei offensichtlichen Fehlern diese bitte gleich in die Bugs (http://bugs.yacy.net) eintragen.
Forumsregeln
In diesem Forum geht es um Benutzungsprobleme und Anfragen für Hilfe. Wird dabei ein Bug identifiziert, wird der thread zur Bearbeitung in die Bug-Sektion verschoben. Wer hier also einen Thread eingestellt hat und ihn vermisst, wird ihn sicherlich in der Bug-Sektion wiederfinden.

Yacy startet nur sporadisch

Beitragvon Rootix » Fr Jun 27, 2014 11:58 pm

Hallo,

ich habe Yacy vor einiger Zeit bereits in Windows benutzt, wo es durchaus sehr gut funktionierte. Mittlerweile bin ich jedoch mit meinem Arbeitssystem auf Ubuntu 14.04 umgestiegen und hier ergeben sich doch einige Probleme mit Yacy. Ich habe es auf eine Extraplatte gelegt, die mit Ext4 formatiert ist und sonst nichts anderes enthält. Ubuntu hat penjdk-7 (7u55-2.4.7-1ubuntu1) installiert. Soweit zum Setup.

Leider musste ich feststellen, dass Yacy einerseits nicht immer startet, selbst nach einem Systemneustart startet es oft nicht. Ich poste mal eine Ausgabe des Terminals, bei einem fehlgeschlagenem Start.


Code: Alles auswählen

/media/rootix/Yacy/yacy$ ./startYACY.sh -l
****************** YaCy Web Crawler/Indexer & Search Engine *******************
**** (C) by Michael Peter Christen, usage granted under the GPL Version 2  ****
****   USE AT YOUR OWN RISK! Project home and releases: http://yacy.net/   ****
**  LOG of       YaCy: DATA/LOG/yacy00.log (and yacy<xx>.log)                **
**  STOP         YaCy: execute stopYACY.sh and wait some seconds             **
**  GET HELP for YaCy: see http://wiki.yacy.net and http://forum.yacy.de     **
*******************************************************************************
>> YaCy started as daemon process. Administration at http://localhost:8090 <<
rootix@Nextu:/media/rootix/Yacy/yacy$ E 2014/06/28 00:37:54 org.apache.solr.core.SolrCore [webgraph] Solr index directory '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/webgraph/data/index/' is locked.  Throwing exception
E 2014/06/28 00:37:54 org.apache.solr.core.SolrCore [collection1] Solr index directory '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/collection1/data/index/' is locked.  Throwing exception
E 2014/06/28 00:37:54 org.apache.solr.core.CoreContainer Unable to create core: collection1
org.apache.solr.common.SolrException: Index locked for write for core collection1
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
   at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core collection1
   at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:496)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
   ... 11 more
E 2014/06/28 00:37:54 org.apache.solr.core.CoreContainer Unable to create core: webgraph
org.apache.solr.common.SolrException: Index locked for write for core webgraph
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
   at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core webgraph
   at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:496)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
   ... 11 more
E 2014/06/28 00:37:54 org.apache.solr.core.CoreContainer null:org.apache.solr.common.SolrException: Unable to create core: collection1
   at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:989)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:606)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: Index locked for write for core collection1
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
   at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   ... 8 more
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core collection1
   at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:496)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
   ... 11 more

E 2014/06/28 00:37:54 org.apache.solr.core.CoreContainer null:org.apache.solr.common.SolrException: Unable to create core: webgraph
   at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:989)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:606)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: Index locked for write for core webgraph
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
   at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   ... 8 more
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core webgraph
   at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:496)
   at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
   ... 11 more



Soweit ich das richtig verstehe, kann Yacy auf ne Menge Dateien nicht zugreifen, aber ich mag mich auch irren.

Desweiteren musste ich feststellen, dass auch wenn Yacy mal erfolgreich startet, der Crawler nach einiger Zeit, aber auch eher sporadisch und ohne nachvollziehbaren Grund das Arbeiten einstellt, obwohl Yacy fleissig weiter CPU in Anspruch nimmt.

Jetzt stellt sich die Frage, woran es liegt und wie man es beheben kann.
Rootix
 
Beiträge: 2
Registriert: Fr Jun 27, 2014 11:46 pm

Re: Yacy startet nur sporadisch

Beitragvon Rootix » So Jul 20, 2014 2:58 am

Ich habe mittlerweile noch ein wenig rumprobiert und festgestellt, dass sobald ich einen Crawl-Job starte und dann Yacy stoppe, es sich nicht mehr starten laesst. Eigentlich schade, das solch eine Software auf Windows problemloser laeuft als in Linux. Noch viel schlimmer ist aber, dass es hier wochenlang einfach keine Antwort, ja nichtmal Rueckfragen bei Problemen mit der Software gibt.
Rootix
 
Beiträge: 2
Registriert: Fr Jun 27, 2014 11:46 pm

Re: Yacy startet nur sporadisch

Beitragvon sixcooler » Di Jul 22, 2014 12:28 am

Hallo Rootix,

ich kann Deinen Unmut ja verstehen hier keine Reaktion zu erhalten.
Aber ich kann hier auch nur Raten das wohl mal etwas beim herunterfahren von YaCy nicht gestimmt hat und den Lock hinterlassen hat.
Ich fürchte das keiner dieses Problem bisher hatte und eine Idee dazu hätte was er Dir hier schreiben kann.

Wenn solche 'Index locked ...' Dinger auftauchen würde ich den YaCy Prozess beenden und '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/collection1/data/index/write.lock' und '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/webgraph/data/index/write.lock' löschen und es erneit versuchen.

Was Deinen Rechner gerade so heftig beschäftigt sieht man gut in einem Threaddump unter http://localhost:8090/Threaddump_p.html.

Cu, sixcooler.
sixcooler
 
Beiträge: 494
Registriert: Do Aug 14, 2008 5:22 pm

Re: Yacy startet nur sporadisch

Beitragvon Orbiter » Di Jul 22, 2014 7:40 am

Index locked for write

heisst dass da noch ein YaCy läuft während du versuchst es neu zu starten.
Orbiter
 
Beiträge: 5793
Registriert: Di Jun 26, 2007 10:58 pm
Wohnort: Frankfurt am Main

Re: Yacy startet nur sporadisch

Beitragvon TmoWizard » Sa Jul 26, 2014 10:59 pm

Hallöchen zusammen!

Passend hierzu durfte ich mehrmals beobachten, daß YaCy erst startete, wenn ich meinen Browser aufrief und einen Tab mit meinem YaCy öffnete! Wenn ich den Browser dann später beende, dann läuft YaCy allerdings weiter. System ist ebenfalls *buntu 14.04 mit OpenJDK 7, welches im Browser allerdings komplett deaktiviert ist!

Dies nur so als Hinweis für den TO. Mich stört das nicht wirklich, da mein Rechner inklusive Browser (SeaMonkey) sowieso schon seit Jahren 24/7 durchläuft!


Grüße aus TmoWizard's Castle zu Augsburg

Mike, TmoWizard
TmoWizard
 
Beiträge: 140
Registriert: So Jul 13, 2014 3:32 pm
Wohnort: Augsburg

CoreContainer Unable to create core: webgraph

Beitragvon flegno » Sa Sep 06, 2014 11:39 am

Also ich habe hier m.E. ähnliche oder sogar gleiche Fehlermeldungen auf einem Windows 7 System. Hier Log-Einträge komplett:
Code: Alles auswählen
Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation. Alle Rechte vorbehalten.

C:\Users\Oldb643051#>cd T:\0_Tools\YaCy\yacy_en

C:\Users\Oldb643051#>t:

T:\0_Tools\YaCy\yacy_en>startYACY_debug.bat
started 11:57:29,06
Generated classpath:lib/yacycore.jar;htroot
JRE Parameters:-Xms90m -Xmx600m -XX:-UseGCOverheadLimit -Djava.net.preferIPv4Stack=true -Djava.awt.h
eadless=true -Dfile.encoding=UTF-8
Priority:/BELOWNORMAL
****************** YaCy Web Crawler/Indexer & Search Engine ******************
**** (C) by Michael Peter Christen, usage granted under the GPL Version 2  ****
****   USE AT YOUR OWN RISK! Project home and releases: http://yacy.net/   ****
**  LOG of       YaCy: DATA/LOG/yacy00.log (and yacy<xx>.log)              **
**  STOP         YaCy: execute stopYACY.bat and wait some seconds            **
**  GET HELP for YaCy: see www.yacy-websearch.net/wiki and forum.yacy.de     **
*******************************************************************************
>> YaCy started as daemon process. Administration at http://localhost:8099 <<
WARNING: the file T:\0_Tools\YaCy\yacy_en\DATA\yacy.running exists, this usually means that a YaCy i
nstance is still running. If you want to restart YaCy, try first ./stopYACY.sh, then ./startYACY.sh.
If ./stopYACY.sh fails, try ./killYACY.sh
[ YaCy v1.72, build 20140506 by Michael Christen / www.yacy.net ]
-------------------------------------------------------------------------------
STARTUP: Trying to load logging configuration from file T:\0_Tools\YaCy\yacy_en\DATA\LOG\yacy.loggin
g
Can't load log handler "java.util.logging.FileHandler"
java.nio.channels.OverlappingFileLockException
java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at java.util.logging.FileHandler.openFiles(Unknown Source)
        at java.util.logging.FileHandler.<init>(Unknown Source)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        at java.util.logging.LogManager$4.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.util.logging.LogManager.loadLoggerHandlers(Unknown Source)
        at java.util.logging.LogManager.initializeGlobalHandlers(Unknown Source)
        at java.util.logging.LogManager.access$1500(Unknown Source)
        at java.util.logging.LogManager$RootLogger.accessCheckedHandlers(Unknown Source)
        at java.util.logging.Logger.getHandlers(Unknown Source)
        at java.util.logging.Logger.log(Unknown Source)
        at java.util.logging.Logger.doLog(Unknown Source)
        at java.util.logging.Logger.log(Unknown Source)
        at net.yacy.cora.util.ConcurrentLog$Worker.run(ConcurrentLog.java:361)
S 2014/09/06 11:57:42 STARTUP YaCy version: 1.72/9000
S 2014/09/06 11:57:43 STARTUP Java version: 1.7.0_67
S 2014/09/06 11:57:43 STARTUP Operation system: Windows 7
S 2014/09/06 11:57:43 STARTUP Application root-path: T:\0_Tools\YaCy\yacy_en
S 2014/09/06 11:57:43 STARTUP Data root-path: T:\0_Tools\YaCy\yacy_en
S 2014/09/06 11:57:43 STARTUP Time zone: UTC+0200; UTC+0000 is 1409997462365
S 2014/09/06 11:57:43 STARTUP Maximum file system path length: 255
E 2014/09/06 11:57:43 STARTUP WARNING: the file T:\0_Tools\YaCy\yacy_en\DATA\yacy.running can not be
created!
S 2014/09/06 11:57:52 BusyThread thread 'BusyThread net.yacy.utils.UPnP.addPortMapping' deployed, st
arting job.
S 2014/09/06 11:59:42 SWITCHBOARD Index Primary Path: T:\0_Tools\YaCy\yacy_en\DATA\INDEX
S 2014/09/06 11:59:42 SWITCHBOARD Index Archive Path: T:\0_Tools\YaCy\yacy_en\DATA\ARCHIVE
S 2014/09/06 11:59:42 SWITCHBOARD Lists Path:     T:\0_Tools\YaCy\yacy_en\DATA\LISTS
S 2014/09/06 11:59:42 SWITCHBOARD HTDOCS Path:    T:\0_Tools\YaCy\yacy_en\DATA\HTDOCS
D 2014/09/06 11:59:42 net.yacy.upnp.Discovery Sending discovery message on 239.255.255.250:1900 mult
icast address form ip 192.168.2.104:
M-SEARCH * HTTP/1.1
HOST: 239.255.255.250:1900
MAN: "ssdp:discover"
MX: 3
ST: urn:schemas-upnp-org:device:InternetGatewayDevice:1


D 2014/09/06 11:59:42 net.yacy.upnp.Discovery Sending discovery message on 239.255.255.250:1900 mult
icast address form ip 192.168.56.1:
M-SEARCH * HTTP/1.1
HOST: 239.255.255.250:1900
MAN: "ssdp:discover"
MX: 3
ST: urn:schemas-upnp-org:device:InternetGatewayDevice:1


S 2014/09/06 11:59:43 SWITCHBOARD Work Path:    T:\0_Tools\YaCy\yacy_en\DATA\WORK
S 2014/09/06 11:59:43 SWITCHBOARD Dictionaries Path:T:\0_Tools\YaCy\yacy_en\DATA\DICTIONARIES
S 2014/09/06 11:59:43 SWITCHBOARD initializing libraries
S 2014/09/06 11:59:46 SWITCHBOARD Loading sessionid file defaults/sessionid.names
I 2014/09/06 11:59:47 UPNP no device found
I 2014/09/06 11:59:47 UPNP listening for device
S 2014/09/06 11:59:47 BusyThread thread 'BusyThread net.yacy.utils.UPnP.addPortMapping' terminated.
I 2014/09/06 11:59:50 HeapReader generating index for T:\0_Tools\YaCy\yacy_en\DATA\WORK\api.bheap, 0
MB. Please wait.
I 2014/09/06 11:59:50 HeapReader finished index generation for T:\0_Tools\YaCy\yacy_en\DATA\WORK\api
.bheap, 2 entries, 0 gaps.
I 2014/09/06 11:59:50 Heap initializing heap T:\0_Tools\YaCy\yacy_en\DATA\WORK\api.bheap
I 2014/09/06 11:59:52 HeapReader generating index for T:\0_Tools\YaCy\yacy_en\DATA\WORK\pkcounter.bh
eap, 0 MB. Please wait.
I 2014/09/06 11:59:52 HeapReader finished index generation for T:\0_Tools\YaCy\yacy_en\DATA\WORK\pkc
ounter.bheap, 1 entries, 0 gaps.
I 2014/09/06 11:59:52 Heap initializing heap T:\0_Tools\YaCy\yacy_en\DATA\WORK\pkcounter.bheap
S 2014/09/06 12:03:18 SWITCHBOARD Starting Indexing Management
I 2014/09/06 12:03:53 Word hashCache.size = 20000
I 2014/09/06 12:03:53 SWITCHBOARD Initializing Segment 'T:\0_Tools\YaCy\yacy_en\DATA\INDEX\intranet\
SEGMENTS.
D 2014/09/06 12:08:32 initializeCoreConf overwrite T:\0_Tools\YaCy\yacy_en\DATA\INDEX\intranet\SEGME
NTS\solr_47\collection1\conf\solrcore.properties with T:\0_Tools\YaCy\yacy_en\defaults\solr\solrcore
.x86.properties
D 2014/09/06 12:12:18 initializeCoreConf overwrite T:\0_Tools\YaCy\yacy_en\DATA\INDEX\intranet\SEGME
NTS\solr_47\webgraph\conf\solrcore.properties with T:\0_Tools\YaCy\yacy_en\defaults\solr\solrcore.x8
6.properties
I 2014/09/06 12:12:27 org.apache.solr.core.ConfigSolr Loading container configuration from T:\0_Tool
s\YaCy\yacy_en\defaults\solr\solr.xml
I 2014/09/06 12:12:49 org.apache.solr.logging.LogWatcher SLF4J impl is org.slf4j.impl.JDK14LoggerFac
tory
I 2014/09/06 12:12:49 org.apache.solr.logging.LogWatcher Registering Log Listener [JUL (org.slf4j.im
pl.JDK14LoggerFactory)]
E 2014/09/06 12:14:42 org.apache.solr.core.CoreContainer Unable to create core: webgraph
org.apache.solr.common.SolrException
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
        at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:217)
        at org.apache.lucene.store.NativeFSLock.isLocked(NativeFSLockFactory.java:319)
        at org.apache.lucene.index.IndexWriter.isLocked(IndexWriter.java:4537)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:485)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
        ... 11 more
E 2014/09/06 12:14:42 org.apache.solr.core.CoreContainer null:org.apache.solr.common.SolrException:
Unable to create core: webgraph
        at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:989)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:606)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.solr.common.SolrException
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
        at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
        ... 8 more
Caused by: java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:217)
        at org.apache.lucene.store.NativeFSLock.isLocked(NativeFSLockFactory.java:319)
        at org.apache.lucene.index.IndexWriter.isLocked(IndexWriter.java:4537)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:485)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
        ... 11 more

E 2014/09/06 12:14:42 org.apache.solr.core.CoreContainer Unable to create core: collection1
org.apache.solr.common.SolrException
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
        at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:217)
        at org.apache.lucene.store.NativeFSLock.isLocked(NativeFSLockFactory.java:319)
        at org.apache.lucene.index.IndexWriter.isLocked(IndexWriter.java:4537)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:485)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
        ... 11 more
E 2014/09/06 12:14:42 org.apache.solr.core.CoreContainer null:org.apache.solr.common.SolrException:
Unable to create core: collection1
        at org.apache.solr.core.CoreContainer.recordAndThrow(CoreContainer.java:989)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:606)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.solr.common.SolrException
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
        at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
        ... 8 more
Caused by: java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:217)
        at org.apache.lucene.store.NativeFSLock.isLocked(NativeFSLockFactory.java:319)
        at org.apache.lucene.index.IndexWriter.isLocked(IndexWriter.java:4537)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:485)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
        ... 11 more

I 2014/09/06 12:14:42 SolrEmbeddedInstance detected default solr core: collection1
E 2014/09/06 12:14:42 STARTUP YaCy cannot start: SolrCore 'collection1' is not available due to init
failure: null
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: n
ull
        at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:827)
        at net.yacy.cora.federate.solr.instance.EmbeddedInstance.<init>(EmbeddedInstance.java:89)
        at net.yacy.search.index.Fulltext.connectLocalSolr(Fulltext.java:132)
        at net.yacy.search.Switchboard.<init>(Switchboard.java:503)
        at net.yacy.yacy.startup(yacy.java:192)
        at net.yacy.yacy.main(yacy.java:684)
Caused by: org.apache.solr.common.SolrException
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:630)
        at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
        at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.nio.channels.OverlappingFileLockException
        at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
        at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
        at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
        at java.nio.channels.FileChannel.tryLock(Unknown Source)
        at org.apache.lucene.store.NativeFSLock.obtain(NativeFSLockFactory.java:217)
        at org.apache.lucene.store.NativeFSLock.isLocked(NativeFSLockFactory.java:319)
        at org.apache.lucene.index.IndexWriter.isLocked(IndexWriter.java:4537)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:485)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:761)
        ... 11 more

T:\0_Tools\YaCy\yacy_en>
Zusatzinfo:
  1. ist vlt. als relevant hier festzustellen, dass ich mit dem Threadersteller
    gemeinsam nicht nur die Fehlermeldungen habe, sondern auch die Tatsache, dass YaCy _nicht_ auf C:/-Laufwerk gestartet ist, wie ich im Thread SolrException: Error opening new searcher erwähnt habe. Frage an die Entwickler - könnte der externe Datenträger den Fehler verursachen? Vlt. unterschiedliche Formatierungen, NTFS u.ä.?
  2. duckduckgo-Suche - yacy Unable to create core: webgraph org.apache.solr.common.SolrException
Zuletzt geändert von flegno am So Sep 28, 2014 9:20 am, insgesamt 1-mal geändert.
flegno
 
Beiträge: 232
Registriert: So Aug 17, 2014 4:23 pm

multiple threads try to access the same sequence file

Beitragvon flegno » Sa Sep 06, 2014 12:22 pm

"Problem(Abstract)
The WebSphere® FTP adapter generates the OverlappingFileLockException error when multiple threads try to access the same sequence file." zitiert von hier -->
WebSphere FTP adapter generates an OverlappingFileLockException error. Kann sein, dass auch YaCy "multiple threads try to access the same sequence file" initiiert, die dann die OverlappingFileLockException verursachen?
flegno
 
Beiträge: 232
Registriert: So Aug 17, 2014 4:23 pm

Re: Yacy startet nur sporadisch

Beitragvon Icebreeze » Fr Jan 22, 2016 7:06 pm

Hallo

Hatte das gerade eben auch mit meinem aquayacy... Windows7, lief seit sicher einer Woche und heute ging gar nichts mehr.
Das Log meinte dazu
E 2016/01/22 18:46:32 org.apache.solr.core.SolrCore [collection1] Solr index directory 'D:\yacy\aquayacy\DATA\INDEX\freeworld\SEGMENTS\solr_4_10\collection1\data\index/' is locked. Throwing exception
E 2016/01/22 18:46:32 org.apache.solr.core.SolrCore [webgraph] Solr index directory 'D:\yacy\aquayacy\DATA\INDEX\freeworld\SEGMENTS\solr_4_10\webgraph\data\index/' is locked. Throwing exception
E 2016/01/22 18:46:32 org.apache.solr.core.CoreContainer Error creating core [webgraph]: Index locked for write for core webgraph
org.apache.solr.common.SolrException: Index locked for write for core webgraph
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:881)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:654)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core webgraph
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:516)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:785)
... 9 more
E 2016/01/22 18:46:32 org.apache.solr.core.CoreContainer Error creating core [collection1]: Index locked for write for core collection1
org.apache.solr.common.SolrException: Index locked for write for core collection1
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:881)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:654)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core collection1
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:516)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:785)
... 9 more
I 2016/01/22 18:46:32 SolrEmbeddedInstance detected default solr core: collection1
E 2016/01/22 18:46:32 STARTUP YaCy cannot start: SolrCore 'collection1' is not available due to init failure: Index locked for write for core collection1
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: Index locked for write for core collection1
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
at net.yacy.cora.federate.solr.instance.EmbeddedInstance.<init>(EmbeddedInstance.java:89)
at net.yacy.search.index.Fulltext.connectLocalSolr(Fulltext.java:133)
at net.yacy.search.Switchboard.<init>(Switchboard.java:532)
at net.yacy.yacy.startup(yacy.java:205)
at net.yacy.yacy.main(yacy.java:697)
Caused by: org.apache.solr.common.SolrException: Index locked for write for core collection1
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:881)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:654)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.lucene.store.LockObtainFailedException: Index locked for write for core collection1
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:516)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:785)
... 9 more


Der Tipp hat dann letztendlich geholfen

sixcooler hat geschrieben:Wenn solche 'Index locked ...' Dinger auftauchen würde ich den YaCy Prozess beenden und '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/collection1/data/index/write.lock' und '/media/rootix/Yacy/yacy/DATA/INDEX/freeworld/SEGMENTS/solr_47/webgraph/data/index/write.lock' löschen und es erneit versuchen.


Wobei die .lock-Datei vom 07.01 war... Hatte Yacy aber sicher letzte Woche neu gestartet...

Was Deinen Rechner gerade so heftig beschäftigt sieht man gut in einem Threaddump unter http://localhost:8090/Threaddump_p.html.


Bei mir ging gar nichts mehr... Während der Arbeit heute traute ich nicht den Rechner Zuhause mit Yacy drauf neu zu starten, war aber irritiert das Yacy von Aussen nicht erreichbar wäre. Irgendwann im Lauf des Tages war dann Yacy gar nicht mehr erreichbar, im Taskmanager hatte es nichts was nach Yacy oder Java aussah...
Auch mehrere Neustarts brachten nichts, Yacy beenden wenn es irgendwo im Speichernirvana hin auch nicht. Er das Löschen der .lock-Datei eben brachte den Erfolg.

rgds
IceBreeze
Icebreeze
 
Beiträge: 30
Registriert: Do Okt 16, 2008 6:37 pm


Zurück zu Fragen und Antworten

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste