Search or transfer

Forum for developers

Search or transfer

Beitragvon reger » Do Dez 17, 2015 8:39 pm

During search events we collect metadata from dht queries as well as solrdocuments from solr direct queries.
As @luc pointed out (see http://mantis.tokeek.de/view.php?id=626) we transfer documents "to big to store" during search.
Should we not considere to tackle this at the root and in view of search performance go back and exchange search results with exactly whats needed for it (standardized search interface) and maybe enhance/expand the dht transfer part to solrdocs, but go away from solr direct queries / returns of a remote peer index assumed to be similar to the local sorl index?

P.S. We basically have everything under the hood, from rwi query, opensearch query, sru query, solr query ...... but each used differently.
reger
 
Beiträge: 45
Registriert: Mi Jan 02, 2013 9:23 am

Re: Search or transfer

Beitragvon luc » Fr Dez 18, 2015 10:38 am

One point however : aren't direct remote solr queries still useful when your peer is member of a Solr Cluster?
Concerning very large inbouds and outbounds link lists embedded in solr documents : should not they be only stored and retrieved from webgraph collection?
luc
 
Beiträge: 276
Registriert: Mi Aug 26, 2015 1:04 am

Re: Search or transfer

Beitragvon luc » Fr Dez 18, 2015 2:07 pm

To my mind, it also sounded interesting to have someday a user interface allowing to dispatch to remote peers a custom solr query built by the user (maybe it is already possible using the API?)
luc
 
Beiträge: 276
Registriert: Mi Aug 26, 2015 1:04 am


Zurück zu YaCy Coding & Architecture

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste

cron