Proxy all crawler traffic

Discussion in English language.
Forumsregeln
You can start and continue with posts in english language in all other forums as well, but if you are looking for a forum to start a discussion in english, this is the right choice.

Proxy all crawler traffic

Beitragvon davide » Mi Jun 17, 2015 1:28 pm

Is it possible to canalize all crawler requests thru a proxy? If so, how?

It is a necessity for me to change YaCy UA, in a way or another. A proxy header rewrite is the easiest and most upgradable solution until your minds will be free from the UA dogma.
I'm talking very pragmatically here, meanwhile measuring the benefits and savings of adopting YaCy over custom solutions, which I'm progressively evaluating.
davide
 
Beiträge: 84
Registriert: Fr Feb 15, 2013 8:03 am

Re: Proxy all crawler traffic

Beitragvon davide » Do Jun 18, 2015 1:11 am

Seems like YaCy does support proxy, thought I have not yet tried:

defaults/yacy.init

Code: Alles auswählen
remoteProxyUse=false
remoteProxyUse4SSL=true

remoteProxyHost=192.168.2.2
remoteProxyPort=4239
remoteProxyUser=
remoteProxyPwd=
davide
 
Beiträge: 84
Registriert: Fr Feb 15, 2013 8:03 am


Zurück zu English

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 1 Gast