What is stored in my hard drives?

Discussion in English language.
Forumsregeln
You can start and continue with posts in english language in all other forums as well, but if you are looking for a forum to start a discussion in english, this is the right choice.

What is stored in my hard drives?

Beitragvon davide » Do Jun 18, 2015 3:11 pm

I deliberately blacklisted a few German (.de, .ch) hosts from "/CrawlResults.html?process=3" which resulted in my index size dropping from 4M to 3.9M, releasing about 1GB of hard disk space. These URLs were not fetched by my crawler, which has a whitelist filter to only allow 5 .com domains.

Now I wonder: what is stored in my hard disks? How many GB am I wasting for storing documents I don't want?
Since I drew up a table outlining the costs of progressive hardware upgrades, including hard drives purchases, storing documents I don't need is an extra parasitical cost.

Specifically, I need to know if there is a chance that the same happens the opposite way: that is, my documents being stored on others' computers. I don't trust others' equipment as much as I trust mine for protection against data loss. If my documents do end up on others' hard disks, will they still be preserved on my own disks? Or may they just be moved out of my server?
davide
 
Beiträge: 78
Registriert: Fr Feb 15, 2013 8:03 am

Re: What is stored in my hard drives?

Beitragvon davide » Di Jun 23, 2015 6:23 pm

davide hat geschrieben:How many GB am I wasting for storing documents I don't want?
Since I drew up a table outlining the costs of progressive hardware upgrades, including hard drives purchases, storing documents I don't need is an extra parasitical cost.


First question is answered by "DTH". DHT reception can be disabled from ConfigNetwork_p.html.
Still I wonder if entries transmitted to other peers via DHT may result in such indexes being deleted from my local index and relied to other peers for custody.
davide
 
Beiträge: 78
Registriert: Fr Feb 15, 2013 8:03 am


Zurück zu English

Wer ist online?

Mitglieder in diesem Forum: 0 Mitglieder und 2 Gäste

cron