The P2P network for PeARS

Make sure you install all requirements from requirements.txt and that you have openvectors.db populated using the script uncompress_db

Build the pear profile using the code browser_history_indexer.py

python browser_history_indexer.py

Clone the p2p-network code from the master branch

Start the DHT by running the following:

python dht.py 4000

This runs a standalone DHT node in your local machine in the port 4000. If you know the IP of another node that has a DHT running, then you can do the following to make the nodes identify each other:

python dht.py 4000 <Known node IP> <Known node port>

Once the above steps are done, open up your browser and go to locahost:5000. Do try to search for something from your local index and hope for the best. :-)

The issues that need loving:

1. There is no way of telling the indexer what to index now. We end up getting a lot of pages like mail home etc. indexed which is not relevant. I have to fix this.
2. The DHT hashing is not really efficient. It randomly picks buckets, although there is a hash function that picks the node.
3. A lot of testing to do. I haven't yet tested DHT across several machines. I tested it all using docker and all the containers communicated using internal IP. I am not even sure if it works properly if DHT setup across different nodes are connected.