Skip to content

jpedraza/wordprocessor

 
 

Repository files navigation

This is a (clients) <-> ROUTER <--> DEALER <-> (workers) model with Zeromq framework
and it derived from zguide/examples/Python/asyncrrhandlers.py and mtserver.py example

I like to use multiprocess to be my worker's running environment( multithread running is suppoted either )
The main.py file is the server with workers initialize and wait client(t-04-client.py) to be connected

I used it to be my word processor framework, to manage the worker
which will process my html -- crawler crawl page from internet.

The word processor can deal with many format html structure.


TODO:
    1. the worker processes pool is not nessessary
    2. the worker's thread pool have some problem, but we can ignore it until
       we use this framework in large situation.
    3. config file, should be defined to a proper structure.

About

a word processor for my web crawler and wordpress robot

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published