GitHub - rwth-i6/cache-manager: CacheManager is a simple but effective solution for data distribution in cluster computer environments without a sophisticated storage system. It is a non-intrusive solution consisting of Python tools.

rwth-i6 / cache-manager Public

CacheManager is a simple but effective solution for data distribution in cluster computer environments without a sophisticated storage system. It is a non-intrusive solution consisting of Python tools.

www-i6.informatik.rwth-aachen.de/~rybach/cache-manager.php

GPL-3.0 license

0 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
AUTHORS		AUTHORS
INSTALL		INSTALL
LICENSE		LICENSE
README		README
README.cqsub		README.cqsub
__init__.py		__init__.py
cf		cf
cftools.sh		cftools.sh
client.py		client.py
cm-client.py		cm-client.py
cm-server.py		cm-server.py
cmclient.config		cmclient.config
cmclient.generic.config		cmclient.generic.config
cmlogging.py		cmlogging.py
cmserver.config		cmserver.config
cqsub		cqsub
dbutil.py		dbutil.py
environment.py		environment.py
example.py		example.py
fetcher.py		fetcher.py
filesystem.py		filesystem.py
header.txt		header.txt
logging.py		logging.py
release.sh		release.sh
server.sh		server.sh
settings.generic.py		settings.generic.py
settings.multienv.py		settings.multienv.py
settings.py		settings.py
shared.py		shared.py
sysvinit		sysvinit
test.sh		test.sh

Repository files navigation

cache manager - load balanced file caching on local harddisks

See also http://code.google.com/p/cache-manager/wiki/Usage

cm-client.py

 Uses the configuration in ~/.cmclient
 (see cmclient.config)

  cm-client.py <filename>
    Copy <filename> to the local harddisk. If possible, existing 
    copies on other compute nodes will be used. A central
    server instanced keeps track of the copies and controlls the
    number of parallel transfers.
    If there is not enough space left on the local disk (see 
    MIN_FREE and MAX_USAGE in the configuration file), older files
    will be deleted.
    The location of the cached file is returned on stdout. If
    the caching is not possible for any reason, the original
    filename will be returned.

  cm-client.py -cp <source> <destination>
    Copy <source> to <destination> and register <source> as copy
    of <destination> on the server instance.


cm-server.py
  
  cm-server.py <config-file>
  See cmserver.config