GitHub - lonlylocly/molva: This is a dormant codebase that used to back molva.spb.ru

lonlylocly / molva Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

This is a dormant codebase that used to back molva.spb.ru

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 327 Commits
gibberish-semantics		gibberish-semantics
java		java
logrotate		logrotate
molva		molva
research		research
test		test
tomita		tomita
web		web
.hgignore		.hgignore
README.tweets.db		README.tweets.db
README.txt		README.txt
Simmer-1.0-SNAPSHOT-jar-with-dependencies.jar		Simmer-1.0-SNAPSHOT-jar-with-dependencies.jar
aligner-jar-with-dependencies.jar		aligner-jar-with-dependencies.jar
archive_recent_tweets.sh		archive_recent_tweets.sh
build-clusters.py		build-clusters.py
clear-words.py		clear-words.py
global-settings.json		global-settings.json
handler-settings.json		handler-settings.json
handler.py		handler.py
knn-clusters.py		knn-clusters.py
logging.conf		logging.conf
lookup.py		lookup.py
parsefacts.py		parsefacts.py
post-profiles.py		post-profiles.py
post-tomita.py		post-tomita.py
pre-tomita.py		pre-tomita.py
prepare-profiles.py		prepare-profiles.py
run-tomita.py		run-tomita.py
save_aligned.py		save_aligned.py
showqual.py		showqual.py
task.py		task.py
trend_new.py		trend_new.py
woape-statuses.py		woape-statuses.py
woape-streaming.py		woape-streaming.py
word_mates.py		word_mates.py
wordstat.py		wordstat.py

Repository files navigation

woape.py
    produces:
        /tweets.db - users
        /tweets_<DATE>.db - tweets

pre-tomita.py
    depends
        /tweets_<DATE>.db - tweets
    produces
        /index/<DATE>_<CHUNK_ID>.index.txt
        /index/<DATE>_<CHUNK_ID>.tweets.txt

run-tomita.py
    depends
        /index/<DATE>_<CHUNK_ID>.index.txt
        /index/<DATE>_<CHUNK_ID>.tweets.txt (removes)
    produces
        /nouns/<DATE>_<CHUNK_ID>.facts.xml

parsefacts.py
    depends
        /index/<DATE>_<CHUNK_ID>.index.txt (removes)
        /nouns/<DATE>_<CHUNK_ID>.facts.xml (removes)
    produces
        /tweets_<DATE>.db - nouns 
        /tweets_<DATE>.db - tweet_nouns 

post-tomita.py
    depends
        /tweets_<DATE>.db - tweets
        /tweets_<DATE>.db - tweet_nouns 
    produces
        /tweets_<DATE>.db - tweet_chains, chains_nouns, post_reply_cnt, post_cnt 

build-profiles.py
    depends 
        /tweets_<DATE>.db - post_reply_cnt, post_cnt 
    produces
        /tweets_<DATE>.db - noun_similarity 

build-clusters.py
    depends 
        /tweets_<DATE>.db - noun_similarity
    produces
        /tweets.db - clusters

handler.py
    depends
        /tweets.db
            clusters
            tweets
        /tweets_<DATE>.db
            nouns
            post_cnt
            post_reply_cnt
            noun_similarity