GitHub - yuyichen09/avito-duplicates-kaggle: Solution for Avito Duplicate Ads Detection competition

Avito Duplicate Ads Detection on Kaggle

A part of the 5th place solution for the ADAD competition run on kaggle

High level overview of features: https://www.kaggle.com/c/avito-duplicate-ads-detection/forums/t/22190/solution-sharing/126772#post126772
Slides: http://www.slideshare.net/AlexeyGrigorev/avito-duplicate-ads-detection-kaggle
This is a code dump with no cleaning. Please let me know if some stuff doesn't work or something is not clear

Running it:

First all prepare_ and mongo_ files should be run, and also the classes from the java package
Then all calculate_ files should be run
Finally, run model_ and stacking at the end

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
ext_data		ext_data
java-features		java-features
README.md		README.md
avito_utils.py		avito_utils.py
bm25.py		bm25.py
calculate_attrs_features.py		calculate_attrs_features.py
calculate_chargram_features.py		calculate_chargram_features.py
calculate_common_tokens.py		calculate_common_tokens.py
calculate_contact_features.py		calculate_contact_features.py
calculate_dimred_features.py		calculate_dimred_features.py
calculate_fuzzy_features.py		calculate_fuzzy_features.py
calculate_glove_features.py		calculate_glove_features.py
calculate_imagehash_features.py		calculate_imagehash_features.py
calculate_imagemagick_features.py		calculate_imagemagick_features.py
calculate_important_tokens_features.py		calculate_important_tokens_features.py
calculate_java-image_features.py		calculate_java-image_features.py
calculate_misspelling_features.py		calculate_misspelling_features.py
calculate_ssim_features.py		calculate_ssim_features.py
calculate_text_features.py		calculate_text_features.py
calculate_w2v_features.py		calculate_w2v_features.py
calculate_w2v_wmd_features.py		calculate_w2v_wmd_features.py
calculate_whash_features.py		calculate_whash_features.py
imagemagick_moment_invariants_scaler.csv		imagemagick_moment_invariants_scaler.csv
model_big_xgb.py		model_big_xgb.py
model_random_et.py		model_random_et.py
model_random_xgb.py		model_random_xgb.py
mongo_data.py		mongo_data.py
mongo_put_images.py		mongo_put_images.py
mongo_put_iteminfo.py		mongo_put_iteminfo.py
mongo_utils.py		mongo_utils.py
prepare_attrs_tfidf.py		prepare_attrs_tfidf.py
prepare_common_tokens.py		prepare_common_tokens.py
prepare_geo_features.py		prepare_geo_features.py
prepare_glove_model.py		prepare_glove_model.py
prepare_image_hashes.py		prepare_image_hashes.py
prepare_imagemagick_features.py		prepare_imagemagick_features.py
prepare_text_features.py		prepare_text_features.py
prepare_text_tfidf.py		prepare_text_tfidf.py
prepare_w2v_model.py		prepare_w2v_model.py
replacements.txt		replacements.txt
stacking.py		stacking.py

yuyichen09/avito-duplicates-kaggle

Folders and files

Latest commit

History

Repository files navigation

Avito Duplicate Ads Detection on Kaggle

Running it:

About

Resources

Stars

Watchers

Forks

Languages