task_search

目的

Bing APIを使ってWeb検索を行い、クエリに応じたタスクの目的を達成する方法を見つけるシステムです

使い方

my_keysのmy_keys.MICROSOFT_API_KEYにBing APIのキーを書く
costants.QUERIES_4にクエリをlist形式で書く
fetch_web_pages_with_original_queries.pyを実行。BingAPIで取得したWebPageオブジェクトをPickle化して保存する。
fetch_and_set_sentences_to_pages_with_original_queries.pyを実行。WebPageオブジェクトにhtmlをセットする。
set_tasks_to_fetched_pages_for_original.pyを実行。WebPageオブジェクトにTasksオブジェクトをAttributeとしてセットする。

Name		Name	Last commit message	Last commit date
Latest commit History 249 Commits
.idea		.idea
fetched_ads		fetched_ads
object_term_dictionary		object_term_dictionary
queries		queries
scripts		scripts
static		static
templates		templates
test_support		test_support
.gitignore		.gitignore
README.md		README.md
TODO.md		TODO.md
abstract_task_cluster_classifier.py		abstract_task_cluster_classifier.py
abstract_task_graph_answerer.py		abstract_task_graph_answerer.py
abstract_task_graph_manager.py		abstract_task_graph_manager.py
abstract_task_graph_part_of_selector.py		abstract_task_graph_part_of_selector.py
ad.py		ad.py
ad_fetcher.py		ad_fetcher.py
ad_page.py		ad_page.py
answer_printer.py		answer_printer.py
app.py		app.py
base_sqlite_manager.py		base_sqlite_manager.py
bing.py		bing.py
bing_searcher.py		bing_searcher.py
block.py		block.py
build_entailment_dictionaries.py		build_entailment_dictionaries.py
build_graph.py		build_graph.py
build_graph_for_ex.py		build_graph_for_ex.py
build_graph_from_db.py		build_graph_from_db.py
build_nodes.py		build_nodes.py
calc_and_save_tfidf.py		calc_and_save_tfidf.py
collect_past_words_from_fetched_pages.py		collect_past_words_from_fetched_pages.py
constants.py		constants.py
create_object_term_dictionary.py		create_object_term_dictionary.py
entailment_db_data_loader.py		entailment_db_data_loader.py
entailment_librarian.py		entailment_librarian.py
evaluate_graph.py		evaluate_graph.py
evaluate_zero_graph.py		evaluate_zero_graph.py
evaluation_dict_data_loader.py		evaluation_dict_data_loader.py
fetch_ads_with_queries.py		fetch_ads_with_queries.py
fetch_and_set_sentences_to_pages.py		fetch_and_set_sentences_to_pages.py
fetch_and_set_sentences_to_pages_of_ex.py		fetch_and_set_sentences_to_pages_of_ex.py
fetch_and_set_sentences_to_pages_with_original_queries.py		fetch_and_set_sentences_to_pages_with_original_queries.py
fetch_html.py		fetch_html.py
fetch_web_pages.py		fetch_web_pages.py
fetch_web_pages_with_expansion_queries.py		fetch_web_pages_with_expansion_queries.py
fetch_web_pages_with_original_queries.py		fetch_web_pages_with_original_queries.py
generalized_task.py		generalized_task.py
graph_task_mapper.py		graph_task_mapper.py
heading.py		heading.py
html_part.py		html_part.py
hypohype_data_loader.py		hypohype_data_loader.py
insert_pages_to_db.py		insert_pages_to_db.py
insert_tasks_to_database_for_ex.py		insert_tasks_to_database_for_ex.py
labelable.py		labelable.py
load_answerer_and_evaluate.py		load_answerer_and_evaluate.py
load_fetched_pages_and_search.py		load_fetched_pages_and_search.py
m_words_factory.py		m_words_factory.py
mecabed_noun.py		mecabed_noun.py
mecabed_verb.py		mecabed_verb.py
mecabed_word.py		mecabed_word.py
mmr_calculator.py		mmr_calculator.py
nanapi_page.py		nanapi_page.py
node.py		node.py
node_factory.py		node_factory.py
object_predicate_toiu_searcher.py		object_predicate_toiu_searcher.py
object_term.py		object_term.py
object_term_dictionary.py		object_term_dictionary.py
page_data_inserter.py		page_data_inserter.py
page_data_loader.py		page_data_loader.py
paragraph.py		paragraph.py
parenthesis_remover.py		parenthesis_remover.py
part_of_edge_finder_with_order.py		part_of_edge_finder_with_order.py
part_of_task_scorer.py		part_of_task_scorer.py
part_of_task_uniter.py		part_of_task_uniter.py
path.png		path.png
path_mover.py		path_mover.py
pattern_matcher.py		pattern_matcher.py
patterns.py		patterns.py
pickle_file_loader.py		pickle_file_loader.py
pickle_file_loader_for_ads.py		pickle_file_loader_for_ads.py
pickle_file_loader_for_entailment_dicts.py		pickle_file_loader_for_entailment_dicts.py
pickle_file_loader_for_ex.py		pickle_file_loader_for_ex.py
pickle_file_loader_for_original.py		pickle_file_loader_for_original.py
pickle_file_saver.py		pickle_file_saver.py
pickle_file_saver_for_ads.py		pickle_file_saver_for_ads.py
pickle_file_saver_for_ex.py		pickle_file_saver_for_ex.py
pickle_file_saver_for_original.py		pickle_file_saver_for_original.py
play_with_entailment_dictionaries.py		play_with_entailment_dictionaries.py
play_with_fetched_ads.py		play_with_fetched_ads.py
play_with_fetched_pages.py		play_with_fetched_pages.py
play_with_fetched_pages_of_ex.py		play_with_fetched_pages_of_ex.py
play_with_object_term_dictionary.py		play_with_object_term_dictionary.py
play_with_queries.py		play_with_queries.py
play_with_saved_tfidf.py		play_with_saved_tfidf.py
play_with_simple_task_search_result.py		play_with_simple_task_search_result.py
posinega_evaluator.py		posinega_evaluator.py
posinega_graph_mapper.py		posinega_graph_mapper.py
print_pages.py		print_pages.py
query.py		query.py
query_data_inserter.py		query_data_inserter.py

katryo/task_search

Folders and files

Latest commit

History