Skip to content

scrapy + bingapipy(my bing API interface) = bing_spiders

Notifications You must be signed in to change notification settings

rtruxal/bing_spiders

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 

Repository files navigation

#THIS IS A SCRAPY-LIKE PACKAGE

#THAT MEANS THIS DIRECTORY (aka the top-level bing_spiders dir) SHOULD ALWAYS BE YOUR WORKING DIRECTORY.

###HURRS SOME 'STRUCTUONS:

>>> from bing_spiders import bing_news_2_csv
>>> bing_api_key = 'RAAAAAAAAANDOMNUMBERSANDLETTERFDAHJKFFADSHKFLDFAKHJ324HKJ2'
>>> myquery = 'unicorn sightings'
>>> bing_news_2_csv(bing_api_key, q=myquery, pages_of_links=20, csv_file_pth=None)

###NOW CHECK bing_spiders.data.queries THURS A CSV FILE THUR NOW ISN'T IT.

###OK NOW GET OUTTA IPYTHON N' GO BACK TO THE SHELL.

###NOW DO THIS:

$ pwd
 /path/to/bing_spiders
$ scrapy crawl bing_news

#THEN U DONE.

About

scrapy + bingapipy(my bing API interface) = bing_spiders

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages