Python loadUrl Examples

Example #1

File: Unit_Scrape.py Project: uwaunitmatching/unit-matching

def confirm_input(url, recursive):
    a = re.compile("^http://", re.IGNORECASE)
    if not a.match(url):
        print("Input does not appear to be a valid url (hint: http://)")
    elif recursive:
        dom = url.split("/")[2]
        print("current domain is " + dom)
        downTools.recursiveload(url, dom, db)
    elif not recursive:
        dom = url.split("/")[2]
        print("current domain is " + dom)
        downTools.loadUrl(url, 0, db)

Example #2

File: Test.py Project: uwaunitmatching/unit-matching

 def test_downTools_loadUrl_build_unit(self):
     downTools.loadUrl("http://handbooks.uwa.edu.au/units/unitdetails?code=cits3200", 0, DBconfig.DBconfig())
     pass #if it got here it ran