Esempi in Python per get_connection

Esempio n. 1

class IgnoreExistingURLMiddleware(object):
    db = get_connection()

    def process_request(self, request, spider):
        if self.db.shops.find_one({
                'link_url': request.url
        }) or self.db.images.files.find_one({'url': request.url}):
            log.msg('Ignore: %s' % request.url, log.WARNING)
            raise IgnoreRequest
        # log.msg('Request: %s'%request.url, log.INFO)
        return None

Esempio n. 2

File: pipelines.py Progetto: kvdaniel/wolfspider

 def __init__(self):
     self.db = get_connection()
     self.fs = gridfs.GridFS(self.db, collection="images")

Esempio n. 3

File: pipelines.py Progetto: davideuler/wolfspider

 def __init__(self):
     self.db = get_connection()
     self.fs = gridfs.GridFS(self.db, collection="images")