Skip to content

PascalNoisette/scrape_ics_calendar

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# Fetch my calendar behind SSO

## Install

sudo pip install Scrapy
sudo pip install icalendar

## Schedule

Add this to the crontab

It is assuming a webserver can serve the file /var/www/html/scrapy_ics_calendar/calendar.ics

# m h  dom mon dow   command
*/15 8-19 * * MON-FRI /home/login/workspace/scrapy_ics_calendar/updater.sh /home/login/workspace/scrapy_ics_calendar/ login pass /var/www/html/scrapy_ics_calendar/calendar.ics > /var/log/scrapy_ics_calendar/log.txt  2>&1

## Developper contribution

### Generate a project

scrapy startproject passenger
mv passenger/scrapy.cfg /scrape/
mv passenger/passenger /scrape/

### Generate a spider

cd /scrape/
scrapy genspider mymodule 'https://url.com/'
scrapy crawl mymodule

About

Scrape calendar

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published