A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

Upton Upton is a framework for easy web-scraping with a useful debug mode that doesn't hammer your target's servers. It does the repetitive parts of writing scrapers, so you only have to write the unique parts for each site.

Related Repos



vifreefly Kimurai Scraping Framework Note about v1.0.0 version: The code was massively refactored for a support to run spiders multiple times from inside a single process. Now it's possible to run Kimurai spiders usin
 

mgleon08 Instagram Crawler The easiest way to download instagram photos, posts and videos. Instagram Crawler is a ruby gem to crawl instagram photos, posts and videos for download. Installation $ gem i