Using git-history to build a web scraper in less than a minute

Thu, 22 Feb 2024 20:45:15 +0100

Simon Willison describes in his blog post git-history, a python tool which leverages a pattern, previously described by Simon to scrape web content via Github actions. Basically the pattern scrapes a web resource and commits differences into a git repository.

I wanted to try this pattern on a to this date static source of open data, to supply the future with a time series of this former static source. So I did with the parking data of Frankfurt and you can inspect the data in this repository.

Datengraben

Using git-history to build a web scraper in less than a minute