chimet-scraper

Scraper for MET data from chimet.co.uk.

Currently supports downloading data from:

• www.bramblemet.co.uk
• www.cambermet.co.uk
• www.chimet.co.uk
• www.sotonmet.co.uk

The scraper currently makes one request per second, which means it takes about 1 hour to download all of the historic data for one location.

Requirements

This program requires Python3, python-dateutil, pandas, and tqdm. These can be installed via:

pip3 install python-dateutil pandas tqdm

Or, if you use pipenv, you can use the following to install from the Pipfile.

pipenv install

Running

Run the program with:

python3 chimet-scraper.py

If you are using pipenv, please run the following instead:

pipenv run python3 chimet-scraper.py

This will download all the weather data from Southampton, Bramble, and Chichester, and cache them into a cache/ folder. Then, it will be combined into one big .csv file in the output/ folder.

Help

Please run the following to view help:

python3 chimet-scraper.py --help