README.md 1.09 KB
Newer Older
Alois Klink's avatar
Alois Klink committed
1
# chimet-scraper
2

3 4 5 6 7 8 9 10 11 12 13 14
Scraper for MET data from [chimet.co.uk](http://www.chimet.co.uk).

Currently supports downloading data from:

- www.bramblemet.co.uk
- www.cambermet.co.uk
- www.chimet.co.uk
- www.sotonmet.co.uk

The scraper currently makes one request per second, which means
it takes about 1 hour to download all of the historic data for one
location.
15 16 17

## Requirements

Alois Klink's avatar
Alois Klink committed
18
This program requires Python3, `python-dateutil`, `pandas`, and `tqdm`.
19 20 21
These can be installed via:

```
Alois Klink's avatar
Alois Klink committed
22
pip3 install python-dateutil pandas tqdm
23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
```

Or, if you use `pipenv`, you can use the following to install from the
[`Pipfile`](./Pipfile).

```
pipenv install
```

## Running

Run the program with:

```
python3 chimet-scraper.py
```

If you are using `pipenv`, please run the following instead:

```
pipenv run python3 chimet-scraper.py
```

This will download all the weather data from
Southampton, Bramble, and Chichester, and cache them into a `cache/` folder.
Then, it will be combined into one big `.csv` file in the `output/` folder.
49 50 51 52 53 54 55 56

## Help

Please run the following to view help:

```
python3 chimet-scraper.py --help
```