README.md 1.48 KB
Newer Older
Ben Anderson's avatar
Ben Anderson committed
1
2
3
4
5
DECC-git NEED
============

Extract & analyse data from the public versions of DECC's  NEED dataset

Ben Anderson's avatar
Ben Anderson committed
6
Original 'End User License' version of the data available from: UK DATA ARCHIVE: Study Number 7518 - National Energy Efficiency Data-Framework, 2014
Ben Anderson's avatar
Ben Anderson committed
7
8
http://discover.ukdataservice.ac.uk/catalogue/?sn=7518

Ben Anderson's avatar
Ben Anderson committed
9
10
For full detailed documentation see https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/332169/need_anonymised_dataset_accompanying_documentation.pdf

Ben Anderson's avatar
Ben Anderson committed
11
Notes (mostly to self):
Ben Anderson's avatar
Ben Anderson committed
12
* gas kwh are weather corrected on distribution zones before delivery to DECC
Ben Anderson's avatar
Ben Anderson committed
13
* This dataset is a sample of just over 4 million households which have had an Energy Performance Certificate from the full NEED 'all dwellings' dataset
Ben Anderson's avatar
Ben Anderson committed
14
15
16
17
* It is a semi-random sample of the 8m records with an EPC, it includes only those with valid values on all variables and (especially) valid observations for electricity in 2012. Uncommon property types are over-represented, common types are under-represented and the weight corrects for this
* Sample bias is unclear - which kinds of dwellings have an EPC (e.g. flats where frequent churn may be over-represented?)
* UPRN = unique property reference = linkage mechanism (uses AddressBase)

Ben Anderson's avatar
Ben Anderson committed
18
Issues:
Ben Anderson's avatar
Ben Anderson committed
19
* Gcons<year>valid variable has undefined labels: G, L, M = ?  0 = off gas & V = valid reading (range 0 - 50,000) so presumably L = large (> 50,000?) and M = missing? But G?
Ben Anderson's avatar
Ben Anderson committed
20
* ideally DECC should set missing to -99 to aid re-coding and avoid unpleasant surprises in naive analysis!
Ben Anderson's avatar
Ben Anderson committed
21