Datasets

The following organisations are providing datasets for the Birmingham Highways Data Challenge on 25/26 Nov 2016 (details below):

• Birmingham City Council
• West Midlands Combined Authority
• West Midlands Fire Service
• Highways England
• HS2
• TransportAPI
• roadworks.org
• GEOmii
• Department for Transport
• Open Street Map
• Mott MacDonald
• Amey

Birmingham City Council

http://butc.opendata.onl/AL_OpenData: Live 5 minute traffic and parking (and historic) data pulled together into this beta interface available as live feeds in xml, JSON, xlsx. xls, csv, txt and html formats for:

• Traffic: traffic speeds (spot and link based), traffic flow, traffic events (incidents and roadworks)
• Car Parks (Birmingham City Centre only): Car park occupancy, Car park status;
• Variable Message Sign Information

Cycle Routes – https://data.birmingham.gov.uk/dataset/cycling-routes
Cycle Counters – https://data.birmingham.gov.uk/dataset/cycling-sensors

Via Amey / Highways Maintenance provider for Birmingham City Council:

First set of data highways asset management data published in February 2017 on Birmingham Data Factory: https://data.birmingham.gov.uk/dataset/highways-assets

• Gullies
• Lighting columns
• Traffic Signals
• Trees

Blogpost from MappaMercia, the West Midlands Open Street Map community: http://www.mappa-mercia.org/2017/03/massive-release-of-highways-asset-data-in-birmingham.html

West Midlands Combined Authority

• Access to realtime bus and tram information through new API: https://api-portal.tfwm.org.uk/
• GTFS feed of public transport data for WM region
• Naptan datasets (https://data.gov.uk/dataset/naptan)
• Rail Station locations, zones, bands
• WMCA park and ride
• Cycle storage/hire locations, capacities
• Swift remote collectors
• Payzone outlets selling swift cards
• Ticket feed
• Integrated journey plan (API which exists underneath https://journeyplanner.networkwestmidlands.com)
• Integrated journey plan/ticketing – provide suitable fares for a planned journey (API)
• WMCA has access to the entire ATOC fares database
• Timetable data

Highways England

The Highways England National Traffic Information Service (NTIS) can provide both real-time and historic data services. There is a lot of data – updated each minute – for all the motorways and major A-roads in England.

• http://www.trafficengland.com/services-info
• http://www.highways.gov.uk/traffic-information
• http://www.datex2.eu/datex-node

Software toolkits are published for the DATEX II XML web service on github:

• https://github.com/ntisservices

There are services available as open data:

• https://data.gov.uk/dataset/live-traffic-information-from-the-highways-agency-road-network
• http://www.highways.gov.uk/mobile-services/

The MobileAPI (more internal to NTIS), is a cut down version of our DATEXII feed, thus I’d advise the best way forward would be to connect via the DATEXII toolkit (https://github.com/SaturnEclipseUK), this has a JSON near real-time interface.

Most of the data is sourced from NTIS so although the formats and delivery mechanisms vary the content should be similar. There may be higher latency with derived services.

HS2

Data on predicted HGV movements for HS2 construction traffic available from the environmental statements http://webarchive.nationalarchives.gov.uk/20140810181550/http://assets.dft.gov.uk/hs2-environmental-statement/volume-5/traffic/Vol_5_TA_WestMids_assessment_CFA25-26_%28Sec8b%29_Part9_wm.pdf

TransportAPI

• Open distribution of nationwide transport data via API
• See http://docs.transportapi.com/
• Data available on open terms at http://fcc.transportapi.com/ with support from Future Cities Catapult

GEOmii

GEOmii info: http://geomii.co/

API: http://parking.ethosvo.org/services/

Elgin (Roadworks.org)

Elgin aggregates roadworks and traffic disruption data across the UK. The data includes roadworks information which varies in accuracy but is typically up-to-date to within +/- 24 hours and planned works and traffic interventions that are scheduled in the future. The data can be viewed on roadworks.org. Details of the Elgin data feed provided for the Hackathon are as follows:

Area: Data within the boundary of Birmingham City Council
Data content:

• Current roadworks on all roads
• Planned roadworks on all roads up to 28 days in the future
• Details of road closures and lane closures associated with works

Caching policy: 10 minutes
Schema and technical documentation: https://github.com/roadworks/api
Data license: The data is made available under the Open Government License terms, with the exception of one field in the data which is included for ease of use: Road names are subject to OS Crown Copyright (eRoadName and iRoadName data elements in the XML) and any use of road names should comply with OS licensing restrictions. Please refer any enquiries about this to Elgin representatives in the first instance.
Data feed endpoint: http://data.roadworks.org/edfm/data.aspx?r=entities&cached=true&t=rc&k=99f23dd77c5aa0447472ac7fd3a07d53

West Midlands Fire Service

http://wmfscss.shoothill.com/#!landing

This is a beta version of a collection of searchable data. including the Fire Service’s own data, together with things like deprivation, census data and more. The service release open incident data, which includes details of all the traffic collisions we attend (in some cases not covered by police data).

Department for Transport (DfT) – from data available on data.gov.uk

1. Transport appraisal and strategic modelling (TASM) research reports
   Analysis, appraisal, evaluation, modelling, and research which has been carried out to inform transport decisions and policies
   https://www.gov.uk/government/collections/transport-appraisal-and-strategic-modelling-tasm-research-reports
2. Road freight statistics: April 2015 to March 2016
   Road freight activity statistics for the United Kingdom and internationally between April 2015 to March 2016.
   https://www.gov.uk/government/statistics/road-freight-statistics-april-2015-to-march-2016
3. Reported road accidents
   Reported road accidents statistics tables, produced by Department for Transport.
   https://www.gov.uk/government/statistical-data-sets/ras10-reported-road-accidents
   (also available as an API via TransportAPI)
4. Road conditions: Contextual information (RDC03)
   Road network size and condition statistics tables, produced by Department for Transport.
   https://www.gov.uk/government/statistical-data-sets/rdc03-roads-requiring-maintenance-and-road-lengths
5. The condition of local authority managed roads (RDC01)
   Condition of local authority managed roads tables, produced by Department for Transport.
   https://www.gov.uk/government/statistical-data-sets/rdc01-roads-where-maintenance-sould-be-considered
6. GB Road Traffic Counts
   The Department for Transport collects traffic data to produce statistics on the level of traffic on roads in Great Britain. This website provides the underlying street-level data for download.
   The most user-friendly method to access street-level road traffic estimates, with an interactive mapping tool, is via http://www.dft.gov.uk/traffic-counts/
   Data are available for each junction to junction link on the major road network (motorways and A roads). Data are also available for the sample of points on the minor road network (B, C and unclassified roads) that are counted each year, and these counts are used to produce estimates of traffic growth on minor roads.The data are produced for every year, and are in three formats:

• the raw manual count data collected by trained enumerators;
• Annual Average Daily Flows (AADFs) for count points on major roads and minor roads; and
• traffic figures for major roads only. Explanatory notes (metadata) are available for each dataset, and in one combined note.
  https://data.gov.uk/dataset/gb-road-traffic-counts

Open Street Map

Planet.osm is the OpenStreetMap data in one file: all the nodes, ways and relations that make up our map: http://wiki.openstreetmap.org/wiki/Elements.

A new version is released every week. It’s a big file (XML variant over 721.1GB uncompressed, 52.8GB bz2 compressed and 32.9GB PBF (http://wiki.openstreetmap.org/wiki/PBF_Format) at 2016-09-20).Further info here: http://wiki.openstreetmap.org/wiki/Planet.osm

There are also files called Extracts which contain OpenStreetMap Data for individual continents, countries, and metropolitan areas.

Complete extract of all OSM data for the West Midlands- updated daily: http://download.geofabrik.de/europe/great-britain/england/west-midlands.html

Direct API access is via Overpass API: http://wiki.openstreetmap.org/wiki/Overpass_API

Other useful tools:

map-based data visualisation of OSM highways data – updated weekly: http://product.itoworld.com/map/group/2

Web -based Overpass Query and Extract tool: http://overpass-turbo.eu/