Campaign: Fragmented data

To avoid data being inaccessible, duplicated or wasteful, we recommend that all public data should adhere to a compulsory data standard, the location be published in a central repository and that support should be provided by the data convener.

What’s the problem?

Data gets fragmented when many organisations are required to publish the same data, but not to a common standard or in a common location. Data gets published, but in unpredictable locations and formats, all across the internet.

Unfortunately, fragmented data rarely has the intended impact because no one can see the big picture. Data users cannot easily use the data, policymakers cannot identify areas for improvement, and public bodies are required to produce data without seeing clear results from their work. 

The opportunity

Happily, this is pretty easy to fix without increasing burdens on the organisations involved. We recommend three minimum features for a successful data publishing requirement:

  1. A mandatory data standard to agree the data and format that is expected.

  2. A centrally maintained repository of the published datasets’ URLs, or of the data itself if resources allow.

  3. Support from the data convener to make publication simple and effective – e.g. through validation and publication tools, coordinating returns, and technical support.

For our full recommendations, read our joint report with mySociety.

Publications

 

Written evidence: the Office for Local Government (2)

March 2024

We responded with mySociety to a consultation on the Office for Local Government’s (Oflog’s) new draft Corporate Plan.

To support civil society’s analysis of local government performance, we recommend that Oflog include data users and republishers in its user research, and tackle fragmentation in local government data.

Written evidence: the Office for Local Government

March 2024

We submitted joint evidence with mySociety to the Department for Levelling Up’s inquiry into the Office for Local Government (Oflog).

We recommend that Oflog tackle fragmentation in local government data so that the data’s potential does not continue to go untapped.

Briefing: Healthcare payments data

January 2024

This briefing discusses how plans to increase transparency about industry payments to the healthcare sector could be jeopardised by data fragmentation.

Drug companies may soon be required to publish data on their payments to doctors. However, this data could be of limited value if data standards and a central repository are not set up.

 
 

Report: Unlocking the value of fragmented public data

February 2023

Co-written with mySociety, this report outlines principles for maximising the value of publishing public data.

To avoid data being inaccessible, duplicated or wasteful, we recommend that all public data should adhere to a compulsory data standard, the location be published in a central repository and that support should be provided by the data convener.

 

Latest news