Campaign: Fragmented data
To avoid data being inaccessible, duplicated or wasteful, we recommend that all public data should adhere to a compulsory data standard, the location be published in a central repository and that support should be provided by the data convener.
What’s the problem?
Data gets fragmented when many organisations are required to publish the same data, but not to a common standard or in a common location. Data gets published, but in unpredictable locations and formats, all across the internet.
Unfortunately, fragmented data rarely has the intended impact because no one can see the big picture. Data users cannot easily use the data, policymakers cannot identify areas for improvement, and public bodies are required to produce data without seeing clear results from their work.
The opportunity
Happily, this is pretty easy to fix without increasing burdens on the organisations involved. We recommend three minimum features for a successful data publishing requirement:
A mandatory data standard to agree the data and format that is expected.
A centrally maintained repository of the published datasets’ URLs, or of the data itself if resources allow.
Support from the data convener to make publication simple and effective – e.g. through validation and publication tools, coordinating returns, and technical support.
For our full recommendations, read our joint report with mySociety.