Government Report On Data Information And Open Government register

List of important UK government reports on data, information and open government This is a rough attempt by Gavin Freeguard to compile a list of major reports relating to data, information and open government related to government in the UK. Original spreadsheet can be found here: https://docs.google.com/spreadsheets/d/1lbGnx9sD3eXuQaz0yV6XClznDLwfd3X4PHfhEbSXKIs/edit#gid=243696253

Government-Report-On-Data-Information-And-Open-Government Date Type Link Organisation Individual Summary What Was New?
Name of the report Date the information was shared Type of report Link to the resource Organisation within government that is responsible for the report
" 2/10/2020 Report https://www.gov.uk/government/publications/artificial-intelligence-and-public-standards-report Committee on Standards in Public Life
"Artificial Intelligence and Public Standards: report
AI Roadmap 6/1/2021 Report https://www.gov.uk/government/publications/ai-roadmap AI Council
APPSI Discussion: A National Information Framework 1/10/2012 Report https://webarchive.nationalarchives.gov.uk/+/http://www.nationalarchives.gov.uk/appsi/appsi-discussion.htm Advisory Panel on Public Sector Information
Adding it up: Improving Analysis & Modelling in Central Government 1/1/2000 Report https://dera.ioe.ac.uk/6321/2/coiaddin.pdf Cabinet Office
Addressing trust in public sector data use 20/7/2020 Report https://www.gov.uk/government/publications/cdei-publishes-its-first-report-on-public-sector-data-sharing/addressing-trust-in-public-sector-data-use CDEI
Better Information for Better Government 18/01/2017 Response https://www.gov.uk/government/publications/better-information-for-better-government Cabinet Office
Better Statistics, Better Decisions: Strategy for UK statistics, 2015 to 2020 1/10/2014 Report https://gss.civilservice.gov.uk/wp-content/uploads/2012/12/Better-Statistics-Better-Decisions.pdf UKSA Five-year (2015 to 2020) strategy for the UK official statistics system. Eight objectives: to inform decision-making, support democratic debate, improve communication, challenge misuse of statistics, deliver high quality statistics/analysis/advice, develop and implement innovative methods, demonstrate value for money, build capability. Statistics should be Helpful, Innovative, Capable, Efficient and Professional.
Better Statistics, Better Decisions: Three Years On 1/1/2017 Report https://www.statisticsauthority.gov.uk/better-statistics-three-years-on/ UKSA Progress check on Better Statistics, Better Decisions. Highlights three priorities for change: economic statistics, contributing to public policy, and building data capability.
Business customer attitudes towards data privacy and data sharing 2/9/2019 Report https://www.gov.uk/government/publications/business-customer-attitudes-towards-data-privacy-and-data-sharing HMRC
Caldicott review: information governance in the health and care system 26/04/2013 Report https://www.gov.uk/government/publications/the-information-governance-review National Data Guardian An ‘independent review of information sharing to ensure that there is an appropriate balance between the protection of patient information and the use and sharing of information to improve patient care’.
Challenges in using data across government 21/06/2019 Report https://www.nao.org.uk/report/challenges-in-using-data-across-government/ NAO
Choose tools and infrastructure to make better use of your data 1/7/2019 Guidance https://www.gov.uk/guidance/choose-tools-and-infrastructure-to-make-better-use-of-your-data Cabinet Office
Code of Practice on the Management of Records issued under section 46 the Freedom of Information Act 2000 15/7/2021 Guidance https://www.gov.uk/government/publications/code-of-practice-on-the-management-of-records-issued-under-section-46-the-freedom-of-information-act-2000 DCMS, The National Archives
Computational modelling: Blackett review 2/20/2018 Report https://www.gov.uk/government/publications/computational-modelling-blackett-review GO Science
D5 Charter 11/12/2014 Charter https://www.gov.uk/government/publications/d5-charter Cabinet Office
Data Ethics Framework 13/06/2018 Guidance https://www.gov.uk/government/publications/data-ethics-framework DCMS
Data Management Board: data vision for Scotland 17/04/2004 Report https://www.gov.scot/publications/data-vision-for-scotland/ Scottish Government
Data Protection Act 1998 16/07/1998 Primary legislation https://www.legislation.gov.uk/ukpga/1998/29/contents UK government
Data Protection Act 2018 23/05/2018 Primary legislation http://www.legislation.gov.uk/ukpga/2018/12/contents/enacted UK government
Data Science Ethical Framework 19/05/2016 Guidance https://www.gov.uk/government/publications/data-science-ethical-framework Cabinet Office
Data Sharing Review Report 11/7/2008 Report https://webarchive.nationalarchives.gov.uk/+/http:/www.justice.gov.uk/docs/data-sharing-review.pdf Data Sharing Review Richard Thomas; Mark Walport
Data ethics and AI guidance landscape 21/7/2020 Guidance https://www.gov.uk/guidance/data-ethics-and-ai-guidance-landscape DCMS
Data for the public good 14/12/2017 Report https://www.nic.org.uk/publications/data-public-good/ National Infrastructure Commission
Data handling procedures in government 17/11/2008 Report https://www.gov.uk/government/publications/data-handling-procedures-in-government Cabinet Office ...sets out how Government is improving its arrangements around information and data security, by putting in place core protective measures, getting the working culture right, improving accountability and scrutiny of performance.’
Data saves lives: reshaping health and social care with data (draft) 22/6/2021 Plan https://www.gov.uk/government/publications/data-saves-lives-reshaping-health-and-social-care-with-data-draft DHSC, NHSX
Defra's data principles 4/4/2017 Guidance https://defradigital.blog.gov.uk/2017/04/04/defras-data-principles/ Defra
Departmental open data strategies 28/06/2012 Report https://www.gov.uk/search/all?keywords=%22open+data+strategy%22&order=relevance UK government Open data strategies for each department. First published in June 2012, although some have been updated since.
Digital Economy Act 2017 27/04/2017 Primary legislation http://www.legislation.gov.uk/ukpga/2017/30/contents/enacted UK government
Fixing broken politics 26/05/2009 Speech https://conservative-speeches.sayit.mysociety.org/speech/601355 Conservative Party David Cameron Post-expenses scandal speech talking about the importance of transparency in politics, including spending data.
Freedom of Information (Scotland) Act 2002 28/05/2002 Primary legislation http://www.legislation.gov.uk/asp/2002/13/contents Scottish Government
Freedom of Information Act 2000 30/11/2000 Primary legislation https://www.legislation.gov.uk/ukpga/2000/36/contents UK government
Future identities: changing identities in the UK 21/01/2013 Report https://www.gov.uk/government/publications/future-identities-changing-identities-in-the-uk GO Science
General Data Protection Regulation 27/04/2016 Regulation https://eur-lex.europa.eu/legal-content/EN/TXT/HTML/?uri=CELEX:32016R0679 EU
Getting smart about intellectual property and intangible assets 29/10/2018 Report https://www.gov.uk/government/publications/getting-smart-about-intellectual-property-and-intangible-assets HMT
Getting smarter: a strategy for knowledge & innovation assets in the public sector. The Mackintosh Report 20/04/2021 Report https://www.gov.uk/government/publications/getting-smarter-a-strategy-for-knowledge-innovation-assets-in-the-public-sector-the-mackintosh-report HMT
Government Response to Redmond Review 12/17/2020 Response https://www.gov.uk/government/publications/local-authority-financial-reporting-and-external-audit-government-response-to-the-redmond-review/local-authority-financial-reporting-and-external-audit-government-response-to-the-independent-review Ministry of Housing & Local Government
Government Technology Innovation Strategy 20/6/2019 Plan https://www.gov.uk/government/publications/the-government-technology-innovation-strategy Cabinet Office
Government Transformation Strategy 9/2/2017 Report https://www.gov.uk/government/publications/government-transformation-strategy-2017-to-2020/government-transformation-strategy#make-better-use-of-data Cabinet Office Includes 'Make better use of data' as one of the key pillars
Government digital records and archives review by Sir Alex Allan 17/12/2015 Report https://www.gov.uk/government/publications/government-digital-records-and-archives-review-by-sir-alex-allan Cabinet Office Sir Alex Allan
Government response to Shakespeare review 14/06/2013 Response https://www.gov.uk/government/publications/government-response-to-shakespeare-review BIS; CO
Government response to the consultation on the National Data Strategy 18/05/2021 Response https://www.gov.uk/government/consultations/uk-national-data-strategy-nds-consultation/outcome/government-response-to-the-consultation-on-the-national-data-strategy DCMS
Government's digital approach has lost momentum 10/7/2019 Report https://www.parliament.uk/business/committees/committees-a-z/commons-select/science-and-technology-committee/news-parliament-2017/digital-government-report-publication-17-19/ Parliament "the right of the citizen to know exactly what the Government is doing with their data"
Growing the artificial intelligence industry in the UK 15/10/2017 Report https://www.gov.uk/government/publications/growing-the-artificial-intelligence-industry-in-the-uk DCMS; BEIS Wendy Hall; Jérôme Pesenti The review included a number of recommendations around data, including ‘data trusts’ – ‘proven and trusted frameworks and agreements – to ensure exchanges are secure and mutually beneficial’.
How to publish central government transparency data 14/12/2017 Guidance https://www.gov.uk/government/collections/how-to-publish-central-government-transparency-data Cabinet Office
INSPIRE directive 25/04/2007 Regulation https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=OJ:L:2007:108:TOC EU
Increasing access to data held across the economy 31/03/21 Report https://www.gov.uk/government/publications/increasing-access-to-data-held-across-the-economy DCMS
Independent Commission on Freedom of Information report 1/3/2016 Report https://www.gov.uk/government/publications/independent-commission-on-freedom-of-information-report Independent Commission on Freedom of Information
Independent review into the arrangements in place to support the transparency and quality of local authority financial reporting and external audit in England 8/9/2020 Report https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/850638/Redmond_Review_Call_for_Views_-_Extended.pdf Ministry of Housing & Local Government Sir Tony Redmond Review od local government financial reporting and auditing
Independent transparency and privacy review 13/09/2011 Report https://www.gov.uk/government/publications/independent-transparency-and-privacy-review Cabinet Office
Information Matters: building government's capability in managing knowledge and information 18/11/2008 Report https://webarchive.nationalarchives.gov.uk/20081217130948/http://www.appsi.gov.uk/2008/11/18/InformationMattersBuildingGovernmentsCapabilityInManagingKnowledgeAndInformation UK government ... sets out the responsibility that all Civil Servants have for managing the knowledge and information they create or handle.'
Information economy strategy 14/06/2013 Report https://www.gov.uk/government/publications/information-economy-strategy BIS A ‘strategy from government and industry for the future of the information economy’.
Information matters: delivery plan for 2009–2010 1/11/2009 Plan https://www.nationalarchives.gov.uk/documents/information-matters-2009-10-3.pdf UK government
Information principles for the UK public sector [WITHDRAWN] 30/04/2012 Guidance https://www.gov.uk/government/publications/information-principles-for-the-uk-public-sector Cabinet Office See also: http://www.nationalarchives.gov.uk/information-management/manage-information/planning/information-principles/
International Aid Transparency Initiative Standard 2/9/2008 Standard https://iatistandard.org/en/about/iati-standard/ International Aid Transparency Initiative DfID became the first organisation to publish data to AITI in January 2011. The UK made further commitments as part of its second OGP National Action Plan, 2013-15
Joined up data in government: the future of data linking methods 25/8/2020 Report https://www.gov.uk/government/publications/joined-up-data-in-government-the-future-of-data-linking-methods ONS; Analysis Function
Joining Up Data for Better Statistics 11/9/2018 Report https://www.statisticsauthority.gov.uk/publication/joining-up-data/ Office for Statistics Regulation
Joining Up Data for Better Statistics - 2019 update 2/10/2019 Report https://www.statisticsauthority.gov.uk/publication/joining-up-data-2019-update/ Office for Statistics Regulation
Knowledge Principles for Government 1/7/2016 Guidance http://www.nationalarchives.gov.uk/documents/information-management/knowledge-principles-for-government.pdf UK government
Launch of data.gov.uk 22/01/2010 Speech https://www.theguardian.com/news/datablog/video/2010/jan/22/freedomofinformation-government-data Cabinet Office Stephen Timms, Minister for Digital Britain
Letter from the Prime Minister on government transparency and open data 14/12/2017 Letter https://www.gov.uk/government/publications/letter-from-the-prime-minister-on-government-transparency-and-open-data UK government Theresa May
Letter re: challenges of using data across government 4/10/2020 Letter https://committees.parliament.uk/publications/1006/documents/7937/default/ Cabinet Office
Letter to Cabinet Ministers on transparency and open data 7/7/2011 Letter https://www.gov.uk/government/news/letter-to-cabinet-ministers-on-transparency-and-open-data UK government David Cameron A recap of achievements and a set of new transparency commitments to open up government and public service data, as well as some around data quality – spending data to include scope/purpose of every transaction, an action plan from each department on quality and comparability, and reference indicators to ‘enable the public to track more easily the interaction between companies and government bodies’.
Letter to government departments on opening up data 31/05/2010 Letter https://www.gov.uk/government/news/letter-to-government-departments-on-opening-up-data UK government David Cameron Letter outlining the importance of open data and which datasets departments should release.
Local Government Transparency Code 2015 25/02/2015 Code https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/408386/150227_PUBLICATION_Final_LGTC_2015.pdf Department for Communities and Local Government Shehla Husain A Senior Civil Servant in the Department for Communities and Local Government Guidelines for Local Council Opendata publication Social housing data added
Making open data real 4/8/2011 Consultation https://www.gov.uk/government/consultations/making-open-data-real Cabinet Office ‘The Open Data consultation paper sets out government’s proposed approach for a Transparency and Open Data Strategy, which is aimed at establishing a culture of openness and transparency in public services… The proposed approach is fundamentally about creating a ‘pull’ (an enhanced right to data) and a ‘push’ (a presumption of publication).’
Modernising Government 1/3/1999 Report https://webarchive.nationalarchives.gov.uk/20091111095905/http://archive.cabinetoffice.gov.uk/moderngov/whtpaper/index.htm Cabinet Office
National Data Strategy 9/9/2020 Plan https://www.gov.uk/government/publications/uk-national-data-strategy DCMS
National Data Strategy open call for evidence 10/6/2019 Consultation https://www.gov.uk/government/publications/national-data-strategy-open-call-for-evidence DCMS
National Information Infrastructure 31/10/2013 Report https://www.gov.uk/government/publications/national-information-infrastructure Cabinet Office In response to the Shakespeare Review (June 2013), the government identified a list of important data – that with ‘the broadest and most significant economic and social impact if made available and accessible outside of government’ – in order to prioritise and support organisations to release it.
Open Data: unleashing the potential 28/06/2012 White paper https://www.gov.uk/government/publications/open-data-white-paper-unleashing-the-potential Cabinet Office White Paper about ‘putting data and transparency at the heart of government and public services’, including making access easier, making it easier for data publishers to release data, and engraining a ‘presumption to publish’ unless there are clear reasons not to.
Open Government National Action Plan 2019-21 - Commitments from the Northern Ireland Executive 28/05/2019 Plan https://www.gov.uk/government/publications/commitments-from-the-northern-ireland-executive--2 Northern Ireland Executive
Open Government Partnership Scottish Action Plan 9/12/2016 Plan https://www.gov.scot/publications/open-government-partnership-scottish-action-plan/ Scottish Government
Open Government Partnership UK National Action Plan 2013 to 2015 27/06/2013 Plan https://www.gov.uk/government/consultations/open-government-partnership-uk-national-action-plan-2013/open-government-partnership-uk-national-action-plan-2013-to-2015 Cabinet Office The commitments under the open data heading included a National Information Infrastructure, work with NHS England, a revised Local Authorities Data Transparency Code, the most transparent social investment market in the Open Government Partnership and G20, and one on digital records and archives. Other headings were government integrity, fiscal transparency (including open contracting, aid to the IATI standard), empowering citizens and natural resource transparency (an extractive industry transparency standard).
Open data charter 18/06/2013 Charter https://www.gov.uk/government/publications/open-data-charter Cabinet Office Set out ‘5 strategic principles that all G8 members will act on. These include an expectation that all government data will be published openly by default, alongside principles to increase the quality, quantity and re-use of the data that is released.’
Open data strategy for Northern Ireland 2020 - 2023 10/14/2019 Report https://www.finance-ni.gov.uk/publications/open-data-strategy-northern-ireland-2020-2023 NI Department of Finance
Openness by design 27/06/2019 Report https://ico.org.uk/media/about-the-ico/documents/2615190/openness_by_-design_strategy_201906.pdf ICO
Outsourcing oversight? 28/01/2019 Report https://ico.org.uk/about-the-ico/what-we-do/outsourcing-oversight/ ICO
Outsourcing the 2001 Census 18/10/2002 Report https://www.nao.org.uk/report/office-for-national-statistics-outsourcing-the-2001-census/ NAO Outsourcing had some governance problems and future census should use existing data
Place matters: the Location Strategy for the United Kingdom - Geographic Information Panel 25/11/2008 Report https://webarchive.nationalarchives.gov.uk/20081217131015/http://www.appsi.gov.uk/2008/11/25/UKLocationStrategyPublishedToday DCLG
Power of Information Taskforce Report 1/2/2009 Report https://webarchive.nationalarchives.gov.uk/20100407163222/http://www.cabinetoffice.gov.uk/reports/power_of_information.aspx Power of Information Taskforce
Public Records Act 1958 23/07/1958 Primary legislation http://www.legislation.gov.uk/ukpga/Eliz2/6-7/51/contents UK government
Quantifying the UK Data Skill Gap - Summary version 18/5/2021 Report https://www.gov.uk/government/publications/quantifying-the-uk-data-skills-gap/quantifying-the-uk-data-skills-gap DCMS
Safe data, safe care 6/7/2016 Report https://www.cqc.org.uk/publications/themed-work/safe-data-safe-care Care Quality Commission The review focused on patient data in the NHS.
Scotland's Open Government Action Plan: 2018-2020 30/01/2019 Plan https://www.gov.scot/publications/scotlands-open-government-action-plan-2018-20/ Scottish Government
Shakespeare review of public sector information 15/05/2013 Report https://www.gov.uk/government/publications/shakespeare-review-of-public-sector-information BIS A review government committed to in the Open Data White Paper. Made nine recommendations: a national data strategy, a twin track (not make best enemy of the good/high quality core), clear leadership – single body for driving access to public sector information, review trading fund model, ‘clear pragmatic policy on privacy’,
Single Data List 17/10/2012 Guidance https://www.gov.uk/government/publications/single-data-list DCLG A list of all the data local authorities are required to submit to central government. Includes six principles for assessing whether new data should be added to the list.
Smart data: putting consumers in control of their data and enabling innovation 11/6/2019 Consultation https://www.gov.uk/government/consultations/smart-data-putting-consumers-in-control-of-their-data-and-enabling-innovation BEIS; DCMS
Statistics and Registration Service Act 2007 26/07/2007 Primary legislation https://www.legislation.gov.uk/ukpga/2007/18/contents UK government
Statistics for the public good - five year strategy 16/7/2020 Plan https://uksa.statisticsauthority.gov.uk/statistics-for-the-public-good/ UKSA
Technology innovation in government survey 20/8/2018 Survey https://www.gov.uk/government/publications/technology-innovation-in-government-survey GDS
The Aqua Book: guidance on producing quality analysis for government 26/03/2015 Guidance https://www.gov.uk/government/publications/the-aqua-book-guidance-on-producing-quality-analysis-for-government HM Treasury
The Balance Sheet Review Report: Improving public sector balance sheet management 11/25/2020 Report https://www.gov.uk/government/publications/the-balance-sheet-review-report-improving-public-sector-balance-sheet-management HMT
The Code of Practice for Statistics 1/2/2018 Guidance https://www.statisticsauthority.gov.uk/code-of-practice/latest-updates/ UKSA Date refers to first publication of the refreshed code, version 2.0.
The Dstl Biscuit Book: An information guide on Artificial Intelligence (AI), Data Science and Machine Learning 23/7/2019 Guidance https://www.gov.uk/government/publications/the-dstl-biscuit-book DSTL
The Environmental Information Regulations 2004 21/12/2004 Secondary legislation http://www.legislation.gov.uk/uksi/2004/3391/contents/made UK government
The Gemini principles 6/12/2018 Report https://www.cdbb.cam.ac.uk/Resources/ResoucePublications/TheGeminiPrinciples.pdf Centre for Digital Built Britain
The National Information Infrastructure (NII): Why, What and How 1/1/2015 Report http://puntofisso.net/odugUK_NII_final.pdf Open Data User Group This paper is designed to provide a greater understanding why an NII is critical, what it can assist with and how it can be delivered and maintained. It will also deal with the issues that need to be addressed to make it a success. Simply put, there is a large jigsaw puzzle to assemble, but it is completely feasible to put the data infrastructure contemplated in this paper in place. The necessary technology is relatively inexpensive and readily available, as is most of the data, which is locked away in silos in different parts of the public sector.'
The Power of Information 1/6/2007 Report http://www.opsi.gov.uk/advice/poi/power-of-information-review.pdf Ed Mayo; Tom Steinberg