As part of the Data Strategy Improvement Programme (DSIP), the data warehouse project will deliver an upgraded data warehouse offering a trusted and up-to-date source of data for data analysts and report writers in support of decision-making at the University. The warehouse will be based on modern technology using medallion architecture to facilitate better data quality, clear traceability, scalability, efficiency for analysts and improved collaboration.
This will deliver three layers of data:
- Bronze: the raw data taken from source systems (such as, Finance, People XD etc) which will allow:
- preservation of the original data for auditing and troubleshooting
- full traceability of data from its source to final output
- scalability by isolating raw data ingestion processes
- Silver: cleaned, standardised and validated raw data, with inconsistencies resolved and domain rules applied which will provide:
- high quality, consistent datasets for further processing
- simplified data integration through reconciliation of inconsistencies (for example, through formatting or duplication)
- a trusted data source
- Gold: curated, analytics-ready data ready for reporting, dashboards and advanced analytics which will allow:
- delivery of a single source of truth for University metrics
- ensuring high performance for reporting tools (like Power BI)
- enabling advanced insights via provision of specific datasets
Access to layers will be based on need but broadly will look like:
- Bronze: data developers
- Silver: data developers and BI developers
- Gold: BI developers and report writers
Project progress
The project is scheduled to complete in Summer 2025. Progress will be reported via the Data News page following each two-weekly sprint of work, linking out to sprint reports for those wanting more detail.
