Principal Data Engineer * Remote Working * 75k- 90k * J12392
An exciting opportunity has arisen for a Principal Data Engineer to lead the design and delivery of data engineering capabilities across the full range of a regulatory body's organisation activities. As data is the lifeblood of analytics and insights that drives decision making, this is a key role to ensure the teams using data have access to the right data, at the right time, on the right platform for decisions to be made.
The role will lead a team of talented data engineers support Data Science, Machine Learning and AI Teams as they generate innovative solutions for a variety of business functions.
You will have excellent stakeholder relationship skills to understand the needs of data scientists and policy teams, turning these into data requirements for prototyping, or to full business design requirements the Information Technology teams to deliver fully automated data pipelines.
In addition experience in Data Governance, data processing and data platforms to advise teams across the organisation on these vital roles and ensure there is consistency as part of the overall data strategy.
In collaboration with colleagues across analytical and technology teams you will also support the engagement with wider research communities.
Requirements of the Role:
Working collaboratively and leading discussions with colleagues in the Hub, policy and operations teams, to understand how they obtain, use and share data and informing how that may change in the future
Working with the ICT data platform team to provide guidance on, and the testing of, ICT's approach to a data enterprise architecture
Collaborating with the Data Governance Manager to support the delivery of data management and stewardship practices across the organisation
Directing the work of data engineers and specialists to support teams across the organisation to build, deploy and proactively maintain systems to extract, transform and load (ETL) data
Continuously seeking ways to improve data systems and pipelines to be in line with industry best practice, including approaches to encryption
Managing relationships with key internal and external stakeholders, including building and maintaining strategic relationships with universities and other regulatory or government bodies active in the management and use of data
Working with the Chief Data Officer and other senior members of the Hub to set, realise and review its strategic direction;
Setting and leading the technical vision while balancing business drivers and imperatives to help customers build successful and impactful engineering solutions
Working with People and Transformation Team to promote and implement specialist professional development for data professionals and, more generally, to improve the capability of all colleagues in the organisation to use data;
Evolving the policy for Open Data to explore and implement efficient and secure ways to share data with stakeholders, governments and other policy-makers
Developing a strategy for the efficient, secure and sustainable sharing of data with external organisations through mechanisms such as application programming interfaces (APIs) and differential privacy.
Skills, knowledge and experience:
Use of data environments to manage pipelines such as Azure and Google Cloud, including tools such as Synapse, Databricks, Kubernetes and containers
Designing complex databases such as PostgreSQL, Cosmos, SQL Server to support SQL and NoSQL operations
Developing, coding, testing, correcting and documenting programs or scripts, using technical tools such as Python, C++, Java, Spark
Data governance tools such as Collibra, Alation, Attacama, data QA tools and data virtualisation/data socialisation.
Engineering data processes, which transform raw data into a state fit for subsequent analysis
Project and programme management, including the delivery of multiple, concurrent activities in an agile way
Working across organisational boundaries in multi-disciplinary project teams to understand requirements, taking a systems view, translating these requirements into technical specifications and delivering impactful solutions
Communicating technical concepts, both written and orally, across organisational and technical boundaries, including to senior colleagues and non-technical audiences
Strong interpersonal skills and evidence of ability to interact effectively with, and influence, a range of internal and external stakeholders.
If you are looking for a new challenge and this role is of interest, we are keen to hear from you. Get in touch today!
Please note we can only accept applications from those with current UK working rights for this role, this client cannot offer visa sponsorship.
Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.
Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data UK. For more information visit our website: www.datatech.org.uk
