We are looking for a Azure Data Engineer to work within the public sector.
Location: Hybrid working- Manchester, Birmingham, Sheffield, Newcastle or Blackpool
About the role: You will be responsible for development of modern, efficient, robust data pipelines and products, making use of cloud native and best in class technologies as appropriate.
Essential Skills: The ideal candidates will hold Active SC clearance and have a proven Azure Data Engineering background, with the following skills/ experience:
- Experience of designing, building and deploying efficient, scalable, automated ETL/ ELT pipelines with Microsoft Azure tooling (Azure Data Factory, Azure Data Lake, Azure Databricks)
- Experience with SQL/ Python
- Experience of monitoring and alerting on pipeline success/failure with the ability to embed appropriate quality checks within ETL/ELT processes.
- Experience of database technologies and data modelling techniques eg RDBMS/ NoSql/ Kimball, and Datalake storage.
- Experience of distributed version control tools, and awareness of modern code deployment methods (CI/CD).
