Lead Data Engineer, Reading – My client has a vacancy for a Lead Data Engineer to join their business and work with various teams through the organisation to build and operate their next generation of strategic platforms and products through innovation with data.
You will have a deep understanding of data architecture, engineering, analysis and reporting but you will also have experience of designing and delivering data strategy. You will also be leading and mentoring a team of engineers in the companies journey as they continue to work in a serverless first cloud native architecture underpinned by strong automation capabilities, messaging patterns, and automated testing. You will have an input in to the future technical roadmap, best practices and culture.
You will be expected to have the relevant experience in order to be responsible for the following:
- Lead the development of scalable Data Engineering and automated solutions
- Introduce and support the introduction of data streaming platforms into their technical environment
- Assemble large, complex data sets to meet function / non-functional business requirements
- Design, build and implement ETL / ELT processes
- Produce and maintain technical and design documentation
- Introduce and support distributed data storage and processing platforms
- Coach and develop a team of data and RPA engineers
- Support the rollout the scaling of RPA solutions and services
- Help shape the technical roadmap
- Project planning and resource allocation
In order to succeed in this role, alongside some of the above experience, you will have the following technical skills:
- Software development experience with distributed data storage and processing technologies such as Hadoop, Spark, R and / or Python
- Leading the architecture, implementation, delivery of ETL/ELT data processing pipelines in both cloud and on-prem environments
- Experience of Azure DevOps, GitHub or SVN tools
- Event driven architectures and data streaming using technologies and platforms such as Kafka and CDC products
- Data mesh and data lakehouse architecture
- Data Modelling
- Structured and unstructured data
- Text document processing including NLP
- Robotic Process Automation and automation platforms such as UiPath
- Agile
- DevOps principles
To be considered for this Lead Data Engineer role, please send an up to date copy of your CV as soon as possible.
