Are you a lead data engineer? Have you technically led teams of engineers? Do you have experience architecting and implementing enterprise-scale data streaming platforms?
An international media company is currently going through an enterprise-scale digital transformation programme. They are seeking to recruit a Lead Data Engineer.
Responsibilities:
- Lead, mentor and assist the development of the data engineering team
- Building and evolving data platforms, services and pipelines used across the business – including building custom frameworks
- Leading the development of streaming systems and Big Data management
- Be an inspiring leader in data tooling, systems and techniques
- Be accountable for delivering data services that produce tangible business value
- Handling large-scale and complex ETL/ELT systems
- Developing platforms and services to product-ionize Data Science models and architectural patterns with Software Engineers
You:
- 3+ years of experience in technically leading data engineers
- Experience in designing, building and launching highly available, distributed systems of data extraction, transformation and loading of datasets
- Familiarity with DataOps methods and data quality improvement techniques
- Large-scale streaming data (Kafka, Kinesis, etc.)
- Proficiency with cloud services (ideally AWS)
- Proficiency with programming languages (Python, etc.)
- Proficiency with Big Data systems (Spark, Hadoop, Pig, etc.)
- Proficiency with SQL databases (Relational, Snowflake, etc.)
- Proficiency with structured or custom ETL management (Airflow, Luigi, etc.)
