Data Engineer – UK Remote – 60,000 – 70,000
Were looking for an experienced Data Engineer to join our data analytics team and take on responsibility for our data pipelines and ELT processes, becoming the go to person in the team for data infrastructure and modelling questions.
You will be responsible for ensuring that analytical datasets are accurate and accessible to the wider business and take on responsibility for the availability and scalability of data platforms. To support you with this, youll by proposing the data products and processes that we introduce next into our data infrastructure.
Day to day youll be building pipelines and data models in the data warehouse to serve up in BI platforms for our business users, and working with devops to ensure the availability and scalability of our data infrastructure in AWS including our data warehouse and our ETL platforms airflow & dbt.
You will be our solo Data Engineer, so you will need the confidence to own the infrastructure that we have and take it forward.It'll be a fast-paced and energetic environment, where youll manage multiple stakeholders and have an opportunity to make this area your own.
?Proactively maintain and enhance the data warehouse ( AWS Redshift), data pipelines (Apache Airflow), data models (airflow/dbt) and data warehouse ( AWS Redshift).
?Ensuring availability and scalability of data platforms.
?Improving on data quality, monitoring and testing processes.
?Modelling complex data for analytics by business users.
?Integrating with third party data sources for analytics.
?Forming SQL & Python best practices, maintaining coding standards across the team, and mentoring the team in these processes.
?Writing clean and well documented code.
?Ownership of data infrastructure and support the data manager with the roadmap here.
?You have a delivery mindset and ability to work in a fast paced, high growth organisation.
?Support with adoption of event analytics across the business.
?5+ years of experience in a data role
?Ability to own / lead data project implementation.
?Fluent in Python (requests, datetime, pandas) & SQL (CTEs, partitioning, schema designs) for retrieving and transforming data.
?Previous experience optimising, improving and scaling data warehouses.
?Knowledge of structured and unstructured data
?Previous experience using AWS or another cloud based platform for analytics infrastructure.
?Previous experience with Apache Airflow or dbt or a similar tool.
?Knowledge of development lifecycles (data engineering, data pipelines, CI/CD, DataOps).
?Previous experience using git/Bitbucket/Github for version control & JIRA for project management.
?Some knowledge of BI Platforms such as PowerBI or similar.
?Strong attention to detail.
?Strong communication skills – ability to educate business users and analysts on data models.