- Job Title: Data Engineer
- Salary: up to 60,000
- Location: Bath (hybrid)
Data Engineer Exciting Growth Opportunity
We are searching for an experienced Data Engineer to architect, implement, and maintain sophisticated data solutions. This position requires building end-to-end database systems, orchestrating data pipelines, and ensuring high-performance data operations.
Primary Duties
- Design and construct SQL-driven databases from inception to deployment.
- Develop, administer, and optimize imaging-related data assets.
- Configure and manage data workflows and pipelines to enhance efficiency.
- Oversee and tune data environments, including warehouses and other repositories.
- Establish robust data transformation strategies to meet organizational needs.
- Collaborate with software developers and key stakeholders to define data requirements and solutions.
- Safeguard data accuracy, security, and consistency across all systems.
- Produce and maintain clear documentation for data engineering processes.
- Continuously monitor and troubleshoot data flows to ensure reliability and top performance.
- Employ CI/CD pipelines to automate testing, deployment, and iteration of data solutions.
Essential Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a similar field.
- Minimum of three years’ relevant professional experience in data engineering.
- Proven expertise in SQL and Python.
- Hands-on familiarity with cloud-based infrastructures and technology stacks.
- Strong knowledge of large-scale, continuous enterprise architecture.
- Skillful in software development within a Linux environment.
- Practical know-how in containerization (e.g., Docker).
- Proficiency in data transformation tools such as DBT.
- Experience working with orchestration platforms like Prefect.
- Comprehensive understanding of ETL/ELT methods and data warehousing principles.
- Background using CI/CD systems and version control (e.g., Git).
- Excellent analytical skills coupled with strong attention to detail.
- Experience modeling machine-centric data.
- Awareness of best practices in data governance and security.
Preferred Attributes
- Familiarity with Agile development principles.
- Professional exposure to regulated industries.
- Previous work with GUI libraries.
- Experience using Jira for task management and GitHub for source control.
