Job Title: Data Engineer
Salary: 700 Umbrella (6 Months)
We are looking for a forward thinking Data Engineer to build a robust Vault 2.0 architecture on Snowflake, to better serve and deliver valuable data products to our customers (internal and end-client).
Key Responsibilities:
1. Data Vault 2.0 Implementation:
o Design and implement Data Vault 2.0 architecture on the Snowflake data platform.
o Develop and maintain hubs, links, and satellites in the Data Vault 2.0 model.
2. Data Integration:
o Build robust and scalable data pipelines to ingest and process data from various sources (e.g., databases, APIs, streaming platforms).
o Implement ETL/ELT processes to ensure efficient data loading, transformation, and storage.
3. Data Marts:
o Design and build data marts to support business intelligence and analytical requirements.
o Collaborate with business stakeholders to understand data needs and deliver tailored data products.
4. Performance Optimization:
o Optimize data models, queries, and storage solutions for performance and cost efficiency.
o Monitor and troubleshoot performance issues in data pipelines and data warehouses.
5. Collaboration & Communication:
o Work closely with analysts, and business stakeholders to gather requirements and deliver data solutions.
6. Documentation & Standards:
o Create and maintain comprehensive documentation- we use confluence o Adhere to industry best practices and company standards for data engineering and governance.
Required Skills and Qualifications
‘ Technical Expertise:
o Proven experience with Data Vault 2.0 methodology.
o Hands-on experience with Snowflake data platform.
o Proficiency in SQL and ETL/ELT processes.
o Experience with data streaming technologies (e.g., Kafka, Kinesis).
‘ Programming & Tools:
o Strong programming skills in Python, Java, or similar languages.
o DBT hands on experience would be preferred.
‘ Analytical Skills:
o Strong analytical and problem-solving skills.
o Ability to design scalable and efficient data models.
‘ Communication:
o Independent minded/self starter- We are a small team, with a lot to work out still.
o Excellent written and verbal communication skills.
o Ability to work effectively in a collaborative team environment.
Would suit a data engineer with good exposure to architecture. Vault exposure within FS would be good.
A pragmatic self starter, who is comfortable working in a small team.
