An Azure Data Engineer required for this newly created greenfield opportunity to help our client migrate from their existing on-prem databases to a new Azure Cloud based platform. The Data Engineer is a key position working with diverse data sets from multiple systems and overseeing their integration and optimisation. This will require raw development and management of the data pipelines using tools in the Azure Cloud. Our client is a well-established and iconic business that’s continuing to expand. This is a hybrid role based in West London ( near Northolt, Perivale, Greenford etc) with the flexibility to work from home 2 or 3 days per week. It’s a position that will allow the post-holder to make a real impact through collaborating with multiple business areas and building data solutions that align with business needs.
The key responsibilities for the post include;
- Develop, test and maintain data architectures.
- Migrate existing on-premises databases to the Azure Cloud.
- Develop and manage data pipelines using Azure Data Factory, Delta Lake and Spark.
- Utilise Azure Cloud architecture knowledge to design and implement scalable data solutions.
- Utilise Spark, SQL, Python, R, and other data frameworks to manipulate data and gain a thorough understanding of the dataset's characteristics.
- Interact with API systems to query and retrieve data for analysis.
To be considered for the post you’ll need at least 2 years Azure Cloud experience and most if not all the following:
- Strong knowledge of Azure Cloud architecture and Azure Databricks.
- Experience with Spark, SQL, Python and other data engineering development tools.
- Experience with metadata driven pipelines and SQL serverless data warehouses.
- Experience migrating on-premises data warehouses to the Azure cloud is beneficial.
- Knowledge of querying API systems.
- Strong problem-solving skills and attention to detail.
- Understanding of data governance and data quality principles.
- A degree in computer science, engineering, or equivalent experience.
Salary will be dependent on experience and likely to be in the region of 60,000 – 70,000. Our client can also provide a vibrant, rewarding, and diverse work environment that supports career development.
Candidates must be authorised to work in the UK and not require sponsoring either now or in the future. For further information, please send your CV to Wayne Hawthorne at Vadis People Services Ltd. Vadis acts in the capacity of both an Employment Agent and Employment Business.
Latest Jobs
Latest Jobs for the perfect fit
As a consultancy business it makes commercial sense to invest in all our candidates, so we do. We don't just push vacancies at you and hope we strike lucky. Rather, we want to talk to 'you', to understand your requirements, aims, ambitions, strengths and weaknesses. Only then will we suggest carefully selected roles for your consideration. You'll find a sample of our latest jobs here Azure Data Engineer Location:London Salary:c 60,000 – 70,000 An Azure Data Engineer required for this newly created greenfield opportunity to help our client migrate from their existing on-prem databases to a new Azure Cloud based platform. … Apply AI Engineer Location:London Salary:circ 70,000 – 80,000 + Bonus A newly created AI Engineer position is available to join an expanding Data Science team for an exciting opportunity working on a new revenue management / dynamic pricing applicati… Apply Senior Data Engineer Location:London Salary:circ 80,000 – 90,000 Senior Data Engineer required to join an expanding team for this exciting growth opportunity within the entertainment sector. Our client is embarking on a journey to bring data sci… Apply Our team – expert, experienced and business-like
We're a group of well-rounded, motivated and 'mature' professionals, each time-served in our specialisms and uniquely equipped to help and advise you. We share a common belief in delivering valuable, culturally compatible people for clients and employers for candidates. Find out more about us here
If you would like to read more candidate and client views on working with Vadis then please click here…
Candidate – Property Management
"Vadis to me is a wonderful, reliable, friendly, caring, interested team of people intent on getting the right match for people and organisations together"
IT Director
Distribution Client
"Vadis take the frustration out of recruitment. They understand what I want in terms of skills and person fit. They give me a great insight into the market and, even when I ask for the impossible, they always seem to be able to find good candidates. …
Senior .Net Developer
Candidate – Property
Hi Adam/Jane/Wayne,
It is finally the time to say good bye to you after working for nearly 7 years with you guys. I have seen lots of highs working with you and learnt lots of new things during these 7 years.
I would like to say thank y…
Senior Director
Pharmaceutical Client
Head of IT
Candidate – Distribution
‘Vadis were the only recruitment consultancy I worked with who got who I was and what I was after, then led me through the whole processes step by step in a truly professional manner.’
Senior Business Analyst
Candidate – FMCG
" you've been the nicest and most professional recruitment agent I've dealt with in a long time, so I appreciate your efforts on this. "
CXO
Leasing Client
"Vadis have, over many years, proven to be a resourceful and professional recruiter for us. With a healthy appetite for going the extra mile, Vadis have always represented our business well and presented us with suited candidates. "
Data Architect
Candidate – Education & Training
Thank you for all your help – I couldn't have done it without you
#J-18808-Ljbffr