Python Software Engineer (Data Lake)
London, Ropemaker Place
The aim of this project is to: create a data lake – an environment which contains all the data that the company acquires, expose the ability to easily connect various data sets in it and finally do complex data analysis. By creating easy access to the huge data lake, it will allow us to commercialize the data. This is a greenfield build of a data platform with cutting edge tech. The Platform team is responsible for an SDK and a backend REST service. Most of our code is written in Python, and we are branching out to some Java tools such as Presto and Spark.
As a Software Engineer, You Will
‘ Develop key backend components in a system for managing big data in the company.
‘ Work as part of a remote team using Agile practices and methods (Scrum). We have team members in the UK, US, Poland and India.
‘ Challenge any requirements in our planning meetings that do not make sense from a business or a technical point-of-view.
‘ Deliver complex solutions to the ambiguous requirements of our many users.
‘ Support internal and external customers to understand their problems/requirements and adjust our design.
‘ Be able to discuss your ideas for solving problems with other developers and business users.
‘ Be proactive about identifying any problems you see.
As a Software Engineer, you will be expected to have:
‘ Curiosity about why something is working even though it should not!
‘ Strong unit testing and troubleshooting skills
‘ Eagerness to learn new things and passion for software development. If a customer comes to us wanting to know how to use a new Big Data tool with our datalake, the team will get hands-on experience with the tool.
‘ High analytical and problem-solving skills
‘ Full project life-cycle experience
‘ Working level knowledge of Docker
‘ Good knowledge about common design patterns
You will also need established experience in and/or knowledge of:
‘ Python. We would also be interested in people with strong experience in Java/C#/Scala who are willing to learn Python.
‘ Git
‘ Jira
‘ AWS services e.g. S3
‘ Kubernetes
‘ Pandas, Jupyter notebook, Spark, Dask.
———————————————–
Equal Opportunity Employer:
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: [email protected] and your request will be forwarded to the appropriate person.
US Candidates Only:
The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.
