Data Engineer, Creator Technology

Description
Description

Do you want to be at the forefront of engineering big data solutions leveraging latest AWS technologies to solve complex data problems of one of the largest affiliate marketing programs in the world? Amazon Affiliate Marketing (Amazon Associates) Science team is seeking a Data Engineer to build its ML data infrastructure and analytics platform that will help address creator needs and make creators more successful on Amazon.
In this role, you will work with science, product and engineering teams to help define our data acquisition and intelligence strategy for creator-related data. Your work will inform strategies in critical areas like creator compensation and monetization, creator satisfaction, marketing segmentation, and content quality.

Key job responsibilities

• Design, develop, and support scalable extract, transform, and load (ETL/ELT) processes using AWS technologies, with focus on high availability and quality, in partnership with upstream teams as required
• Manage existing AWS infrastructure, and continually explore and learn latest AWS technologies to provide new capabilities and increase efficiency
• Collaborate with Data Scientists, Product Managers, and Business Intelligence Engineers to implement advanced algorithms that exploit our rich data sets for statistical analysis, prediction, clustering and machine learning
• Help continually improve ongoing reporting and analysis processes, simplifying self-service support for customers

A day in the life
A successful candidate is a self-starter, comfortable with a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. You have strong analytical skills and excel in the design, development and management of large data sets spanning a variety of sources, using scalable batch/real-time ETL/ELT processes, in order to deliver data as a service supporting growing and dynamic business data needs. You excel in a culture of invention and collaboration.

About the team
Amazon Associates program is a global leader in online marketing and one of the largest paid advertising channels for Amazon. Our program spans a large number of websites, blogs and influencers worldwide, all of whom create original content to help customers make informed purchasing decisions on Amazon. Our team develops tools for associates to create compelling content on their sites, provides insights on their site’s performance, establishes program policies and prices, provides recommendations to associates to enhance their audience engagement, and runs all the back-end services required to make the program run smoothly: onboarding, payments, and fraud detection and prevention. Several characteristics make Amazon Associates an exciting and rewarding place to grow your career:

• We own our space end-to-end, and have a wealth of opportunities for innovation while leveraging the technology and scientific wealth of Amazon. This gives us the opportunity to think big, try new things, and pave the way for the industry as a whole.
• We serve a diverse population of content creators- from a small blogger with 50 readers, through TikTok influencers with over 5,000 followers, and all the way to some of the largest publishers in the world. Each of these present specific business challenges and opportunities, and we partner with them to reach millions of customers worldwide. We cover everything from B2B to B2C.
• We (literally) have to keep up with the Kardashians: As we strive to meet our customers wherever they spend their digital time, we’re at the forefront of what’s ‘new’ and ‘cool’ on the internet, and that makes our challenges complex and exciting.
• We have the ability to help facilitate customer shopping decisions for millions of products and services, and we always keep this mission at the forefront.

Basic Qualifications

• Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline
• 3+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets
• Knowledge of various data warehousing methodologies, data lake architecture and data modelling concepts. Hands on modelling experience is highly desired
• Hands-on experience designing, building and maintaining large scale data warehousing solutions on RDBMS- Oracle, Redshift, PostgreSQL, etc. Knowledge of distributed systems as it pertains to data storage and computing is desired
• 2+ years of programming experience with at least one modern programming language (Python, Scala, Java, etc.)
• 3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets and demonstrated strength in performance tuning skills
• Ability to work on a diverse team or with a diverse range of coworkers located across the globe

Preferred Qualifications

• 3+ years of experience as a Data Engineer, BI Engineer, or Systems Analyst in a company with large, complex data sources
• Proficiency in building large-scale data warehouses and analytics products using AWS technologies Redshift, RDS, DynamoDB, S3, Glue, Lambda, EMR, SNS, SQS, Kinesis, etc
• Experience using business intelligence reporting tools such as – AWS QuickSight, Power BI, Tableau, etc.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
• Experience providing mentoring to other Data Engineers for best practices on data engineering

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Basic Qualifications

• Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline
• 3+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets
• Knowledge of various data warehousing methodologies, data lake architecture and data modelling concepts. Hands on modelling experience is highly desired
• Hands-on experience designing, building and maintaining large scale data warehousing solutions on RDBMS- Oracle, Redshift, PostgreSQL, etc. Knowledge of distributed systems as it pertains to data storage and computing is desired
• 2+ years of programming experience with at least one modern programming language (Python, Scala, Java, etc.)
• 3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets and demonstrated strength in performance tuning skills
• Ability to work on a diverse team or with a diverse range of coworkers located across the globe

Preferred Qualifications

• 3+ years of experience as a Data Engineer, BI Engineer, or Systems Analyst in a company with large, complex data sources
• Proficiency in building large-scale data warehouses and analytics products using AWS technologies Redshift, RDS, DynamoDB, S3, Glue, Lambda, EMR, SNS, SQS, Kinesis, etc
• Experience using business intelligence reporting tools such as – AWS QuickSight, Power BI, Tableau, etc.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
• Experience providing mentoring to other Data Engineers for best practices on data engineering

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.