AWS Data Engineer
Location: Columbia, MD (REMOTE)
Duration : Long-term Contract
SUMMARY:
As a AWS Data Engineer, you will play a supporting role in our data migration from on-prem data stores to a modern AWS cloud-based data and analytics architecture as we embark on a Digital Transformation to ensure we have the proper tools and technology to become an industry leader in the financial sector.
You will assist in creating, updating, and managing ETL and data integration processes, presentation layer endpoints, and SQL statements to create both the physical and logical structures for data manipulation within the AWS data architecture.
You will work under the guidance of senior data engineers and collaborate with internal stakeholders across the organization in identifying, designing, and implementing internal process improvements that include re-designing data infrastructure for greater scalability, optimizing data delivery, and enhancing effective and efficient data utilization by turning data into insights.
You will also help coordinate with application vendors and assist in project planning and implementation. You will assist in interfacing with internal business lines and project management staff, and learn to become the authoritative subject matter expert on data management.
ESSENTIAL JOB FUNCTIONS:
Assist in using AWS cloud technologies like Redshift, Glue, EC2, S3, etc to build a scalable cloud data platform.
Develop Data Pipelines to build our data lake in AWS, leveraging technologies like EC2, S3, Lambda, Glue, DynamoDB, Redshift, etc.
Assist in developing and designing models for complex analytical and data warehouse/mart systems including tasks related to database design, data analysis, data quality, metadata management and support.
Assist in presenting cloud data solutions to given use cases, giving guidance on options in architecting AWS data solutions and concisely presenting the pros and cons and alternatives to proposed solutions.
Learn about workforce transformation by receiving knowledge transfer, operational guidance and training to team members on AWS cloud data tools and technologies.
Assist in providing data and analytical solutions to ensure efficient manipulation, organization and sharing of information, data and/or master data in a data lake, datawarehouse, and data-mart construct using AWS technologies.
Assist in collaborating with Cloud Architect to define the appropriate cloud database solutions, such as AWS Redshift, Database Migration Services, Glue, EMR, EC2, S3, Relational Database Service (RDS)/Aurora, and Amazon Kinesis.
Assist in defining access patterns, storage methods, and integration patterns for the movement and maintenance of data into unstructured, relational, and NoSQL databases.
Assist in collaborating with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
Assist in writing and maintaining functional and technical documentation and specifications.
Assist in creating project plans, test plans, test data sets and automated testing to ensure all components of the system meet specifications.
Provide technical consulting for problem resolution, performance optimizations and data processing questions.
Assist in analyzing, defining and documenting system requirements for data, workflow, logical processes, interfaces with other systems, auditing, reporting requirements and production configuration.
Assist in overseeing database backup, clustering, mirroring, replication and failover. Evaluate and recommend new database technology, when appropriate.
