The Metadata Data Engineer is responsible for developing, implementing, maintaining and monitoring data integration pipelines from metadata management databases to scan and collect all enterprise metadata required for the effective data governance, data quality and master data management of these data assets. The engineer consults business stakeholders and technology leaders to effectively gather requirements for metadata management technical solutions.
Essential Roles and Responsibilities
% of Time Spent
Develop and maintain data integration for data governance database with enterprise databases housing required metadata for data schemas and lineage.
Partner with database administrators to validate data repositories needed for processes critical to data governance and master data management.
Collaborate with data engineers to integrate Snowflake metadata and data lineage into Collibra data governance database. Partner with BI to integrate BI presentation tool lineage to Collibra.
Work with data modeling and data architecture to integrate ER Studio model metadata into Collibra.
Develop and maintain data quality dashboard for key data certification metrics.
Partner with business stakeholders to identify metrics, KPIs, and OKRs critical to performance measurement. Stratify and certify this strategic data in Collibra for presentation on enterprise data quality dashboard.
Partner with BI professionals to ensure strategic client reports are sourced from data sources measured and certified for data quality.
Maintain operating model in data governance tool.
Partner with data governance council and data stewards to develop operating model in Collibra that reflects operating model from a business (non-technical) perspective. Engage data stewards to provide oversight to the data assets critical to their business domain.
Develop and maintain quality controls and measurement for data governance database.
Partner with Data and Analytics leaders to ensure internal controls are in place from data ingest to Collibra presentation of data assets (source to target).
Additional duties as assigned.
Skills and Qualifications
Minimum Bachelor's degree in Computer Science, Engineering, Business Information Systems, Statistics, Healthcare Informatics, Mathematics or related field.
5+ years of experience in data management, database design, data modeling and metadata management. Experience working with medical data preferred.
At least one prior experience developing data integration for a new data governance solution within an organization, preferably with Collibra and/or in healthcare.
Experience with data security, privacy and confidentiality requirements (GDPR, CCPA, CHS, HIPAA).
Proficient with SQL scripting and Python.
Hands on experience building data ecosystems using ETL tools, data warehouses, dimensional star schemas and OLAP technologies (AWS, Azure, SSIS, DBT, Snowflake, Tableau, Marklogic, ThoughtSpot, PowerBI and others).
Experience developing data catalogs and business terms within a data governance program.
Proficiency in data modeling, particularly from conceptual to logical to physical models as metadata transverses and data assets are formed and defined.
Hands on experience working with schema-on-read (NoSQL) sources such as DynamoDB, Kafka, with JSON and Parquet formats.
Competency working with metadata patterns for naming, formatting, securing and defining data assets across the enterprise.
Hands on experience developing a performance management dashboard with KPIs or OKRs.
Ability to work with vendor engineers to implement, troubleshoot, maintain and monitor vendor products requiring internal and external technical support.
Ability to adapt to agile product development methodologies within a dynamic and diverse team of technology professionals delivering business value through innovation, creativity, critical communications and total stack competencies.
The ability to present and influence stakeholders with effective visualizations and communication skills to solve business problems and implement effective solutions.
Protect and take care of our company and member's data every day by committing to work within our company ethics and policies.