Job Title:
Data Catalog Engineer: In this role you will work closely with senior technical leadership to implement and maintain metadata management solutions build scalable pipelines and ensure seamless integration of data sources into our Informatica CDGC platform. This is a handson role where you will contribute to the foundation of our data governance and quality framework.
Key Responsibilities:
Build Pipelines: Design develop and maintain data pipelines to integrate various data sources into the metadata catalog.
Scan Data Sources: Configure and execute scanning processes for structured semistructured and unstructured data sources using Informatica CDGC and related tools.
Metadata Management: Assist in the creation and maintenance of metadata repositories ensuring consistency and completeness.
Data Dictionaries: Develop and manage comprehensive data dictionaries promoting transparency and standardized definitions across the organization.
Support Lineage Efforts: Collaborate with team members to map data flows and establish clear reliable lineage for critical data assets.
Performance Optimization: Monitor pipeline performance troubleshoot issues and implement enhancements to improve efficiency and scalability.
Collaboration: Work closely with data engineers data scientists and business stakeholders to understand their needs and align metadata solutions with organizational goals.
Documentation: Maintain thorough documentation for pipelines metadata processes and lineage workflows ensuring accessibility for team members and stakeholders. Required Skills and Experience:
Technical Expertise:
o Proficiency in building and managing ETL/ELT pipelines using tools like Informatica AWS Glue Talend Apache NiFi or similar platforms.
o Experience with Informatica CDGC or similar metadata management tools.
o Familiarity with SQL and at least one programming or scripting language (e.g. Python Java).
Data Integration Knowledge:
o Strong understanding of data source scanning techniques for databases files APIs and cloudbased storage.
o Experience in data governance concepts including metadata lineage and data quality.
ProblemSolving Skills:
Ability to troubleshoot and resolve pipeline and integration issues quickly and effectively.
Collaboration: Experience working in crossfunctional teams with excellent communication and stakeholder management skills.
Preferred Qualifications:
Familiarity with Informatica Axon EDC or similar tools.
Exposure to cloudbased data platforms (e.g. AWS Glue Azure Data Factory Google Data Catalog).
Understanding of CI/CD practices for data pipeline development. Knowledge of AIdriven recommendations in metadata management or data quality.
Required Skills : About the Role: Were looking for a Technical Lead to take charge of implementing advanced data governance metadata management and quality initiatives using Informatica CDGC. This is a handson role where you will be a technical leader shaping the foundation for scalable and intelligent data systems.
...well-being. Schedule: Part time Availability: Morning, Afternoon, Evening (Includes Weekends). Age Requirement: Must be 16 years or older Location: Burlington, MA Address: 53 Third Avenue Pay: $18 / hour Job Posting: 03/06/2025 Job Posting End:...
...their desired items. Monitor inventory in the gift shop and re-stock as necessary. Partner with other tour guides and gift shop associates to generate revenues and raving fans of the Buffalo Trace Distillery and bourbon. Successful candidate must have strong communication...
Overview: MANAGER BUSINESS CONTINUITY AND CRISIS MANAGEMENT WHAT IS THE OPPORTUNITY? The BC & Ops Resiliency Remediation Lead will help develop a plan and lead the execution of activities designed to improve the overall end to end BC and Ops Res lifecycle and ensure...
...Job Description Consolidated Medical Travel is seeking a travel Pharmacist for a travel job in Austin, Texas. Job Description & Requirements ~ Specialty: Pharmacist ~ Discipline: Allied Health Professional ~ Start Date: 12/23/2024~ Duration: 13 weeks...
...ERM Senior Auditor at Micron Technology, Inc. in Boise, Idaho, United States Job Description Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate...