Note: The job is a remote job and is open to candidates in USA. Tech Observer is seeking a Data Engineer to develop, test, implement, and support enterprise data integration solutions using Informatica IDMC/IICS and Snowflake. The role focuses on data pipeline development, data quality and testing, environment and release management, production support, governance, metadata, security, and collaboration with data, platform, analytics, governance, and security teams.
Responsibilities
- Design, build, and maintain data pipelines using Informatica IDMC, including mappings, mapplets, transformations, and task flows
- Develop and optimize SQL‑based transformations in Snowflake across staging, integration, and curated layers
- Implement reusable frameworks for error handling, data cleansing, parameterization, and pipeline orchestration
- Perform unit, integration, and regression testing for new or modified data pipelines
- Execute post‑load reconciliation, validation rules, completeness checks, and anomaly detection
- Implement automated data quality workflows using IDMC and/or Snowflake Tasks & Streams
- Support migration of Informatica IDMC artifacts between Dev and Prod environments
- Ensure IDMC pipelines, connections, and Secure Agent configurations are ready for deployments
- Monitor pipeline executions, address load failures, and drive resolution of data quality and processing issues
- Diagnose root causes related to schema drift, source system changes, or unexpected data patterns
- Collaborate with Platform Administrators to support reliable execution of scheduled workflows in JAMS
- Develop and maintain mapping documents, data flow diagrams, and end‑to‑end lineage documentation
- Ensure all datasets meet governance requirements, including glossary alignment, classification, and usage rules
- Maintain metadata accuracy within governance tools and Snowflake information schema
- Ensure pipelines follow data handling standards, including PII protections, masking, and role‑based access expectations
- Participate in audit support, access reviews, and change control processes as required
- Work with Data Warehouse Engineers to align models, transformations, and performance expectations
- Work closely with platform engineering teams to ensure Secure Agents are running, monitored, and capable of supporting required pipeline workloads
- Collaborate with Analytics and BI teams to deliver accurate, analytics-ready datasets
- Collaborate with the Data Governance team to support data quality, consistency, and adherence to enterprise standards for cleanliness, accuracy, and reliability
- Collaborate with IT Security and Risk teams to implement approved security controls and remediation activities in accordance with enterprise security standards and risk management requirements
Skills
- 5+ years of experience designing, developing, and supporting enterprise-scale data integration solutions using Informatica Intelligent Data Management Cloud (IDMC/IICS), including mappings, mapplets, taskflows, parameterization, reusable frameworks, batch and incremental data ingestion, transformation logic, and ETL/ELT development
- 5+ years of advanced SQL development experience, including complex query optimization, performance tuning, ELT development, and transformation implementation within Snowflake environments
- Experience developing data profiling, validation rules, reconciliation processes, data quality monitoring, exception handling, and automated quality controls
- Working knowledge of metadata management, data lineage, business glossary alignment, cataloging, and governance processes
- Experience monitoring pipeline executions, troubleshooting failures, resolving data integration issues, optimizing ETL/ELT performance, and supporting enterprise production environments
- 5+ years of experience utilizing Git-based source control and Azure DevOps for collaborative development, branching strategies, pull requests, code reviews, work item management, release management, and deployment automation across data integration and data warehouse solutions
- 5+ years of experience designing, implementing, and supporting CI/CD pipelines for Informatica IDMC/IICS and Snowflake deployments, including automated testing, code promotion, environment migration, release management, and deployment automation using Azure DevOps, GitHub Actions, GitLab CI/CD, or equivalent platforms
- Experience supporting regulatory compliance initiatives
- Financial Services Experience
Benefits
- Remote work arrangement
Company Overview
Company H1B Sponsorship