Note: The job is a remote job and is open to candidates in USA. Optomi is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines and integrations across enterprise systems. The role focuses on automating data movement, integrating third-party applications, and ensuring reliable data processing across cloud-based data warehouses.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines to integrate data from multiple internal and external systems
- Develop and support custom REST API integrations to extract, transform, and load data from third-party applications
- Configure, schedule, monitor, and troubleshoot production data workflows using BMC Control-M or Redwood RunMyJobs
- Develop and optimize data warehouse ingestion, transformation, and loading processes
- Build reusable Python and SQL-based solutions for data integration, automation, and data processing
- Manage workflow dependencies, job failures, retries, and production scheduling to ensure reliable data delivery
- Implement data validation, monitoring, and troubleshooting processes to maintain data quality and pipeline performance
- Collaborate with technical and business stakeholders to understand integration requirements and deliver scalable solutions
Skills
- 5+ years of hands-on experience in Data Engineering, ETL Development, or Data Integration
- Professional experience with BMC Control-M or Redwood, including production job scheduling, monitoring, and troubleshooting
- Strong proficiency in Python and SQL for data pipeline development and automation
- Proven experience designing, developing, and maintaining production ETL/ELT pipelines
- Hands-on experience building REST API integrations to ingest data from third-party applications
- Experience with enterprise data warehousing technologies such as Snowflake, Databricks, Amazon Redshift, or Google BigQuery
- Experience with ETL/integration technologies such as Informatica, AWS Glue, Azure Data Factory, or similar platforms
- Experience integrating CRM, marketing automation, or customer data platforms such as Salesforce, Adobe Experience Platform (AEP), Marketo, or HubSpot
- Experience with cloud environments including AWS, Azure, or GCP
- Familiarity with enterprise data migrations, legacy ETL modernization, and workflow optimization
Company Overview
Company H1B Sponsorship