Note: The job is a remote job and is open to candidates in USA. SoTalent is seeking a Data Engineer II to join its Data Engineering team and build the data infrastructure supporting business intelligence, revenue reporting, operational insights, and analytics-driven decision-making. The role focuses on developing scalable pipelines and data models, improving orchestration and cloud data platforms, supporting reliable business and analytics data solutions, and ensuring data quality, observability, performance, and governance from design through deployment.
Responsibilities
- Build, maintain, and optimize data models using modern transformation frameworks
- Develop scalable data pipelines and transformation workflows that support business and analytics needs
- Enhance orchestration and transformation infrastructure as data platform requirements evolve
- Modernize legacy data workflows and reduce technical debt through improved engineering practices
- Implement testing, validation, and documentation standards for data assets
- Participate in operational support activities, troubleshooting data pipeline failures and system issues
- Develop monitoring, alerting, logging, and dashboarding capabilities to improve platform visibility
- Establish proactive detection mechanisms to identify and resolve data quality and performance issues
- Continuously improve platform reliability, scalability, and operational excellence
- Design and maintain pipelines supporting financial reporting, operational metrics, and business analytics
- Enable new data products and reporting capabilities as business needs evolve
- Ensure critical business data remains accurate, timely, and auditable
- Improve query performance and optimize cloud data warehouse costs
- Contribute to ingestion frameworks, analytics infrastructure, and platform enhancements
- Maintain high standards for testing, documentation, monitoring, and operational readiness before deployment
- Promote best practices for data governance, quality, and engineering excellence
Skills
- 3+ years of hands-on experience in Data Engineering within a production environment
- Strong SQL skills, including window functions, CTEs, query optimization, and performance tuning
- Proficiency in Python for data processing, transformation, testing, and pipeline development
- Experience with modern data transformation tools such as SQLMesh, dbt, or similar platforms
- Hands-on experience with cloud data warehouses and an understanding of partitioning, clustering, and cost optimization strategies
- Experience working with workflow orchestration platforms such as Dagster, Airflow, Prefect, or equivalent solutions
- Knowledge of data observability, monitoring, alerting, and data quality frameworks
- Ability to independently own and deliver small-to-medium engineering initiatives from design through production deployment
- Strong problem-solving, analytical, and communication skills
- Experience working in collaborative, Agile development environments
Benefits
- Remote work arrangement
Company Overview