Note: The job is a remote job and is open to candidates in USA. Piper Companies is seeking a Senior Data Engineer III to support a modern, cloud-based data platform within an enterprise technology organization. The role leads the design and development of scalable data pipelines, integrations, reporting solutions, and engineering initiatives supporting AI and machine learning.
Responsibilities
- Design and maintain scalable data pipelines and ETL workflows
- Develop and optimize advanced SQL queries for performance and reliability
- Leverage Azure, Fabric, Spark, and Python to automate complex data processes
- Build and support REST and SOAP APIs for system integrations
- Monitor and troubleshoot data pipelines to ensure high availability
- Identify and resolve bottlenecks in data workflows
- Lead engineering efforts supporting AI and machine learning initiatives
- Collaborate with stakeholders and cross-functional teams
- Conduct code reviews and contribute to technical documentation
- Provide Tier 3 support for reporting and integrated systems
- Mentor team members and lead complex technical projects
Skills
- 5+ years of data engineering or related experience
- Strong expertise in SQL, Python, dbt, and or C#
- Experience with Azure Data Factory or similar orchestration tools
- Hands-on experience with Microsoft Azure and Fabric
- Experience with Databricks or Snowflake is acceptable
- Strong understanding of data modeling and ETL concepts
- Experience with Git and version control best practices
- Ability to work independently and solve complex problems
- Background working in small or mid-sized environments with leadership experience
- Must be authorized to work in the United States
Benefits
- Full benefits including medical, dental, vision, 401k, and PTO, sick leave as required by law
- This is a fully remote position.
Company Overview