Note: The job is a remote job and is open to candidates in USA. ImagineX is a technology company that deploys AI-assisted teams to build and secure mission-critical enterprise solutions across software, data, and AI. The Senior Data Engineer will lead the design, implementation, and operationalization of modern enterprise data platforms, architect scalable data solutions, establish technical best practices, and mentor engineers while remaining hands-on with code.
Responsibilities
- Lead the development and maintenance of robust, scalable data pipelines and ETL/ELT workflows using AWS Glue and Apache Spark
- Architect and build complex, transactional data lakehouses leveraging Apache Hudi for efficient ingestion and data management
- Guide design discussions, conduct rigorous code reviews, and provide data architecture leadership for development squads
- Collaborate with cross-functional team members, product managers, and client stakeholders to deliver high-quality data features and business insights from conception to deployment
- Establish data engineering standards, drive clean code initiatives, and champion best practices across the data development lifecycle
- Leverage AI-assisted tools to optimize development workflows, automate data testing, and improve overall pipeline reliability
- Troubleshoot, debug, and optimize high-scale analytical queries within Amazon Athena and distributed data systems for peak performance and security
- Oversee CI/CD pipeline integration, cloud data infrastructure deployments, and workflow automation efforts
- Mentor junior and mid-level data engineers, fostering a culture of technical excellence and continuous growth
Skills
- 7+ years of professional software or data engineering experience
- Expert proficiency in SQL and advanced relational data management techniques
- Strong hands-on experience building distributed data processing frameworks using Apache Spark
- Proven experience architecting cloud data solutions, serverless execution with AWS Glue, and interactive analytics via Amazon Athena
- Deep understanding of modern open-source table formats, specifically constructing transactional lakehouse layers with Apache Hudi
- Deep understanding of data engineering fundamentals, dimensional modeling, testing strategies (data quality validation, unit, integration), and version control (Git)
- Strong communication skills, with the ability to articulate complex technical data concepts to both technical and non-technical stakeholders
- Proven ability to lead technical teams, mentor engineers, and drive successful data project delivery
- This role is based in the US and only open to citizens and permanent residents of the US who do not require visa sponsorship
Benefits
- 100% remote
Company Overview