Note: The job is a remote job and is open to candidates in USA. HCLTech is seeking an experienced AWS Data Engineer to design, build, and optimize modern cloud-based data platforms and real-time data pipelines. The role involves developing scalable data solutions that support critical business and analytics initiatives.
Responsibilities
- Design, develop, and maintain scalable data pipelines in AWS using AWS Glue, Python, and PySpark
- Build robust data ingestion frameworks to collect and process data from multiple on-premises and cloud-based sources
- Implement Change Data Capture (CDC) solutions for near real-time data synchronization and replication
- Utilize AWS Database Migration Service (AWS DMS) to migrate and replicate data across enterprise systems with minimal downtime
- Design and implement event-driven architectures using Kafka, Amazon SNS, Amazon SQS, and EventBridge
- Develop cloud-native data processing solutions supporting high availability, scalability, and performance
- Build, optimize, and maintain enterprise Data Lake solutions
- Monitor and troubleshoot data workflows using AWS CloudWatch and AWS CloudTrail
- Develop efficient Python-based data processing applications leveraging libraries such as Pandas and NumPy
- Work with relational and NoSQL databases including SQL Server, DynamoDB, MongoDB, and Cassandra
- Support migration and modernization of legacy data pipelines into AWS-based architectures
- Collaborate with business stakeholders, application owners, and data teams to understand data architecture, business requirements, and analytics needs
- Document data models, ETL processes, data flows, and target-state architectures
- Drive continuous improvements in data quality, platform performance, security, and operational efficiency
Skills
- 7+ years of experience in Data Engineering and Data Integration
- Hands-on experience with AWS-based data platforms and cloud-native applications
- Strong expertise in Python and PySpark development
- Experience implementing CDC and real-time data streaming solutions
- Strong understanding of data modeling, SQL optimization, and enterprise data architecture
- Excellent communication and stakeholder management skills
- AWS Glue
- AWS DMS (Database Migration Service)
- CDC (Change Data Capture)
- Python / PySpark
- Kafka or SNS/SQS
- Data Lake Architecture
- SQL & Database Design
- Data Integration & ETL Development
- AWS IAM
- Amazon EKS
- EventBridge
- MongoDB, Cassandra, DynamoDB
- Data Migration & Modernization Projects
- Real-Time Streaming Architectures
- CI/CD for Data Platforms
Benefits
- Eligible for performance-based bonuses subject to company policies
- Medical insurance; dental insurance; vision insurance; pharmacy insurance; life insurance; accidental death & dismemberment insurance; disability insurance (subject to company policies)
- Employee assistance program
- 401(k) retirement plan
- 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year)
- 10 paid holidays per year
- Flexible remote work environment with exposure to cutting-edge AWS technologies
- Learning and career development programs at every level
- Transparent communication with senior-level employees
- Opportunities to experiment in different roles or even pivot industries
Company Overview