Note: The job is a remote job and is open to candidates in USA. Smart Info Solutions LLC is seeking a highly skilled AWS Data Engineer to help build, scale, and optimize enterprise-grade data platforms for the Federal Reserve Bank. The role involves designing and implementing scalable data pipelines, modern cloud infrastructure, and ensuring compliance with federal security standards.
Responsibilities
- Design, build, and maintain robust ETL/ELT pipelines for efficient data ingestion and processing into AWS data lake and platform environments
- Write, architect, and deploy reusable Terraform modules from scratch to provision and manage cloud infrastructure (not just update or maintain existing code)
- Implement and optimize high-performance database architectures using DynamoDB and/or PostgreSQL
- Write complex, optimized Python scripts and advanced SQL queries to handle large-scale, high-throughput data processing
- Ensure all cloud components adhere to strict federal security standards and architectural best practices
Skills
- US Citizen (USC) or Green Card (GC) Holder Required
- Enhanced Federal Background Check Required
- Extensive experience with core AWS data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, Lambda, Kinesis)
- Must be able to build Terraform infrastructure and modules from scratch
- Advanced proficiency in Python and Advanced SQL for data manipulation, pipeline orchestration, and optimization
- Strong hands-on experience with high-performance databases, specifically DynamoDB and/or PostgreSQL
- Deep understanding of enterprise data platform architectures, data lake concepts, partitioning strategies, and storage formats (e.g., Parquet, ORC, Avro)
Company Overview