Note: The job is a remote job and is open to candidates in USA. No Limit Staffing, Inc. is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and data platforms. The role focuses on ETL/ELT development, data ingestion and transformation, cloud data services, data warehousing, real-time processing, data quality, and collaboration with technical and business stakeholders.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines
- Build data ingestion and transformation processes using Python and SQL
- Develop and optimize data warehouses, data lakes, and data models
- Work with AWS/Azure/GCP cloud data services
- Implement batch and real-time data processing solutions
- Optimize data pipelines for performance, reliability, and scalability
- Integrate data from APIs, databases, applications, and external sources
- Implement data quality, validation, monitoring, and governance processes
- Collaborate with Data Scientists, Analysts, Software Engineers, and business stakeholders
- Troubleshoot data pipeline and production issues
Skills
- 5+ years of professional Data Engineering experience
- Strong Python and SQL skills
- Experience with ETL/ELT development
- Experience with AWS, Azure, or GCP
- Strong experience with data warehouses such as Snowflake, Redshift, BigQuery, or Databricks
- Experience with Apache Spark/PySpark
- Experience with relational and NoSQL databases
- Strong understanding of data modeling and database design
- Experience with Git and CI/CD
- Databricks and Delta Lake
- Apache Kafka or other streaming technologies
- Airflow or similar workflow orchestration tools
- Terraform or Infrastructure as Code
- Docker/Kubernetes
- Experience with data governance and security
- Experience supporting enterprise-scale data platforms
Company Overview
Company H1B Sponsorship