Note: The job is a remote job and is open to candidates in USA. SoTalent is seeking an experienced Data Engineer to join a technology team focused on modern data platforms. The role designs, develops, and optimizes scalable data pipelines, data lakes, warehouses, and cloud-based infrastructure supporting analytics, artificial intelligence, and business intelligence initiatives.
Responsibilities
- Design, develop, and maintain scalable, high-performance data pipelines and architectures to support analytics and reporting needs
- Build and optimize ETL/ELT processes for ingesting, transforming, and integrating data from multiple sources
- Develop and manage data lake and data warehouse solutions to ensure reliable and efficient data access
- Implement data processing workflows using modern big data technologies and distributed computing frameworks
- Collaborate with business, analytics, and engineering teams to understand requirements and deliver robust data solutions
- Create and optimize data models that support reporting, analytics, and machine learning use cases
- Write complex SQL queries and develop scalable data transformation logic to ensure data accuracy and performance
- Manage cloud-based data environments, processing clusters, and automated workflow executions
- Support the development and deployment of machine learning and AI-driven solutions through reliable data infrastructure
- Ensure compliance with data governance, security, and quality standards across all data assets
- Troubleshoot production issues, enhance existing systems, and drive continuous improvements in data platform performance
- Participate in code reviews, technical discussions, and knowledge-sharing initiatives while supporting and mentoring team members
Skills
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field
- Strong experience in data engineering, cloud-based data platforms, and large-scale data processing environments
- Proficiency in programming languages such as Python, Scala, or similar technologies
- Hands-on experience with Apache Spark, distributed data processing, and big data frameworks
- Strong knowledge of SQL, data modeling, and database design principles
- Experience designing and implementing scalable ETL/ELT pipelines
- Familiarity with data lakes, cloud data warehouses, and modern data architecture concepts
- Understanding of data governance, data quality frameworks, and security best practices
- Experience with version control systems, CI/CD pipelines, and software development best practices
- Proven ability to work effectively in agile and cross-functional environments
- Strong analytical, problem-solving, and communication skills
- Experience working with cloud platforms and modern data engineering ecosystems
- Knowledge of workflow orchestration, automation tools, and DevOps practices
- Exposure to machine learning, artificial intelligence, or advanced analytics initiatives
- Experience building reusable, modular, and maintainable data engineering components
- Familiarity with data validation frameworks and monitoring solutions
- Experience optimizing large-scale data processing and streaming workloads
Benefits
- Opportunity to work on innovative data and analytics initiatives with modern technologies.
- Exposure to large-scale cloud and big data environments.
- Collaborative culture that encourages learning, innovation, and technical growth.
- Comprehensive benefits package.
- Flexible work arrangements that support work-life balance.
Company Overview