Note: The job is a remote job and is open to candidates in USA. SoTalent is a professional services company seeking a Senior Data Engineer to design, develop, and optimize modern data architectures. The role focuses on building scalable data platforms and pipelines, supporting enterprise analytics, reporting, machine learning, and AI initiatives, and ensuring data quality, security, governance, and performance.
Responsibilities
- Design and implement scalable data architectures that support analytics, reporting, machine learning, and AI initiatives
- Develop and maintain robust data pipelines for data ingestion, transformation, integration, and processing across diverse data sources
- Collaborate with business and technical stakeholders to understand requirements and translate them into effective data solutions
- Build and optimize data models that support enterprise reporting, analytics, and operational use cases
- Design and implement data integration frameworks that ensure reliable and efficient data movement across systems
- Optimize data processing workflows for performance, scalability, reliability, and cost efficiency
- Support the full data lifecycle, including data acquisition, storage, transformation, governance, and consumption
- Implement data quality, security, and governance controls to ensure data integrity and compliance
- Develop solutions that support real-time and batch processing requirements using modern data technologies
- Partner with analytics, engineering, and AI teams to enable advanced insights and machine learning capabilities
- Monitor and troubleshoot data platform performance while identifying opportunities for continuous improvement
- Create and maintain technical documentation, architecture diagrams, and operational procedures
Skills
- Bachelor's degree in Data Science, Computer Science, Engineering, Information Technology, Mathematics, or a related field
- 2 to 4+ years of experience designing and developing scalable data engineering solutions
- Strong hands-on experience with Python, SQL, and modern data engineering practices
- Experience building and maintaining enterprise data pipelines and integration solutions
- Strong understanding of data modeling, database design, and data architecture principles
- Experience working with cloud-based data platforms and distributed data processing technologies
- Knowledge of structured, semi-structured, and unstructured data management
- Experience optimizing data flows, performance tuning, and troubleshooting complex data environments
- Strong analytical, problem-solving, and communication skills
- Ability to work effectively in collaborative and client-facing environments
- Experience supporting analytics, business intelligence, AI, or machine learning initiatives
- Knowledge of big data ecosystems and distributed data processing frameworks
- Familiarity with streaming architectures and real-time data processing technologies
- Experience implementing data governance, security, and compliance standards
- Exposure to consulting, professional services, or customer-focused delivery environments
- Experience with cloud-native data platforms and modern data lake or warehouse architectures
Benefits
- Remote work arrangement
Company Overview