Note: The job is a remote job and is open to candidates in USA. Bayside Solutions is seeking a Data Infrastructure Engineer to build and maintain large-scale data infrastructure. The role focuses on batch orchestration, data platform migration, Scala development, distributed systems, API development, and ensuring infrastructure reliability, integrity, governance, and security.
Responsibilities
- Develop and maintain a batch orchestration platform that runs 100,000+ jobs per day
- Develop migration tooling to facilitate the transfer of job configurations to a new data platform
- Write efficient, high-performance code in Scala
- Design and implement distributed data systems for high availability, reliability, and performance
- Collaborate with stakeholders and other software engineers to build robust platform features
- Ensure data integrity, governance, and security within the infrastructure
Skills
- • Strong programming skills in Scala
- • Deep understanding of data structures, algorithms, and distributed computing principles
- • Experienced in API development
- • General SQL knowledge
- • Experience deploying production applications to Kubernetes
- • Experience with relational databases (such as PostgreSQL)
- Bayside Solutions, Inc. is not able to sponsor any candidates at this time. Additionally, candidates for this position must qualify as a W2 candidate
- • In-depth experience with Kubernetes
- • Proficiency in Scala
- • Strong problem-solving skills with the ability to debug and optimize large-scale distributed systems
- • Experience with cloud-based data solutions (AWS). Familiarity with Yarn and Spark jobs
Benefits
- W2 Contract
- Remote Role - PST
Company Overview