Note: The job is a remote job and is open to candidates in USA. ZipRecruiter is an online employment marketplace powered by AI-driven smart matching technology that connects businesses and job seekers. The Senior Software Engineer, Big Data will build scalable data processing pipelines, machine learning infrastructure, cloud-based systems, and distributed applications that support the company’s intelligence and marketplace.
Responsibilities
- Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
- Deploy a range of cloud-based technologies for critical projects
- Write, test, instrument, and deploy code to our Kubernetes environment
- Help drive the innovation and evolution of ZipRecruiter
Skills
- 5+ years of professional software development experience with a focus on Python and big data technologies
- Experience with Spark, Kafka, Hadoop, Hive, and/or other big data technologies
- Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
- Experience with containerization technologies like Docker and/or Kubernetes
- 8+ years of professional software development experience, with a focus on Python and big data technologies
- BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
- Experience with data integration tools like Apache Kafka, Flume, and NiFi
- Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
- Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks
Benefits
- We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)
- Flexible Vacation & Paid Time Off
- Employer-matched 401(k) plan
- Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package
- A full range of medical, financial, and other benefits
Company Overview
Company H1B Sponsorship