Note: The job is a remote job and is open to candidates in USA. iSpot is hiring a Software Development Engineer 3 for its Ad Optimization team. The role builds and operates Spark and Snowflake data pipelines and partner integrations that deliver TV and streaming measurement feeds for campaign optimization.
Responsibilities
- Build, tune, and maintain large-scale batch Spark pipelines that turn measurement data into partner-ready optimization feeds
- Build and optimize Snowflake processing, including SQL transformations, scheduled and incremental pipelines, and data modeling
- Tune pipeline performance and cost across Spark and Snowflake
- Design data models, table layouts, and partitioning across S3, lakehouse tables, and Snowflake
- Build partner data feeds, including file and API deliveries, identity matching, privacy-sensitive data handling, and delivery SLAs
- Build data-quality checks, reconciliation, telemetry, and alerting, and handle late-arriving data and backfills
- Write and review technical designs and test plans, and lead small-to-medium projects from ambiguous requirements to production
- Own releases and deployments to team standards, including staged rollouts and rollback
- Participate in the team's on-call rotation. You will respond to alerts and incidents, lead root-cause analysis, and keep runbooks current
- Mentor other engineers through code review, pairing, and design feedback
- Use AI-assisted tools for design, development, testing, and incident work, and verify what they produce
Skills
- Applicants must be currently authorized to work in the United States
- ISpot is not able to sponsor or take over sponsorship of an employment visa for this position at this time
- 5+ years of professional software or data engineering experience
- 3+ years building, optimizing, and operating production Apache Spark pipelines in Java or Scala and in Python/PySpark
- 2+ years of production Snowflake experience, including complex SQL transformations, performance and cost tuning (warehouse sizing, clustering, query profiling), and tasks and streams or dynamic tables for scheduled and incremental processing
- 2+ years running data workloads on AWS, including S3 and Spark on Kubernetes (EKS) or EMR
- Production experience with Airflow or an equivalent workflow orchestrator
- Advanced SQL and relational data modeling
- Experience building external partner or client data feeds that involve file and API deliveries, identity matching, privacy-sensitive data, and delivery SLAs
- Experience designing data-quality checks, reconciliation, telemetry, and alerting for batch pipelines, including handling late-arriving data and backfills
- Experience writing unit and integration tests for data pipelines
- Production ownership experience covering CI/CD, releases and rollback, incident response, and root-cause analysis
- Experience writing and reviewing technical designs and leading small-to-medium engineering projects through production delivery
- Experience mentoring engineers through code review, pairing, and design feedback
- Experience using AI-assisted engineering tools responsibly, with appropriate verification for security, correctness, and maintainability
- Experience with Snowflake external Iceberg tables and catalog integrations, secure data sharing, or Snowpark (Python)
- Experience with Apache Iceberg and MySQL
- Experience running Spark on Amazon EKS and Airflow on Amazon MWAA
- Experience in ad tech or advertising measurement, such as attribution, conversions, audience and impression data, identity matching, or partner optimization feeds
Benefits
- Full-time iSpotters are eligible to participate in iSpot’s equity plan to receive stock options.
- Variable commission for employees in eligible roles.
- Annual bonus targets for eligible roles.
- Hybrid schedule for employees local to or living in surrounding areas of the Bellevue, WA or New York, NY offices: in-office 1–3 days a week.
- Fully remote schedule for employees in roles that are not office-based and who are located farther away from the offices.
Company Overview