Note: The job is a remote job and is open to candidates in USA. Cast & Crew is an entertainment technology and services provider supporting the global entertainment industry with software, payroll products, data, reporting, and creative tools. The Senior Data Engineer will design, build, and operate scalable cloud-native data platforms and pipelines that support mission-critical applications, analytics, reporting, AI solutions, and real-time event processing.
Responsibilities
- Enterprise-scale data ingestion and transformation pipelines
- Cloud-native data platforms supporting analytics and operational workloads
- Real-time event-driven data processing solutions
- Data models supporting reporting, AI, and customer-facing applications
- Secure, scalable integrations between enterprise systems
- Automated monitoring, testing, and deployment pipelines for data infrastructure
Skills
- Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related field
- 5+ years of experience building production data platforms and pipelines
- Strong Python development experience
- Strong SQL development and query optimization skills
- Experience designing and maintaining ETL/ELT pipelines
- Experience working with relational databases (PostgreSQL, MySQL, Aurora)
- Experience working with NoSQL databases (DynamoDB, MongoDB, document databases)
- Experience building data lakes and cloud-native data architectures
- Experience with Snowflake, BigQuery, Redshift, or similar cloud data warehouses
- Experience with AWS cloud services including S3, Lambda, EventBridge, DynamoDB, ECS/EKS, and IAM
- Experience building event-driven and streaming data solutions
- Experience working with Kafka, SNS/SQS, Kinesis, or similar messaging technologies
- Experience with data orchestration tools such as Airflow, Prefect, or Dagster
- Experience with Git and modern CI/CD pipelines (Azure DevOps, GitHub Actions, or similar)
- Experience building highly available, scalable production systems
- Strong understanding of data modeling, partitioning, indexing, and performance optimization
- Experience monitoring and operating production data platforms
- Sedentary – Involves sitting most of the time but may involve walking or standing for brief periods of time. Some positions may entail exerting up to 15 lbs. of force occasionally and/or a negligible amount of force to lift, carry, push, or pull
- Experience with Apache Spark or distributed processing frameworks
- Experience with Debezium, CDC, or change data capture architectures
- Experience with Iceberg, Delta Lake, or modern lakehouse technologies
- Experience with OpenSearch or Elasticsearch
- Experience supporting AI and machine learning data platforms
- Experience building feature stores or vector databases
- Experience with document processing (OCR, Textract, PDF extraction)
- Experience in media, payroll, financial systems, or enterprise SaaS platforms
- Experience using AI-assisted development tools such as Claude Code or GitHub Copilot
Benefits
- Medical
- Dental
- Vision
- PTO
- Health and wellness programs
- Employee discounts
Company Overview
Company H1B Sponsorship