```html
About talentedge
talentedge is a global leader in entertainment‑driven digital experiences, delivering cutting‑edge web‑based features and data‑intensive solutions to millions of users worldwide. Our mission is to transform storytelling through technology, enabling partners, sponsors, and content creators to reach audiences with unprecedented precision and insight. As part of our rapid expansion, we are looking for a highly motivated Lead Data Engineer to join our Information and Investigation group, a core pillar of the talentedge Web‑Based Features (DSS) team under the broader talentedge Diversion and Innovation (DE&ET) umbrella.
Why This Role Matters
Data is the lifeblood of every modern entertainment platform. From configuring product offerings to measuring advertising effectiveness, from supporting customer discovery journeys to building new revenue streams, the insights we generate drive strategic decisions across the organization. As a Lead Data Engineer, you will be at the forefront of designing, building, and scaling the data infrastructure that powers these insights, ensuring that our partners can make data‑driven decisions quickly, accurately, and securely.
Key Responsibilities
- Architectural Leadership: Define and evolve the roadmap for our data products and data platforms, focusing on reliability, scalability, and performance.
- Data Warehouse Design: Design and implement flexible data warehousing solutions, building robust ETL pipelines that operate in large‑scale data environments (cloud, on‑premises, hybrid).
- Technology Stack Management: Leverage a modern stack that includes Hadoop, AWS, Snowflake, Flink, and Kafka, while writing production‑grade code in Python, Scala, and Java.
- Collaboration & Delivery: Partner with Product Owners, Data Modelers, and Data Architects to design, implement, and deliver high‑quality data solutions that meet strict SLAs.
- Documentation & Governance: Maintain meticulous documentation of data pipelines, schema changes, and data quality metrics to support governance and compliance initiatives.
- Performance Optimization: Continuously monitor and tune data pipelines to ensure optimal throughput, latency, and cost efficiency.
- Agile Participation: Actively contribute to Scrum ceremonies, championing continuous improvement and fostering a collaborative, high‑velocity team culture.
- Mentorship: Guide junior engineers, share best practices, and cultivate a learning environment that encourages innovation.
Essential Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field (or equivalent practical experience).
- 5+ years of hands‑on experience designing and operating large‑scale data platforms.
- Deep expertise in SQL and the ability to craft performant queries across distributed data stores.
- Proven experience with Hadoop ecosystem tools (HDFS, Hive, Impala, PySpark) and streaming platforms such as Apache Flink or Kafka.
- Strong programming skills in Python and either Java or Scala, with a track record of delivering production‑ready code.
- Hands‑on experience with at least one major MPP or cloud data warehouse technology (Snowflake, Redshift, BigQuery, etc.).
- Familiarity with data modeling, data warehousing best practices, and data pipeline orchestration tools.
- Demonstrated ability to work within Scrum/Agile frameworks and to thrive in fast‑paced, cross‑functional environments.
Preferred Qualifications & Nice‑to‑Have Skills
- Master’s degree or advanced certifications in data engineering, cloud architecture, or related disciplines.
- Experience with AWS services such as S3, EMR, EC2, and Lambda.
- Knowledge of data quality frameworks and tools (e.g., Great Expectations, Deequ).
- Exposure to CI/CD pipelines for data engineering (e.g., GitLab CI, Jenkins, Airflow).
- Background in the entertainment or media industry, understanding the unique data challenges of content delivery and audience analytics.
- Strong problem‑solving mindset, with a blend of technical depth and business acumen.
Core Skills & Competencies
- Analytical Thinking: Ability to dissect complex data problems and translate business requirements into scalable technical solutions.
- Communication: Clear articulation of technical concepts to both technical and non‑technical stakeholders.
- Collaboration: Proven teamwork skills, with a focus on building trust and delivering collective outcomes.
- Adaptability: Comfort navigating ambiguous requirements and rapidly evolving technology landscapes.
- Attention to Detail: Commitment to high data quality, documentation, and adherence to governance standards.
Career Growth & Learning Opportunities
At talentedge, your career trajectory is shaped by the impact you create. As a Lead Data Engineer, you will have direct visibility to senior leadership and the chance to influence strategic data initiatives across the organization. We invest heavily in continuous learning—offering access to industry conferences, certification programs, internal tech talks, and a generous education stipend. Whether you aspire to become a Data Architecture Director, a Cloud Solutions Architect, or a senior leader in product analytics, the pathways are open and supported.
Work Environment & Culture
Our remote‑first policy empowers you to work from anywhere while staying closely connected to the talentedge community. We foster an inclusive culture where diverse perspectives are celebrated, and every voice matters. Team rituals include weekly knowledge‑sharing sessions, virtual coffee chats, and quarterly hackathons that encourage experimentation. We value work‑life balance, offering flexible hours, generous paid time off, and mental‑health resources.
Compensation, Perks & Benefits
- Competitive hourly rate of $24/hr, with performance‑based bonuses.
- Comprehensive health, dental, and vision coverage.
- Retirement savings plan with company match.
- Generous paid time off, parental leave, and sick days.
- Remote work allowance for home office setup and internet expenses.
- Annual learning and development budget.
- Employee assistance program and wellness initiatives.
Location
This role is remote‑first, but our primary hub is located in San Francisco, USA. Candidates based in or near this region are encouraged to apply, though we welcome talent from across the globe.
Application Process
Ready to shape the future of data‑driven entertainment? Submit your application today and join a team that is redefining how audiences interact with content worldwide.
Take the Next Step
Are you prepared to lead innovative data solutions at talentedge? Click the link below to apply and start your journey with us.
``` Apply for this job