```html
About talentflow – Pioneering Innovation in Digital Entertainment
talentflow is a global leader in creating immersive digital experiences that delight millions of users every day. With a legacy of groundbreaking storytelling and cutting‑edge technology, talentflow continuously pushes the boundaries of what’s possible in the entertainment and media landscape. Our Information and Investigation group, part of the talentflow Web‑Based Features division, drives the data‑centric strategies that power next‑generation products, advertising solutions, and new revenue streams. As we expand our footprint across cloud platforms, big‑data ecosystems, and advanced analytics, we are looking for visionary talent to join our high‑impact team.
Position Overview
We are seeking a Lead Data Engineer to spearhead the design, development, and operational excellence of large‑scale data solutions. This role sits at the intersection of data engineering, data science, and product innovation, delivering robust data pipelines, warehouses, and analytics platforms that enable our business partners to make data‑driven decisions with confidence. The ideal candidate will bring a strong technical foundation, a passion for solving complex data challenges, and the ability to lead cross‑functional teams in an agile environment.
Key Responsibilities
- Architect and implement scalable data products and data lake solutions that support the Commitment and Maintenance Analytics and Data Science initiatives.
- Design, build, and optimize end‑to‑end ETL pipelines in massive data environments, leveraging both cloud (AWS) and on‑premise technologies.
- Collaborate closely with Data Product Managers, Data Modelers, and Data Architects to translate business requirements into high‑performance data architectures.
- Maintain comprehensive documentation of data flows, schema changes, and pipeline transformations to ensure data quality, governance, and traceability.
- Monitor and tune system performance to meet stringent Service Level Agreements (SLAs) while supporting critical internal and external stakeholders.
- Champion agile and Scrum practices, actively participating in sprint planning, daily stand‑ups, retrospectives, and continuous improvement initiatives.
- Mentor junior engineers, fostering a culture of knowledge sharing, code reviews, and best‑practice adoption.
- Stay abreast of emerging technologies, industry trends, and best practices to continuously evolve talentflow’s data platform.
Essential Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related discipline.
- Minimum of 5 years of hands‑on experience designing and operating large‑scale data pipelines and warehouses.
- Proven expertise with SQL and the ability to craft complex queries that extract performant datasets from relational and non‑relational sources.
- Deep technical experience with Hadoop ecosystem components (HDFS, Hive, Impala, PySpark) and streaming platforms such as Apache Flink or Kafka.
- Strong programming skills in Python and either Java or Scala, with a track record of building production‑grade code.
- Hands‑on experience with at least one major MPP or cloud data warehouse technology (Snowflake, Redshift, BigQuery, or similar).
- Familiarity with data orchestration tools (e.g., Airflow, Luigi) and data quality frameworks.
- Demonstrated ability to work within Scrum/Agile frameworks and contribute to a collaborative team culture.
Preferred Qualifications & Additional Skills
- Master’s degree or advanced certifications in data engineering, cloud architecture, or related fields.
- Experience with AWS services such as S3, EMR, EC2, and Lambda for building end‑to‑end data solutions.
- Knowledge of data modeling techniques, dimensional modeling, and data vault methodology.
- Exposure to machine learning pipelines and collaboration with data scientists on feature engineering.
- Strong problem‑solving mindset, meticulous attention to detail, and excellent communication skills.
Core Competencies & Skills for Success
- Technical Acumen: Mastery of big data processing frameworks, cloud platforms, and programming languages.
- Analytical Thinking: Ability to dissect complex business problems and translate them into scalable data solutions.
- Leadership & Mentorship: Proven capability to guide teams, provide constructive feedback, and nurture talent.
- Collaboration: Strong interpersonal skills to work effectively with product owners, analysts, and engineering peers.
- Adaptability: Comfort operating in a fast‑paced environment where priorities shift rapidly.
- Quality Focus: Commitment to data integrity, documentation, and rigorous testing.
Career Growth & Learning Opportunities
At talentflow, your career trajectory is shaped by ambition and curiosity. As a Lead Data Engineer, you will have direct exposure to senior leadership, strategic product roadmaps, and high‑visibility projects that influence the company’s direction. Opportunities include:
- Progression to Data Architecture Director or Head of Data Platform roles.
- Access to internal training programs, certifications, and conferences focused on cloud, big data, and AI.
- Cross‑functional rotations with product, analytics, and engineering teams to broaden your skill set.
- Mentorship from industry veterans who have built data platforms at Fortune‑500 companies.
- Participation in innovation labs where you can prototype emerging technologies and present findings to executive stakeholders.
Work Environment & Culture at talentflow
talentflow fosters a vibrant, inclusive, and collaborative workplace where creativity meets technical excellence. Our teams operate in modern offices located in San Francisco, equipped with flexible workspaces, state‑of‑the‑art meeting rooms, and quiet zones for deep focus. We champion:
- Diversity & Inclusion: A commitment to building a workforce that reflects the global audience we serve.
- Work‑Life Balance: Flexible hours, remote‑work options, and generous paid time off.
- Innovation Culture: Hackathons, idea‑incubation programs, and “innovation days” that empower employees to explore new concepts.
- Health & Wellness: Comprehensive medical, dental, and vision plans, on‑site fitness facilities, and mental‑health resources.
- Community Impact: Volunteer initiatives and partnerships with nonprofit organizations focused on education and digital literacy.
Compensation, Perks, & Benefits
We offer a competitive hourly rate of $24 per hour, reflective of your expertise and the high‑impact nature of the role. In addition to base compensation, you will receive:
- Performance‑based bonuses tied to project milestones and business outcomes.
- Comprehensive health, dental, and vision coverage for you and your dependents.
- Retirement savings plans with company matching contributions.
- Generous paid time off, parental leave, and flexible scheduling.
- Professional development stipend for certifications, courses, and conferences.
- Employee assistance programs, wellness initiatives, and on‑site amenities.
How to Apply
If you are ready to lead transformative data initiatives at a world‑renowned entertainment powerhouse, we want to hear from you. Submit your resume and a brief cover letter highlighting your most relevant experience and why you are excited about the opportunity at talentflow.
Join talentflow – Where Data Meets Imagination
At talentflow, data isn’t just a backend function—it’s the engine that powers storytelling, audience engagement, and business growth. By joining our team, you become a catalyst for innovation, helping shape the future of digital entertainment for audiences worldwide. Take the next step in your career and become part of a legacy of excellence. Apply today and let your data expertise shine at talentflow!
``` Apply for this job