Job Details
- Location: San Jose (TR)
- Experience: 10 - 15 Years
- Job Type: Employee
- Openings: 1
Role Description
Work Location - Remote (Anywhere in USA)
As a DE Senior Architect at Tredence, you will lead the architectural design and implementation of scalable data engineering solutions leveraging Databricks technologies within the retail sector. Success in this role means delivering robust, high-quality data platforms that drive business insights and operational efficiency. You will collaborate with cross-functional teams to translate business requirements into technical architectures, ensuring adoption of analytics solutions that create measurable impact.
Key Responsibilities
- Architect Data Solutions → Design and architect end-to-end solutions using Databricks Lakehouse, Delta Lake, and associated technologies.
- Pipeline Development → Lead development of scalable ETL pipelines using PySpark, Python, and SQL for complex retail workflows.
- Data Governance → Implement and maintain cataloging and quality frameworks to ensure trust and governance of data assets.
- Model Alignment → Collaborate with stakeholders to define data models aligned with retail use cases.
- Mentorship → Provide technical guidance to teams, enforcing best practices in architecture and coding standards.
- Continuous Improvement → Evaluate emerging technologies to enhance platform capabilities.
- Solution Reviews → Participate in reviews, audits, and deployment planning for seamless client integration.
Required Skills & Experience
- 10–15 years of hands-on data engineering experience with a focus on architecture in the retail industry.
- Deep expertise in Databricks platform, including Delta Lake and Lakehouse concepts.
- Advanced skills in PySpark, Python, and SQL for building and optimizing pipelines.
- Strong knowledge of data cataloging, data modeling, and data quality best practices.
- Bachelor’s degree in Computer Science, Engineering, IT, or related discipline.
- Excellent communication skills with both technical and non-technical stakeholders.
Good to Have Skills
- Certifications: Databricks Certified Professional Data Engineer, AWS/GCP/Azure certifications.
- Experience with cloud-native data services and deployment automation tools.
- Familiarity with AI/ML model operationalization within pipelines.
- Knowledge of retail domain challenges, KPIs, and analytics use cases.
- Contributions to open-source projects or engagement in industry forums.
Why You’ll Love This Job
At Tredence, you’ll be part of a forward-thinking, collaborative team driving transformative analytics solutions at scale. This role offers strong career growth opportunities by working on cutting-edge data platforms and retail use cases. You’ll enjoy a supportive environment that values innovation, continuous learning, and work-life balance. Joining us means making a meaningful impact by helping clients unlock business value through practical AI and data-driven transformation.
10-15 years data engineering experience in retail; expertise in Databricks, Delta Lake, PySpark, Python, SQL; Bachelor's in Computer Science or related; strong communication; certifications preferred.
Key Responsibilities
- architecting data solutions
- developing ETL pipelines
- implementing data governance
Skills & Tools
Databricks, Delta Lake, PySpark, Python, SQL
Job Details
- Category: Data and Analytics
- Seniority: Senior Level
- Commitment: Full Time
- Workplace: Remote — United States
- Languages: English
About Tredence
A data engineering and analytics company delivering transformative solutions at scale. — Industry: Information Technology