Note: The job is a remote job and is open to candidates in USA. Xinova Group is a Fortune 500 Consumer Goods organization seeking an experienced Databricks Engineer to support their cloud data platform initiatives. The role involves designing, developing, and optimizing data pipelines and architectures while collaborating with various teams to drive data modernization and analytics enablement.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and cloud-native services
- Build and optimize Lakehouse architectures leveraging Databricks, Delta Lake, and Apache Spark technologies
- Develop robust ETL/ELT solutions to support enterprise reporting, analytics, and machine learning initiatives
- Implement data ingestion frameworks supporting structured, semi-structured, and unstructured data sources
- Collaborate with architects and stakeholders to translate business requirements into scalable technical solutions
- Optimize Databricks workloads for performance, scalability, reliability, and cost efficiency
- Develop and maintain Delta Live Tables, Databricks Workflows, and orchestration solutions where appropriate
- Implement data quality controls, monitoring, observability, and operational best practices across the platform
- Support the implementation of data governance, security, and compliance requirements utilizing Unity Catalog and related capabilities
- Collaborate with DevOps and platform teams to establish CI/CD pipelines and Infrastructure-as-Code practices
- Troubleshoot and resolve data processing, performance, and integration issues across the data ecosystem
- Work closely with analytics, data science, and business teams to deliver high-quality data products and datasets
- Contribute to cloud modernization efforts across Azure, AWS, or Google Cloud environments
- Promote engineering best practices, documentation standards, and continuous improvement initiatives
Skills
- 5+ years of experience in Data Engineering, Big Data, or Cloud Data Platform development
- 3+ years of hands-on experience developing solutions with Databricks
- Strong expertise with Databricks, Delta Lake, Apache Spark, and PySpark
- Experience building and supporting enterprise-scale data pipelines and data integration solutions
- Strong proficiency in Python and SQL
- Experience designing and implementing modern Lakehouse architectures
- Hands-on experience with Azure, AWS, or Google Cloud Platform
- Knowledge of data modeling, data warehousing, and enterprise data architecture concepts
- Experience implementing data quality, governance, and security best practices
- Experience with CI/CD pipelines, DevOps practices, and Infrastructure-as-Code frameworks
- Strong understanding of distributed computing and large-scale data processing concepts
- Excellent problem-solving skills and ability to work independently in complex enterprise environments
- Strong communication and stakeholder engagement skills
- Active Databricks certifications preferred
- Experience with Unity Catalog, Delta Live Tables, Databricks Workflows, MLflow, and Databricks Asset Bundles
- Experience supporting advanced analytics, machine learning, and AI workloads
- Experience integrating with Azure Data Factory, Azure Synapse, AWS Glue, or similar cloud-native services
- Knowledge of streaming technologies and real-time data processing frameworks
- Experience within consumer goods, retail, CPG, manufacturing, or other large-scale enterprise environments
- Cloud certifications in Azure, AWS, or Google Cloud Platform
Company Overview