Note: The job is a remote job and is open to candidates in USA. HIKE2 is seeking a Senior Databricks Engineer to design and deliver enterprise-grade data platforms and pipelines, from architecture through production support. The role leads technical direction, optimizes Databricks and Azure workloads, partners with clients, and mentors engineers.
Responsibilities
- Design and build large-scale data platforms on Databricks (Delta Lake, Spark, Unity Catalog) in Azure
- Develop and maintain batch and streaming data pipelines for high-volume, complex data sources
- Implement medallion/lakehouse architectures from the ground up in greenfield environments
- Build and optimize data models to support analytics, reporting, and downstream applications
- Integrate Databricks with enterprise systems (APIs, event streams, warehouses, ML workflows)
- Tune Spark jobs and pipelines for performance, reliability, and cost at scale
- Support production deployments, including CI/CD pipelines, testing, and release management
- Partner directly with enterprise clients to translate requirements into working technical solutions
- Collaborate with architects, engineers, and data scientists across multiple workstreams
- Balance speed and quality, knowing when to move fast and when to harden solutions
- Make pragmatic decisions in ambiguous, evolving environments (especially greenfield builds)
- Contribute hands-on while also guiding design and approach across the team
- Communicate tradeoffs clearly to both technical and non-technical stakeholders
- Work within modern engineering practices (version control, code reviews, automated testing)
- Demonstrated ability to mentor and guide data engineers and analysts
- End-to-end delivery of Databricks-based data solutions—from design through production support
- Technical direction and key architecture decisions for large-scale implementations
- Data pipeline reliability, monitoring, and incident response in production environments
- Performance and cost efficiency of workloads running in Databricks and Azure
- Data quality, governance alignment, and adherence to enterprise security standards
- Reusable patterns, frameworks, and standards for scaling future implementations
- Mentorship and technical development of other engineers on the team
Skills
- Deep Databricks-native expertise, including experience architecting and implementing end-to-end lakehouse solutions that run primarily or entirely on Databricks
- Advanced experience with modern Databricks architecture patterns, including declarative pipelines / Delta Live Tables, Unity Catalog, Delta Lake, workflow orchestration, governance, performance tuning, and operational monitoring
- Familiarity with infrastructure-as-code (Terraform, Bicep), environment provisioning, and CI/CD automation (Github, Azure DevOps) for Databricks-based platforms
- Strong learning agility, technical curiosity, and comfort using AI-enabled development workflows or automation tools to accelerate delivery and improve quality
- Familiarity with other modern cloud data architectures and tools, including cloud-native data warehouses (Snowflake, BigQuery, Redshift), data lakes, orchestration frameworks (Airflow/Astronomer), transformation tools (dbt), catalog/governance platforms, and scalable batch or streaming data processing services (Kafka, Kinesis)
- All applicants must reside in the U.S. and hold US Citizenship to be considered for employment
- Hike2 cannot sponsor work authorizations or visas now or in the future
Benefits
- HIKE2 offers a wide range of benefits which may include medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more.
- Remote work
Company Overview