Note: The job is a remote job and is open to candidates in USA. Lumenalta partners with global enterprises to design and build large-scale, secure, and cost-effective data platforms. The Senior Databricks Platform Engineer will implement Unity Catalog governance, enforce classification-based access controls, establish FinOps policies, and provide cost, usage, lineage, and data quality visibility for stakeholders.
Responsibilities
- Configure the Unity Catalog foundation, including catalogs, schemas, and baseline role-based access controls across all environments
- Implement the data classification and tagging approach, including governed tags that drive program-level CUI and part-level ITAR handling
- Implement row filters and column masks where classification requires them, so access is enforced by policy rather than by hand-built views
- Configure lineage capture for ingestion pipelines and make lineage usable for audit and impact analysis
- Implement cluster policies, budget policies, and serverless spend controls that keep compute within agreed limits without blocking engineers
- Design and implement cost-attribution tagging and a chargeback model by program, team, and workload
- Build cost and usage dashboards on Databricks system tables and AWS billing data, and report spend trends and anomalies to stakeholders
- Set up data quality monitoring and alerting standards for the pipelines the engineers build
- Support the architect in presenting governance and access controls to enterprise security reviewers, with documentation of policies and evidence that they work
- Document governance and cost standards, including catalog and column documentation, so the client can operate the platform after handoff
Skills
- 5+ years in data platform engineering, cloud engineering, or platform administration
- Hands-on Databricks administration in production
- Practical Unity Catalog experience: access controls, governed tags, lineage, and, ideally, row filters and column masks
- Experience implementing classification-driven access, where tags decide access
- Demonstrated ownership of platform cost: you have written cluster and budget policies, implemented tagging standards, and built a chargeback or showback model
- Experience with AWS cost management, such as Cost Explorer, Cost and Usage Reports, and budgets
- Strong SQL and working Python, with experience querying system tables or billing data to build reporting
- Clear written communication
- US citizenship
- Fluent English, both written and spoken
- This position supports a U.S. Government contract that requires all personnel to possess U.S. Citizenship
- Experience with Databricks on AWS GovCloud
- Experience with Delta Sharing across regions or regulatory boundaries
- Infrastructure as code for Databricks, such as Terraform or Databricks Asset Bundles
- FinOps Certified Practitioner or a Databricks Platform Administrator accreditation
- Experience with Lakehouse Monitoring or other data quality tooling
- Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data
Benefits
- 100% dedicated to one project at a time
- A team of talented and friendly senior-level developers
- Projects that allow you to use leading tech
- Delivery Partner Program qualification, sponsored by Lumenalta
- Champion path, including a dedicated Databricks solutions architect as a mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit
- Databricks certification exam fees covered
- Fully remote position
Company Overview