Note: The job is a remote job and is open to candidates in USA. Lumenalta partners with global enterprises to design and build large-scale data platforms that support core business products and operations. The Senior Databricks Data Engineer will build governed Gold data products for a digital thread by modeling and relating engineering artifacts, implementing Silver-to-Gold transformations, and documenting data models, business rules, and lineage.
Responsibilities
- Implement the v1 program-agnostic digital thread schema in Databricks, including artifact attributes and the relationships between them
- Map existing traceability relationships across requirements, system models, parts, and revisions into the new schema for each MVP capability
- Implement part and revision keying across multiple source systems to support a program-specialized bill of materials
- Build Silver-to-Gold transformations in Databricks declarative pipelines, with data quality expectations on keys, relationships, and completeness
- Publish Gold tables as governed data products in Unity Catalog, with documentation, tags, and ownership
- Work with source system SMEs to resolve how Cameo, Teamcenter, and Capital represent the same engineering concepts differently
- Design the Gold layer so it can serve the digital thread and digital twin use cases
- Document data models, business rules, and lineage for handoff
Skills
- 6+ years in data engineering, including production data modeling on Databricks or a comparable lakehouse
- Strong data modeling skills, including relationship-heavy or graph-like models and entity resolution across systems
- Experience keying the same entity across multiple source systems, such as part number plus revision
- Working fluency in PLM and MBSE concepts and vocabulary, such as parts, BOMs, revisions, change objects, SysML model elements, and requirements traceability
- Hands-on experience with data from at least one of Teamcenter, Cameo, or Siemens Capital
- Experience with Databricks declarative pipelines or Delta Live Tables, including data quality expectations
- Experience publishing governed tables in Unity Catalog with documentation and tags
- Strong PySpark and SQL, and experience with Delta Lake and medallion architecture
- Experience working directly with engineering stakeholders to define data definitions and business rules
- This position supports a U.S. Government contract that requires all personnel to possess U.S. Citizenship
- Familiarity with digital thread or digital twin reference architectures
- Experience with SLICwave or logistics support analysis data
- Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data
- Databricks Data Engineer Professional certification
Benefits
- 100% dedicated to one project at a time so that you can innovate and grow.
- Be a part of a team of talented and friendly senior-level developers.
- Work on projects that allow you to use leading tech.
- Delivery Partner Program qualification, sponsored by Lumenalta, which does not expire once granted.
- Databricks Champion path, including a dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit.
- The exam fee is covered for any Databricks certification you want to take.
- Fully remote position.
Company Overview