Note: The job is a remote job and is open to candidates in USA. Lumenalta partners with global enterprises to design and build large-scale data platforms that support core products and operations. The Senior Databricks Data Engineer will integrate Oracle E-Business Suite and SLICwave cost, supplier, and logistics data into Databricks, model it with engineering data, and build governed, orchestrated pipelines with appropriate security and data quality controls.
Responsibilities
- Ingest cost and supplier data from Oracle E-Business Suite into Databricks, using file-based ingestion from S3 extracts or direct read access, including session-level init parameter handling to work within row-level security
- Ingest SLICwave logistics support analysis data into Databricks, working with its relational backend and file exports
- Implement incremental and batch refresh patterns for both sources, starting from representative extracts where direct access is still pending
- Configure schema evolution and baseline data quality checks in Databricks declarative pipelines
- Model cost, supplier, and logistics data so it links to parts, revisions, and BOM structures from Teamcenter and other engineering sources
- Support the architect in presenting the Oracle integration approach to enterprise security reviewers, including documentation of access patterns and controls
- Orchestrate pipelines with Databricks Workflows and ensure lineage is captured for every pipeline
- Work with logistics and ERP SMEs to understand data structures, business rules, and extraction constraints
Skills
- 6+ years in data engineering, including production experience building ingestion pipelines on Databricks
- Working knowledge of Oracle E-Business Suite data structures, including cost, supplier, item, and BOM tables
- Experience with relational ingestion into Databricks from Oracle, SQL Server, or comparable databases
- Understanding of Oracle E-Business Suite's multi-org security model and how it affects returns
- Experience with Auto Loader and file-based ingestion from S3
- Experience with Databricks declarative pipelines or Delta Live Tables, including schema evolution configuration
- Experience modeling ERP or logistics data so it joins to engineering or product data
- Strong PySpark and SQL, and working knowledge of Delta Lake internals such as managed vs. external tables and predictive optimization
- Experience with Databricks Workflows for orchestration
- Clear written communication, including documenting integration designs for security review
- US citizenship
- Fluent English, both written and spoken
- Familiarity with PLM data, such as Teamcenter parts, BOMs, and revisions
- Familiarity with logistics support analysis (LSA/LSAR) data, such as GEIA-STD-0007 or MIL-STD-1388-2B structures. SLICwave experience is a plus
- Experience migrating Oracle or EDW workloads to Databricks
- Experience with Lakeflow Connect or other CDC-based ingestion tools
- Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data
- Databricks Data Engineer Professional certification
Benefits
- 100% dedicated to one project at a time so that you can innovate and grow.
- Work in a fully remote position within the United States.
- Flexible working hours in a remote environment.
- Health insurance (medical and dental) for W2 Employees.
- 401K Contribution.
- A professional development fund to enhance your skills and knowledge.
- 15 days of paid time off annually.
- Access to soft-skill development courses to further your career.
- We sponsor Delivery Partner Program qualification for Databricks practitioners.
- A dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit for Databricks Champion candidates.
- We pay the exam fee for any Databricks certification you want to take.
Company Overview