Note: The job is a remote job and is open to candidates in USA. KeyLogic is seeking a Data Engineer to support the Department of Energy with Databricks-based data engineering solutions. The role focuses on designing, building, maintaining, and optimizing scalable data pipelines and infrastructure while ensuring reliable data integration, processing, quality, and availability.
Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks
- Develop and implement infrastructure as code solutions with Terraform
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions
- Optimize data workflows for performance, reliability, and scalability
- Monitor, troubleshoot, and resolve issues related to data processing and infrastructure
- Ensure data quality and integrity throughout the data lifecycle
- Automate repetitive tasks to improve efficiency and reduce manual intervention
Skills
- **U.S. Citizenship**
- 2+ years of engineering experience on Databricks and large-scale big data projects (Delta Lake, DLT, Apache Spark, unity Catalog)
- Bachelor's Degree
- 4+ years of experience in Python, Java, or equivalent. Comfortable with evaluation tooling, logging, monitoring, and observability
- Experience with government contracting
Benefits
- Remote work
Company Overview