Data Engineer
This full-time role of Data Engineer is a remote position.
The Data
Engineer will design, implement, and optimize data pipelines and workflows within the Databricks environment, ensuring the efficient collection, transformation, and storage of data.
Responsibilities include building robust ETL processes, developing and maintaining data models, and creating highly scalable and reliable data warehouses. The engineer will analyze and interpret large datasets, enabling stakeholders to make data driven decisions and support strategic initiatives across the organization.
Responsibilities:
Design, develop, and maintain scalable data pipelines and workflows within the Databricks environment
Build and optimize ETL/ELT processes to support ingestion, transformation, and delivery of structured and semi-structured data
Develop and maintain data models and enterprise data warehouse solutions to support reporting, analytics, and mission operations
Collaborate with cross-functional teams including data analysts, developers, and government stakeholders to gather requirements and deliver data solutions
Perform data validation, data quality checks, and troubleshooting to ensure integrity and reliability of datasets
Support data analytics initiatives by preparing datasets and enabling stakeholders to derive actionable insights
Maintain technical documentation for data pipelines, models, and workflows and support ongoing enhancements
Follow federal data security, governance, and privacy requirements aligned to U.S. Coast Guard systems and policies
Job Requirements:
• Must be a US Citizen
Ability to obtain and maintain a Public Trust background investigation (minimum requirement)
Bachelor’s degree in Computer Science, Information Systems, Engineering, or related technical field
2–5 years of experience in data engineering, ETL development, or data platform engineering
Hands-on experience building production-grade ETL/ELT pipelines and scalable data workflows
Experience with Databricks, Apache Spark, or similar distributed data processing frameworks
Strong proficiency in Python, SQL, or Scala for data engineering and pipeline development
Experience designing and maintaining data warehouse and lakehouse architectures
Working knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform Preferred:
Experience implementing Databricks medallion architecture (bronze/silver/gold)
Familiarity with Delta Lake, Unity Catalog, or structured streaming within Databricks
Experience working in Agile/Scrum development environments supporting federal IT programs
Exposure to federal data security standards and compliance frameworks (e.g., FISMA, NIST)