Note: The job is a remote job and is open to candidates in USA. Bixal is a consulting company headquartered in Fairfax, Virginia, helping governments and organizations deliver better services and experiences through evidence-based knowledge and technology. The company is seeking a Data Engineer to build and optimize data pipelines using PySpark, Databricks, AWS, Kafka, and infrastructure-as-code technologies while ensuring platform reliability, scalability, and evolution. The role also involves mentoring engineers, troubleshooting pipelines, documenting architectures, and collaborating with cross-functional and client teams.
Responsibilities
- Leading the implementation of complex data ingestion pipelines using PySpark, Databricks Intelligence Platform, and AWS services (S3, IAM roles and policies), including Kafka/streaming architectures, schema evolution, and Delta Share, ensuring alignment with enterprise architecture standards
- Provide technical guidance and mentorship to engineers across the team and representing data engineering in cross-functional discussions
- Apply engineering standards, including code quality, testing practices, CI/CD processes, and infrastructure as code patterns using Terraform
- Author and maintain architectural documentation, technical decision records, and platform runbooks that enable team autonomy and operational excellence
- Guide and implement optimization opportunities across data ingestion, transformation, and storage layers
- Troubleshoot complex pipeline failures across multi-system dependencies
- Collaborate with data scientists, analysts, DevOps engineers, and client teams to deliver integrated solutions that meet program objectives
- Other relevant duties as qualified and trained to perform
Skills
- Applicants must be authorized to work for any employer in the U.S
- Bachelor's degree
- Minimum of 4 years of relevant experience in Data Engineering
- Demonstrated experience working cross-functional engineering initiatives
- Proficiency in Python for data engineering tasks at scale
- Hands-on experience with Databricks Intelligence Platform (Notebooks, Lakeflow Jobs, Unity Catalog, Delta Share)
- Experience with AWS services such as S3 and IAM roles and policies
- Strong knowledge of data pipeline design and implementation, including data transformation techniques, data modeling, data storage optimization, and data security best practices
- Proficiency in using version control systems like Git for managing code repositories and collaborating with team members on Agile projects
- Familiarity with Terraform or other infrastructure as code tools for automating infrastructure deployment and configuration management
- Experience working on Linux environments for data engineering projects, including accessing containers remotely, installing packages, managing files, services, and processes
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
- Strong problem-solving skills, ability to work independently and as part of a team, and excellent verbal and written communication skills
- Comfortable working in a highly collaborative environment with strong attention to detail and a commitment to delivering high-quality software
- Ability to obtain and maintain a Public Trust security clearance
- Experience working with other data frameworks such as Apache Hive, Apache Hadoop, or Apache Spark is a plus
- Federal consulting experience
- Databricks certifications (Associate Data Engineer or Professional Data Engineer)
- Experience with business intelligence tools (e.g., QuickSight, Power BI) for building data observability or usage reporting
Benefits
- Fully Remote; this role can work remotely from anywhere in the USA.
- Flex hours
- 401K with matching incentive
- Parental Leave
- Medical/dental/vision benefits
- Flex Spending Account
- Company provided short-term disability and life insurance
- Commuter benefits
- Paid Time Off (PTO)
- 11 Paid holidays
Company Overview