Note: The job is a remote job and is open to candidates in USA. Bixal is a consulting company that works with governments and organizations to deliver better services and experiences through evidence-based knowledge and technology. The DevOps Engineer will design, deploy, and manage secure, scalable AWS and Databricks cloud infrastructure supporting data, analytics, and AI/ML workloads. The role will automate and optimize platform operations using Terraform, GitHub Actions, Python, and Bash while partnering with engineering and security teams.
Responsibilities
- Own the design, deployment, and operations of cloud infrastructure supporting enterprise data platforms, analytics workloads, and AI/ML capabilities across development, validation, and production environments
- Build and maintain Infrastructure as Code (IaC) using Terraform to provision, manage, and standardize AWS and Databricks resources
- Develop and maintain reusable Terraform modules and automation patterns for Databricks workspaces, Unity Catalog resources, networking components, IAM roles, S3 storage, KMS encryption, service principals, and platform integrations
- Administer and support Databricks environments, including workspace configuration, account-level settings, Unity Catalog governance, metastore configuration, external locations, storage credentials, service credentials, clusters, jobs, secrets, and access controls
- Manage Databricks platform migrations, upgrades, and architectural changes while ensuring minimal disruption to users and downstream integrations
- Design and implement secure AWS architectures including VPC networking, private connectivity, VPC endpoints, IAM policies, cross-account access, S3 architectures, encryption, and least-privilege access patterns
- Build and maintain CI/CD pipelines using GitHub Actions to automate infrastructure deployments, validation, security checks, operational workflows, and platform management tasks
- Develop automation tooling using Python, Bash, and cloud APIs to improve operational efficiency and reduce manual platform administration
- Support enterprise identity and access management patterns including user provisioning, groups, service principals, OAuth/PAT authentication, workload identities, and automated permission management
- Implement and maintain observability and audit logging solutions for cloud and Databricks environments, including integration with enterprise monitoring platforms such as Splunk
- Design and support secure data platform integrations including Delta Lake, Unity Catalog, Delta Sharing, external locations, data access controls, and consumer-facing data products
- Support AI/ML platform capabilities by enabling services such as MLflow, Databricks AI tooling, AWS Bedrock, foundation model integrations, and GenAI workloads
- Partner with data engineering, analytics, security, and application teams to troubleshoot complex platform issues and establish scalable engineering standards
- Lead technical investigations, proof-of-concepts, and platform improvements focused on reliability, security, automation, and developer experience
- Create and maintain technical documentation, onboarding guides, architecture diagrams, operational runbooks, and self-service tooling for internal teams and external consumers
- Participate in incident response, root cause analysis, and continuous improvement efforts for production data platform services
- Other relevant duties as qualified and trained to perform
Skills
- • Bachelor's degree in a relevant technical field plus 4+ years of experience, or equivalent professional experience
- • Strong hands-on experience managing AWS cloud infrastructure in enterprise environments
- • Experience with Terraform or similar Infrastructure as Code tooling, including developing reusable modules and managing large infrastructure deployments
- • Experience administering Databricks environments, including Unity Catalog, workspace management, account-level resources, permissions, service principals, and integrations
- • Strong understanding of AWS services including IAM, S3, VPC, Route 53, KMS, Lambda, VPC endpoints, and networking fundamentals
- • Experience designing secure cloud architectures using least privilege IAM, encryption, private networking, and compliance-focused controls
- • Experience building and maintaining CI/CD pipelines using GitHub Actions or similar automation platforms
- • Strong Python and Bash scripting skills with experience automating cloud, infrastructure, or platform operations
- • Experience supporting production data platforms, distributed systems, analytics environments, or AI/ML infrastructure
- • Understanding of data platform concepts including Delta Lake, medallion architecture (Bronze/Silver/Gold), data governance, and access control models
- • Experience troubleshooting complex issues across cloud infrastructure, networking, identity, automation, and data platforms
- • Strong communication skills with the ability to collaborate with engineers, architects, security teams, and non-technical stakeholders
- • Ability to obtain and maintain a Public Trust security clearance
- This role can work remotely from anywhere in the USA. You must be legally authorized to work in the US. Bixal does not provide visa sponsorship
- • Experience working in FedRAMP, FISMA, or other regulated cloud environments
- • Experience with Databricks E2 architecture, workspace provisioning, and account-level platform administration
- • Experience leading Databricks migrations, networking redesigns, or cloud modernization initiatives
- • Experience supporting AI/ML platforms, AWS Bedrock, LLM integrations, RAG architectures, or GenAI workloads
- • Experience with enterprise logging and monitoring solutions such as Splunk
- • Experience managing GitHub organization settings, repository automation, and developer tooling
- • Databricks, AWS, Terraform, or cloud security certifications
- • Experience supporting healthcare, or federal government environments
Benefits
- Flex hours
- 401K with matching incentive
- Parental Leave
- Medical/dental/vision benefits
- Flex Spending Account
- Company provided short-term disability and life insurance
- Commuter benefits
- Paid Time Off (PTO)
- 11 Paid holidays
Company Overview