Note: The job is a remote job and is open to candidates in USA. Bixal is a consulting company that helps governments and organizations deliver better services through evidence-based knowledge and technology. The Sr. Cloud Engineer will design, deploy, and manage secure, scalable cloud infrastructure for data, analytics, and AI/ML workloads, working with AWS, Databricks, Terraform, and GitHub Actions. The role also partners with engineering and security teams to automate operations, strengthen the data platform, and support compliance.
Responsibilities
- Own the design, deployment, and operations of cloud infrastructure supporting enterprise data platforms, analytics workloads, and AI/ML capabilities across development, validation, and production environments
- Build and maintain Infrastructure as Code (IaC) using Terraform to provision, manage, and standardize AWS and Databricks resources
- Develop and maintain reusable Terraform modules and automation patterns for Databricks workspaces, Unity Catalog resources, networking components, IAM roles, S3 storage, KMS encryption, service principals, and platform integrations
- Administer and support Databricks environments, including workspace configuration, account-level settings, Unity Catalog governance, metastore configuration, external locations, storage credentials, service credentials, clusters, jobs, secrets, and access controls
- Manage Databricks platform migrations, upgrades, and architectural changes while ensuring minimal disruption to users and downstream integrations
- Design and implement secure AWS architectures including VPC networking, private connectivity, VPC endpoints, IAM policies, cross-account access, S3 architectures, encryption, and least-privilege access patterns
- Build and maintain CI/CD pipelines using GitHub Actions to automate infrastructure deployments, validation, security checks, operational workflows, and platform management tasks
- Develop automation tooling using Python, Bash, and cloud APIs to improve operational efficiency and reduce manual platform administration
- Support enterprise identity and access management patterns including user provisioning, groups, service principals, OAuth/PAT authentication, workload identities, and automated permission management
- Implement and maintain observability and audit logging solutions for cloud and Databricks environments, including integration with enterprise monitoring platforms such as Splunk
- Design and support secure data platform integrations including Delta Lake, Unity Catalog, Delta Sharing, external locations, data access controls, and consumer-facing data products
- Support AI/ML platform capabilities by enabling services such as MLflow, Databricks AI tooling, AWS Bedrock, foundation model integrations, and GenAI workloads
- Partner with data engineering, analytics, security, and application teams to troubleshoot complex platform issues and establish scalable engineering standards
- Lead technical investigations, proof-of-concepts, and platform improvements focused on reliability, security, automation, and developer experience
- Create and maintain technical documentation, onboarding guides, architecture diagrams, operational runbooks, and self-service tooling for internal teams and external consumers
- Participate in incident response, root cause analysis, and continuous improvement efforts for production data platform services
- Other relevant duties as assigned and qualified/trained to perform
Skills
- You must be legally authorized to work in the US
- Bixal does not provide visa sponsorship
- Bachelor's degree in a relevant technical field plus 4+ years of experience, or equivalent professional experience
- Strong hands-on experience managing AWS cloud infrastructure in enterprise environments
- Experience with Terraform or similar Infrastructure as Code tooling, including developing reusable modules and managing large infrastructure deployments
- Experience administering Databricks environments, including Unity Catalog, workspace management, account-level resources, permissions, service principals, and integrations
- Strong understanding of AWS services including IAM, S3, VPC, Route 53, KMS, Lambda, VPC endpoints, and networking fundamentals
- Experience designing secure cloud architectures using least privilege IAM, encryption, private networking, and compliance-focused controls
- Experience building and maintaining CI/CD pipelines using GitHub Actions or similar automation platforms
- Strong Python and Bash scripting skills with experience automating cloud, infrastructure, or platform operations
- Experience supporting production data platforms, distributed systems, analytics environments, or AI/ML infrastructure
- Understanding of data platform concepts including Delta Lake, medallion architecture (Bronze/Silver/Gold), data governance, and access control models
- Experience troubleshooting complex issues across cloud infrastructure, networking, identity, automation, and data platforms
- Strong communication skills with the ability to collaborate with engineers, architects, security teams, and non-technical stakeholders
- Ability to obtain and maintain a Public Trust security clearance
- Experience working in FedRAMP, FISMA, or other regulated cloud environments
- Experience with Databricks E2 architecture, workspace provisioning, and account-level platform administration
- Experience leading Databricks migrations, networking redesigns, or cloud modernization initiatives
- Experience supporting AI/ML platforms, AWS Bedrock, LLM integrations, RAG architectures, or GenAI workloads
- Experience with enterprise logging and monitoring solutions such as Splunk
- Experience managing GitHub organization settings, repository automation, and developer tooling
- Databricks, AWS, Terraform, or cloud security certifications
- Experience supporting healthcare, or federal government environments
Benefits
- Flex hours
- 401K with matching incentive
- Parental Leave
- Medical/dental/vision benefits
- Flex Spending Account
- Company provided short-term disability and life insurance
- Commuter benefits
- Paid Time Off (PTO)
- 11 Paid holidays
Company Overview