Job Description: AWS DevOps Engineer – Terraform & Azure DevOps
Location: USA – Remote
Job Summary
We are seeking an experienced AWS DevOps Engineer with strong hands-on expertise in AWS infrastructure provisioning using Terraform and CI/CD pipeline implementation. The ideal candidate will have experience provisioning, configuring, and managing AWS resources using Infrastructure as Code (IaC), along with Azure DevOps Pipelines for automated deployment workflows.
Experience with Databricks (DBX) provisioning and administration is a significant advantage and will be considered a strong differentiator.
Key Responsibilities
Design, provision, and manage AWS infrastructure using Terraform.
Develop and maintain reusable Terraform modules for AWS resource provisioning.
Implement and manage CI/CD pipelines using Azure DevOps Pipelines.
Automate infrastructure deployments, configuration, and environment management.
Configure AWS networking, security, access controls, and private connectivity.
Collaborate with development, cloud, and data engineering teams to support infrastructure automation.
Troubleshoot infrastructure, deployment, connectivity, and access-related issues.
Follow infrastructure security, compliance, and operational best practices.
Support Databricks workspace provisioning, configuration, and administration, if experienced.
Required Technical Skills
1. AWS Infrastructure
Hands-on experience provisioning and managing the following AWS services using Terraform:
Amazon S3
AWS Lambda
Amazon VPC and Subnets
NAT Gateway
AWS PrivateLink
Security Groups
Amazon Route 53 – Private DNS Zones
AWS IAM
AWS KMS
2. Infrastructure as Code (IaC)
Strong experience with Terraform for AWS resource provisioning.
Experience writing and maintaining Terraform configurations, modules, variables, and state management.
Understanding of infrastructure automation and deployment best practices.
3. CI/CD Pipelines
Experience with Azure DevOps Pipelines for CI/CD automation.
Ability to build and maintain pipelines for infrastructure deployments.
Experience with GitHub Actions, GitLab CI/CD, or similar tools is also acceptable.
4. Scripting and Automation
Proficiency in Python, Bash, or similar scripting languages.
Experience automating infrastructure operations and deployment processes.
Familiarity with Git and version control workflows.
Preferred Skills – Databricks (DBX)
Candidates with experience in the following areas will be strongly preferred:
Databricks workspace provisioning and administration.
Automating Databricks infrastructure using Terraform.
Managing workspace configuration, access controls, and permissions.
Understanding Databricks networking and cloud infrastructure integration.
Experience supporting Databricks deployment and environment management.
Ideal Candidate Profile The ideal candidate should have strong practical experience with AWS + Terraform + CI/CD, particularly Azure DevOps Pipelines. Experience with Databricks provisioning and administration will make the candidate an excellent fit.
Core Must-Haves:
AWS infrastructure provisioning using Terraform.
Hands-on knowledge of S3, Lambda, VPC, Subnets, NAT Gateway, PrivateLink, Security Groups, Route 53 Private DNS, IAM, and KMS.
Azure DevOps Pipelines or equivalent CI/CD experience.
Infrastructure automation and troubleshooting.
Preferred Differentiator: Databricks provisioning and administration experience.