Note: The job is a remote job and is open to candidates in USA. Astir IT Solutions, Inc. is seeking a Senior Databricks Data Engineer to build and support large-scale enterprise data platforms. The role focuses on Databricks, Spark, PySpark, Python, SQL, cloud data services, security, governance, data quality, and production troubleshooting.
Responsibilities
- We are seeking a Senior Databricks Data Engineer with strong hands-on experience building large-scale enterprise data platforms using Databricks, Spark, PySpark, Python, SQL, and AWS/Azure
Skills
- 10+ years of Data Engineering experience
- 7+ years hands-on Databricks experience
- Expert in Apache Spark/PySpark, Python, and SQL
- Strong experience with Delta Lake, Databricks Workflows, and data pipelines
- Hands-on Unity Catalog experience
- Strong knowledge of RBAC, row-level security/filtering, column masking, and fine-grained access controls
- Experience with AWS/Azure, S3/ADLS, data governance, lineage, and data quality
- Strong troubleshooting and production support skills
- Deeply hands-on with Databricks and core data engineering , with proven experience handling large-scale Spark processing, Unity Catalog, security, governance, and complex production environments
- Experience with Git, CI/CD, Terraform/IaC is preferred
Benefits
- Remote work arrangement
Company Overview