Note: The job is a remote job and is open to candidates in USA. Nasscomm is seeking a Databricks Engineer to support data engineering initiatives on the Databricks Lakehouse platform. The role focuses on developing with PySpark and SQL, implementing Medallion architecture, tuning performance, managing Unity Catalog security and lineage, and applying CI/CD and testing processes.
Responsibilities
- Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform
- Set up row/column-level security and manage data lineage and sharing in Unity Catalog
- Utilize CI/CD and testing processes like Databricks
- Utilize CI/CD and testing processes like Databricks
- SAS, SQL, Unix, Linux
Skills
- • Proficiency in PySpark and SQL, experience with Medallion architecture, and performance tuning within the Databricks Lakehouse platform
- • Set up row/column-level security and manage data lineage and sharing in Unity Catalog
- • Utilize CI/CD and testing processes like Databricks
- Education: Bachelors
- SAS, SQL, Unix, Linux
Benefits
- Remote work
Company Overview
Company H1B Sponsorship