Note: The job is a remote job and is open to candidates in USA. Smart Tech LLC is hiring a Senior Data and AI Engineer (Databricks) on a remote contract basis. The role focuses on designing and optimizing Databricks data pipelines and lakehouse architectures, productionizing machine learning and AI solutions, and translating stakeholder requirements into technical designs.
Responsibilities
- The individual in this role will design, build, and optimize data pipelines and lakehouse architectures on Databricks, integrating with Snowflake and other cloud services as needed
- Day-to-day responsibilities include developing scalable ETL/ELT workflows, implementing data quality and governance controls, and collaborating with data scientists and architects to productionize machine learning and AI solutions
- The role also involves performance tuning, cost optimization, and creating reusable components and frameworks that support automation and agentic AI use cases
- The Senior Data and AI Engineer will engage with stakeholders to translate business requirements into technical designs and provide guidance on best practices in modern data and AI engineering
Skills
- Strong experience with Databricks (Spark, Delta Lake, notebooks, jobs) and modern data lakehouse architectures
- Proficiency in Python or Scala for data engineering, along with SQL for analytics and data transformations
- Hands-on expertise with cloud platforms (such as AWS, Azure, or GCP) and related data services and security practices
- Experience designing and implementing ETL/ELT pipelines, data modeling, and data quality frameworks
- Background in building and deploying machine learning and AI solutions in production, preferably in collaboration with data science teams
- Ability to work independently in a remote environment, manage multiple priorities, and communicate clearly with technical and non-technical stakeholders
- Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field, or equivalent practical experience
- Familiarity with Snowflake or similar cloud data warehouses is strongly preferred
- Experience in consulting or working with external clients on data and AI projects is a plus
Benefits
- Remote contract role
Company Overview