Note: The job is a remote job and is open to candidates in USA. Prudent Technologies and Consulting, Inc. is seeking an experienced AI Data Engineer to design, develop, and manage scalable data platforms that enable advanced analytics and Machine Learning solutions. The ideal candidate will build robust data pipelines and integrate AI/ML capabilities into enterprise data ecosystems.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data
- Build and optimize data lakes, data warehouses, and AI-ready data platforms
- Develop ingestion, transformation, and orchestration frameworks using cloud-native technologies
- Prepare, cleanse, and engineer datasets for AI/ML and Generative AI workloads
- Integrate Large Language Models (LLMs), vector databases, embeddings, and RAG (Retrieval-Augmented Generation) pipelines into enterprise solutions
- Implement data governance, security, lineage, and quality controls
- Collaborate with Data Scientists, AI Engineers, Business Analysts, and Solution Architects
- Monitor, troubleshoot, and optimize data pipelines and platform performance
- Automate deployment, testing, and monitoring of data engineering workflows
- Create technical documentation and data dictionaries for enterprise data assets
Skills
- Python
- AI/ML
- 15+ Years of experience
- Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data
- Build and optimize data lakes, data warehouses, and AI-ready data platforms
- Develop ingestion, transformation, and orchestration frameworks using cloud-native technologies
- Prepare, cleanse, and engineer datasets for AI/ML and Generative AI workloads
- Integrate Large Language Models (LLMs), vector databases, embeddings, and RAG (Retrieval-Augmented Generation) pipelines into enterprise solutions
- Implement data governance, security, lineage, and quality controls
- Collaborate with Data Scientists, AI Engineers, Business Analysts, and Solution Architects
- Monitor, troubleshoot, and optimize data pipelines and platform performance
- Automate deployment, testing, and monitoring of data engineering workflows
- Create technical documentation and data dictionaries for enterprise data assets
- Retail domain experience is highly preferable
Company Overview