Note: The job is a remote job and is open to candidates in USA. Eli Lilly and Company is a pharmaceutical company focused on discovering and delivering life-changing medicines. The Associate Director - Integrated Risk Data Engineer owns the data foundation for enterprise risk intelligence, leading Microsoft Fabric architecture, data pipelines, governance, integrations, and analytics-ready datasets. The role also provides technical leadership, resolves complex data quality challenges, and partners with risk, technology, and business stakeholders.
Responsibilities
- Own the Microsoft Fabric architecture for IRM, defining standards, design patterns, and best practices that ensure scalable, maintainable, and high-performing data infrastructure across the risk ecosystem
- Design, build, and maintain enterprise risk data pipelines using Microsoft Fabric with medallion architecture (bronze, silver, gold layers) that integrate data from multiple risk domains and enterprise systems
- Architect and implement data engineering workflows using Fabric Data Factory, Synapse Data Engineering (Spark notebooks), and Dataflows Gen2 to consolidate fragmented risk data from ServiceNow GRC, SAP, Workday, SuccessFactors, assurance platforms, and other enterprise and function-specific systems
- Design unified data models and Power BI semantic models that enable cross-functional risk analytics, ensuring data consistency, accuracy, and accessibility across all risk functions
- Establish and own the data governance framework for IRM, including data quality standards, validation rules, monitoring processes, security protocols, and access controls that protect sensitive risk information while enabling appropriate data sharing
- Serve as a key technical resource partnering with Analytics Developers, Architects, and Data Scientists to understand data requirements and deliver datasets that power dashboards, reports, predictive models, and risk assessments
- Architect and build scalable, automated data solutions using Fabric pipelines and dataflows that reduce manual data preparation efforts and enable real-time or near-real-time risk monitoring capabilities
- Optimize data pipeline performance using Fabric's compute resources and data storage options (Lakehouse, Data Warehouse) to ensure stakeholders receive timely, accurate risk intelligence when decisions need to be made
- Design and implement data observability and monitoring solutions that proactively identify and resolve data quality issues before they impact business decisions
- Lead migration and integration initiatives as new risk technologies and platforms are adopted across the enterprise, independently owning project planning, solution architecture, and delivery
- Independently respond to complex data requests from risk functions, producing clean, well-documented datasets in Fabric Lakehouses and Data Warehouses that support risk assessments, audits, investigations, and strategic initiatives
- Anticipate and resolve complex data quality issues, working with source system owners and business partners to implement sustainable fixes that prevent recurrence
- Define and maintain comprehensive documentation standards for data lineage, transformation logic, data dictionaries, and technical architecture that enable knowledge sharing and maintain institutional knowledge
- Build strategic relationships with Tech@Lilly (IT), risk platform administrators, and business data owners to identify and resolve data integration challenges that impact the broader IRM function
- Build and maintain strategic relationships with risk data owners, assurance function partners, and enterprise data teams to identify internal customer requirements and opportunities to improve data availability, quality, and integration
- Lead standardization of data definitions, taxonomies, and integration patterns across risk functions, influencing technical decisions that enable more effective cross-functional analytics
- Lead the upskilling of IRM team members and business partners in data engineering concepts, serving as a subject matter expert and contributing to data literacy across the organization
- Stay current on emerging data engineering technologies, practices, and tools, evaluating and applying relevant innovations to enhance Lilly's risk data capabilities
Skills
- • Bachelor's Degree in Computer Science, Information Systems, Data Engineering, or related field
- • 5+ years of relevant professional experience in data engineering, ETL development, or data integration, with demonstrated progression in responsibility and complexity
- Up to 5-10% travel based on business needs
- • Expert proficiency with Microsoft Fabric (preferred) or similar cloud data platforms (Azure Data Factory, Synapse Analytics, Databricks), with ability to define architecture standards and best practices
- • Advanced SQL and Python/PySpark skills, with hands-on experience building data pipelines in Spark notebook environments (Fabric, Databricks, or similar), using Git-based version control
- • Experience integrating LLM/API-based workflows (RAG, embeddings, enterprise LLM gateways), with interest or exposure to agentic tool-calling protocols such as MCP
- • Demonstrated experience independently leading data engineering projects from planning through delivery, including architecture design and standards definition
- • Demonstrated ability to translate complex business requirements into scalable technical data solutions with sound decision-making within functional guidelines
- • Strong understanding of Power BI data modeling, semantic model design, and optimizing datasets for analytical performance
- • Hands-on experience with Microsoft Fabric components including Data Factory, Synapse Data Engineering, Data Warehouse, Lakehouse, and Dataflows Gen2
- • Experience designing and implementing medallion architecture or similar layered data lake design patterns at enterprise scale
- • Experience with ServiceNow platform, ServiceNow GRC, or other governance, risk, and compliance systems
- • Proficiency in dimensional modeling, star schema design, and data warehouse concepts
- • Experience in pharmaceutical, healthcare, or highly regulated industries with complex data governance requirements
- • Background in risk management, audit, compliance, or assurance domain data
- • Familiarity with Power Platform integration (Power Automate, Power Apps) with Fabric
- • Strong problem-solving skills with ability to anticipate, diagnose, and resolve complex data integration challenges
- • Proven ability to collaborate effectively with both technical teams and non-technical business stakeholders, translating technical concepts into business language
- • Detail-oriented with commitment to data quality and comprehensive documentation
- • Self-directed professional who works independently, takes initiative on complex problems, and proactively identifies opportunities for improvement
- • Demonstrated strong motivation, rapid learning agility, and growth mindset
Benefits
- Company bonus (depending, in part, on company and individual performance)
- Eligibility to participate in a company-sponsored 401(k)
- Pension
- Vacation benefits
- Eligibility for medical, dental, vision and prescription drug benefits
- Flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts)
- Life insurance and death benefits
- Certain time off and leave of absence benefits
- Well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities)
Company Overview
Company H1B Sponsorship