Note: The job is a remote job and is open to candidates in USA. Aptive Resources is seeking a Senior Data Scientist to support Veteran Health consulting roles on Veterans Health Administration projects. The role focuses on developing AI risk stratification and evaluation methodologies, assessing the value and fairness of deployed AI systems, consulting with field teams, and analyzing healthcare data and cohorts.
Responsibilities
- Design and execute the AI risk stratification pilot, developing and evaluating a new methodology for assigning risk levels to AI systems across the VHA enterprise
- Design evaluation methodology for deployed AI systems, covering model performance, bias and fairness, construct validity, and post-deployment monitoring
- Build and validate preregistered cost-benefit formulations that let VHA demonstrate concrete, measurable value from deployed AI systems
- Provide technical consultation to five field pilot partnerships on model selection, data readiness, cohort construction, and evaluation design
- Conduct the quantitative assessment of pilot outcomes supporting the program evaluation deliverable
- Support AI oversight evaluations with analytic evidence, participating in working sessions with VHA governance entities at a cadence of at least one session every other month
- Contribute analytic content to AI risk management playbooks, assessment guides, and training materials for use case owners and oversight personnel
- Assess a variety of AI/ML solution approaches such as supervised, unsupervised, and reinforcing learning against specific VHA use cases and constraints
- Develop and analyze data models and cohorts specific to the healthcare field, and advise on data quality, cohort definition, and synthetic data approaches for AI development in a protected health information environment
Skills
- Aptive Resources is seeking a Senior Data Scientist with a degree in statistics, mathematics, computer science, or a related discipline and demonstrated experience applying machine learning technologies to healthcare data
- * **Years of experience:** 8 years minimum of applied data science experience
- * **Required experience:** Previous experience applying various machine learning technologies including supervised, unsupervised, and reinforcing learning techniques
- Previous experience working with cloud-based analytic environments
- Previous experience working with synthetic data models and cohorts
- Previous experience developing and analyzing data models and cohorts specific to the healthcare field
- * **Degree:** Master's degree in Statistics, Mathematics, Computer Science, Data Science, or a related field
- * **Work location:** Remote
- * **Citizenship:** Must be authorized to work in the United States
- All work must be performed within a jurisdiction subject to the law of the United States or its territories
- * Demonstrated command of supervised, unsupervised, and reinforcing learning techniques and of when each is and is not appropriate
- Experience working in cloud-based analytic environments and with synthetic data models and cohorts
- Experience developing and analyzing data models and cohorts specific to the healthcare field
- Familiarity with healthcare operations and clinical workflow, and the ability to reason about how a model behaves once it meets one
- Experience developing risk stratification or cost-benefit methodologies for a decision-making body
- Fluency in Python and/or R and modern ML tooling
- Experience evaluating third-party or vendor AI solutions on behalf of a purchasing organization
- Ability to get up to speed quickly on complex issues
- Capable self-starter with a drive to get all types of work done and high attention to detail
- Outstanding written and verbal communications skills
- Knowledge of military and Veteran populations
- Preferred: ten or more years, including five or more designing and evaluating machine learning models on health or health-adjacent data
- PhD preferred
- Experience with VA data sources such as Corporate Data Warehouse, VistA, MedSAS, Patient Treatment File strongly preferred
- Peer-reviewed publication record in health AI or clinical informatics valued
Benefits
- Remote work; work is performed at the contractor’s site and no travel is anticipated.
Company Overview