Testing & Results

Volv tested the rare disease prediction model on a database of 2.5 million anonymised primary care electronic health records (EHRs) in the Netherlands. Importantly, the patients in this dataset were being treated for other conditions and not the underlying target disease — making the evaluation clinically robust.

The assessment confirmed that the Volv inTrigue model identified a significantly greater number of patients with the specific rare disease and outperformed both traditional prediction models and clinicians’ own diagnostic accuracy.

The Volv approach raised clinical accuracy for the detection of at-risk patients to world-class precision. Compared to existing state-of-the-art models, it achieved a two-thirds reduction in error rate. Sensitivity to false positives was measured using the Area Under the ROC Curve (AUC). On this gold-standard metric, where 1.00 equals perfect accuracy (no false positives), the Volv model achieved an outstanding 0.935 AUC, far exceeding the average human diagnostic performance of 0.76 AUC.

Performance comparison

  • Volv model (inTrigue): Accuracy = 90.8% (SE = 0.4%), AUC = 93.5% (SE = 0.1%).
  • Kopcke model (L2-regularised logistic regression on full feature set [Kopcke et al. 2013]): Accuracy = 73.1% (SE = 1.1%), AUC = 74.9% (SE = 1.0%).
  • Miotto model (classification using relevance scoring [Miotto, Weng 2015]): Accuracy = 74.2% (SE = 1.0%), AUC = 75.8% (SE = 1.0%).

 

When the Volv methodology was used to augment physician diagnosis, accuracy rose even further, reaching an impressive 0.975 AUC.

Further work

As part of the project, we also developed ways to help healthcare system providers utilise the methodology within strict ethical and regulatory frameworks across different countries and regions. The solution is now highly scalable and translatable, with potential application to thousands of rare and complex diseases.

We have named this end-to-end solution: inTrigue.

Benefits of inTrigue

The inTrigue methodology delivered five core benefits to our pharmaceutical company client:

  1. Accurate Disease Insight
    inTrigue identified the most predictive clinical evidence for assessments conducted by specialist clinicians diagnosing rare diseases. It also uncovered a novel disease predictor, which can be added to diagnostic assessments to further improve accuracy.
  2. Patient Finding
    inTrigue successfully identified hidden patients within electronic health record (EHR) systems. For such rare conditions, these individuals would likely have gone undiagnosed until a severe exacerbating event revealed the condition.
  3. Prevalence Insight
    inTrigue redefined the estimated disease prevalence, showing it to be closer to 1 in 300,000 rather than the previously assumed 1 in 1,000,000. This data-driven prevalence insight reshapes understanding of the true disease burden.
  4. Risk Mitigation
    inTrigue enables pharmaceutical companies to demonstrate to payers and clinicians new ways to reduce clinical risk by more accurately defining the treatment population. Patients who can benefit from the medicine are those who receive it. The methodology also supports FDA Risk Evaluation and Mitigation Strategies (REMS) by providing precise patient cohort identification.
  5. Improved Financial Performance
    With world-class precision in patient cohort selection, inTrigue helps companies align market access strategies with payer preferences and healthcare archetypes. By improving uptake among diagnosing physicians and reducing traditional sales costs, the model creates a more efficient buyers’ market for specialty medicines.

 

Summary: What does our approach do?

inTrigue is a case-finding prediction model that reshapes clinical practice by helping clinical specialists make more accurate diagnoses for precision medicine and personalised healthcare. This ensures that the precise cohort of patients who can benefit from a specific medicine are identified and treated earlier.

inTrigue leverages genetic biomarkers, phenotype markers, cognitive markers, and, where available, behavioural markers. It also identifies digital biomarkers and novel disease predictors extracted from electronic health records (EHRs) and scientific literature.

The prediction model is dynamic—it continues to learn and improve accuracy as feedback from clinical use is fed back into the system.

By shifting disease prevalence insights, inTrigue demonstrates precision case finding and enables patient cohort identification for clinical trials, helping researchers find patients that fit specific profiles.

Ultimately, inTrigue augments human decision-making and reduces the subjectivity that often hampers clinical diagnosis, case finding, and cohort creation.

FAQs

Q1: How does AI improve rare disease detection?
AI models like inTrigue analyse millions of records to detect subtle patterns and biomarkers, improving both speed and accuracy.

Q2: Can this methodology be applied beyond rare diseases?
Yes, inTrigue is scalable to common and complex diseases, supporting personalised medicine.

Q3: How accurate is it compared to clinicians?
Clinicians average ~76% accuracy. inTrigue achieves 90.8%, rising to 97.5% when used alongside physicians.

Q4: Is patient privacy protected?
Yes, the system uses anonymised records and aligns with strict ethical and regulatory standards.

 

References