Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker
- Karel G M Moons1,
- Andre Pascal Kengne1,2,3,
- Mark Woodward2,4,
- Patrick Royston5,
- Yvonne Vergouwe1,
- Douglas G Altman6,
- Diederick E Grobbee1
- 1Julius Centre for Health Sciences and Primary Care, UMC Utrecht, Utrecht, The Netherlands
- 2Cardiovascular Division, The George Institute for Global Health, University of Sydney, Sydney, Australia
- 3NCRP for Cardiovascular and Metabolic Diseases, South African Medical Research Council, University of Cape Town, Cape Town, South Africa
- 4Department of Epidemiology, Johns Hopkins University, Baltimore, USA
- 5MRC Clinical Trials Unit, London, UK
- 6Centre for Statistics in Medicine, University of Oxford, Oxford, UK
- Correspondence to Professor Karel Moons, Julius Center for Health Sciences and Primary Care, UMC Utrecht, PO Box 85500; 3508 GA Utrecht. The Netherlands;
Contributors KGMM and APK conceived the study, conducted the review, drafted and revised the paper. MW and DEG contributed to the study conception and revised the draft. PR, YV and DGA revised the draft paper.
- Received 13 December 2011
- Accepted 14 January 2012
- Published Online First 7 March 2012
Prediction models are increasingly used to complement clinical reasoning and decision making in modern medicine in general, and in the cardiovascular domain in particular. Developed models first and foremost need to provide accurate and (internally and externally) validated estimates of probabilities of specific health conditions or outcomes in targeted patients. The adoption of such models must guide physician's decision making and an individual's behaviour, and consequently improve individual outcomes and the cost-effectiveness of care. In a series of two articles we review the consecutive steps generally advocated for risk prediction model research. This first article focuses on the different aspects of model development studies, from design to reporting, how to estimate a model's predictive performance and the potential optimism in these estimates using internal validation techniques, and how to quantify the added or incremental value of new predictors or biomarkers (of whatever type) to existing predictors. Each step is illustrated with empirical examples from the cardiovascular field.
- Prediction model
- risk prediction
- model development
- internal validation
- model improvement
- added value
- clinical hypertension
- general practice
Linked article 301247.
KGMM and APK contributed equally.
Funding Karel GM Moons receives funding from the Netherlands Organisation for Scientific Research (project 9120.8004 and 918.10.615).
Competing interests None.
Provenance and peer review Commissioned; externally peer reviewed.