Updating methods improved the performance of a clinical prediction model in new patients.
K. Janssen, K. Moons, C. Kalkman, D. Grobbee, und Y. Vergouwe. Journal of clinical epidemiology, 61 (1):
76-86(Januar 2008)4731<br/>JID: 8801383; 2006/08/22 received; 2007/03/08 revised; 2007/04/20 accepted; 2007/11/26 aheadofprint; ppublish;<br/>Models predictius; Avaluació de riscs.
DOI: 10.1016/j.jclinepi.2007.04.018
Zusammenfassung
OBJECTIVE: Ideally, clinical prediction models are generalizable to other patient groups. Unfortunately, they perform regularly worse when validated in new patients and are then often redeveloped. While the original prediction model usually has been developed on a large data set, redevelopment then often occurs on the smaller validation set. Recently, methods to update existing prediction models with the data of new patients have been proposed. We used an existing model that preoperatively predicts the risk of severe postoperative pain (SPP) to compare five updating methods. STUDY DESIGN AND SETTING: The model was tested and updated with a set of 752 new patients (274 36 with SPP). We studied the discrimination (ability to distinguish between patients with and without SPP) and calibration (agreement between the predicted risks and observed frequencies of SPP) of the five updated models in 283 other patients (100 35% with SPP). RESULTS: Simple recalibration methods improved the calibration to a similar extent as revision methods that made more extensive adjustments to the original model. Discrimination could not be improved by any of the methods. CONCLUSION: When the performance is poor in new patients, updating methods can be applied to adjust the model, rather than to develop a new model.
%0 Journal Article
%1 Janssen2008
%A Janssen, K J M
%A Moons, K G M
%A Kalkman, C J
%A Grobbee, D E
%A Vergouwe, Y
%D 2008
%J Journal of clinical epidemiology
%K AcuteDisease Adult Aged DataInterpretation Female Humans Male MiddleAged Pain PainMeasurement PainMeasurement:methods Postoperative Postoperative:diagnosis Postoperative:etiology Prognosis RiskFactors SeverityofIllnessIndex Statistical
%N 1
%P 76-86
%R 10.1016/j.jclinepi.2007.04.018
%T Updating methods improved the performance of a clinical prediction model in new patients.
%U http://www.ncbi.nlm.nih.gov/pubmed/18083464
%V 61
%X OBJECTIVE: Ideally, clinical prediction models are generalizable to other patient groups. Unfortunately, they perform regularly worse when validated in new patients and are then often redeveloped. While the original prediction model usually has been developed on a large data set, redevelopment then often occurs on the smaller validation set. Recently, methods to update existing prediction models with the data of new patients have been proposed. We used an existing model that preoperatively predicts the risk of severe postoperative pain (SPP) to compare five updating methods. STUDY DESIGN AND SETTING: The model was tested and updated with a set of 752 new patients (274 36 with SPP). We studied the discrimination (ability to distinguish between patients with and without SPP) and calibration (agreement between the predicted risks and observed frequencies of SPP) of the five updated models in 283 other patients (100 35% with SPP). RESULTS: Simple recalibration methods improved the calibration to a similar extent as revision methods that made more extensive adjustments to the original model. Discrimination could not be improved by any of the methods. CONCLUSION: When the performance is poor in new patients, updating methods can be applied to adjust the model, rather than to develop a new model.
%@ 0895-4356
@article{Janssen2008,
abstract = {OBJECTIVE: Ideally, clinical prediction models are generalizable to other patient groups. Unfortunately, they perform regularly worse when validated in new patients and are then often redeveloped. While the original prediction model usually has been developed on a large data set, redevelopment then often occurs on the smaller validation set. Recently, methods to update existing prediction models with the data of new patients have been proposed. We used an existing model that preoperatively predicts the risk of severe postoperative pain (SPP) to compare five updating methods. STUDY DESIGN AND SETTING: The model was tested and updated with a set of 752 new patients (274 [36] with SPP). We studied the discrimination (ability to distinguish between patients with and without SPP) and calibration (agreement between the predicted risks and observed frequencies of SPP) of the five updated models in 283 other patients (100 [35%] with SPP). RESULTS: Simple recalibration methods improved the calibration to a similar extent as revision methods that made more extensive adjustments to the original model. Discrimination could not be improved by any of the methods. CONCLUSION: When the performance is poor in new patients, updating methods can be applied to adjust the model, rather than to develop a new model.},
added-at = {2023-02-03T11:44:35.000+0100},
author = {Janssen, K J M and Moons, K G M and Kalkman, C J and Grobbee, D E and Vergouwe, Y},
biburl = {https://www.bibsonomy.org/bibtex/202775a96771ec1512b5fb17f7b00046a/jepcastel},
city = {Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands. k.j.m.janssen@umcutrecht.nl},
doi = {10.1016/j.jclinepi.2007.04.018},
interhash = {82216aeb71a990ef2723becccdda885a},
intrahash = {02775a96771ec1512b5fb17f7b00046a},
isbn = {0895-4356},
issn = {0895-4356},
journal = {Journal of clinical epidemiology},
keywords = {AcuteDisease Adult Aged DataInterpretation Female Humans Male MiddleAged Pain PainMeasurement PainMeasurement:methods Postoperative Postoperative:diagnosis Postoperative:etiology Prognosis RiskFactors SeverityofIllnessIndex Statistical},
month = {1},
note = {4731<br/>JID: 8801383; 2006/08/22 [received]; 2007/03/08 [revised]; 2007/04/20 [accepted]; 2007/11/26 [aheadofprint]; ppublish;<br/>Models predictius; Avaluació de riscs},
number = 1,
pages = {76-86},
pmid = {18083464},
timestamp = {2023-02-03T11:44:35.000+0100},
title = {Updating methods improved the performance of a clinical prediction model in new patients.},
url = {http://www.ncbi.nlm.nih.gov/pubmed/18083464},
volume = 61,
year = 2008
}