Key Concepts in Model Selection: Performance and Generalizability
- PMID: 10733865
- DOI: 10.1006/jmps.1999.1284
Key Concepts in Model Selection: Performance and Generalizability
Abstract
What is model selection? What are the goals of model selection? What are the methods of model selection and how do they work? Which methods perform better than others and in what circumstances? These questions rest on a number of key concepts in a relatively underdeveloped field. The aim of this paper is to explain some background concepts, to highlight some of the results in this special issue, and to add my own. The standard methods of model selection include classical hypothesis testing, maximum likelihood, Bayes method, minimum description length, cross-validation, and Akaike's information criterion. They all provide an implementation of Occam's razor, in which parsimony or simplicity is balanced against goodness-of-fit. These methods primarily take account of the sampling errors in parameter estimation, although their relative success at this task depends on the circumstances. However, the aim of model selection should also include the ability of a model to generalize to predictions in a different domain. Errors of extrapolation, or generalization, are different from errors of parameter estimation. So, it seems that simplicity and parsimony may be an additional factor in managing these errors, in which case the standard methods of model selection are incomplete implementations of Occam's razor. Copyright 2000 Academic Press.
Similar articles
-
Easy computation of the Bayes factor to fully quantify Occam's razor in least-squares fitting and to guide actions.Sci Rep. 2022 Jan 19;12(1):993. doi: 10.1038/s41598-021-04694-7. Sci Rep. 2022. PMID: 35046427 Free PMC article.
-
Akaike's Information Criterion and Recent Developments in Information Complexity.J Math Psychol. 2000 Mar;44(1):62-91. doi: 10.1006/jmps.1999.1277. J Math Psychol. 2000. PMID: 10733858
-
Razor sharp: The role of Occam's razor in science.Ann N Y Acad Sci. 2023 Dec;1530(1):8-17. doi: 10.1111/nyas.15086. Epub 2023 Nov 29. Ann N Y Acad Sci. 2023. PMID: 38018886 Free PMC article.
-
Grasping Occam's razor.Adv Exp Med Biol. 2009;629:499-522. doi: 10.1007/978-0-387-77064-2_27. Adv Exp Med Biol. 2009. PMID: 19227518 Review.
-
Between prolixity and reductionism: psychoanalytic theory and Occam's razor.J Am Psychoanal Assoc. 1991;39(1):71-86. doi: 10.1177/000306519103900104. J Am Psychoanal Assoc. 1991. PMID: 2026857 Review.
Cited by
-
Model-assisted analysis for tuning anthocyanin composition in grape berries.Ann Bot. 2023 Nov 30;132(5):1033-1050. doi: 10.1093/aob/mcad165. Ann Bot. 2023. PMID: 37850481
-
Person-centred Approaches to Psychopathology in the ABCD Study: Phenotypes and Neurocognitive Correlates.Res Child Adolesc Psychopathol. 2023 Aug;51(8):1195-1212. doi: 10.1007/s10802-023-01065-w. Epub 2023 Apr 29. Res Child Adolesc Psychopathol. 2023. PMID: 37119331 Free PMC article.
-
Frequency and types of clusters of major chronic diseases in 0.5 million adults in urban and rural China.J Multimorb Comorb. 2022 May 20;12:26335565221098327. doi: 10.1177/26335565221098327. eCollection 2022. J Multimorb Comorb. 2022. PMID: 35615751 Free PMC article.
-
Green extraction of hemp (Cannabis sativa L.) using microwave method for recovery of three valuable fractions (essential oil, phenolic compounds and cannabinoids): a central composite design optimization study.J Sci Food Agric. 2022 Nov;102(14):6220-6235. doi: 10.1002/jsfa.11971. Epub 2022 May 18. J Sci Food Agric. 2022. PMID: 35485728 Free PMC article.
-
Identifying consumer segments based on COVID-19 pandemic perceptions and responses.J Consum Aff. 2022 Spring;56(1):34-67. doi: 10.1111/joca.12413. Epub 2021 Sep 30. J Consum Aff. 2022. PMID: 34908579 Free PMC article.
LinkOut - more resources
Full Text Sources
Other Literature Sources