Experiments with AdaBoost.RT, an improved boosting scheme for regression
- PMID: 16764518
- DOI: 10.1162/neco.2006.18.7.1678
Experiments with AdaBoost.RT, an improved boosting scheme for regression
Abstract
The application of boosting technique to regression problems has received relatively little attention in contrast to research aimed at classification problems. This letter describes a new boosting algorithm, AdaBoost.RT, for regression problems. Its idea is in filtering out the examples with the relative estimation error that is higher than the preset threshold value, and then following the AdaBoost procedure. Thus, it requires selecting the suboptimal value of the error threshold to demarcate examples as poorly or well predicted. Some experimental results using the M5 model tree as a weak learning machine for several benchmark data sets are reported. The results are compared to other boosting methods, bagging, artificial neural networks, and a single M5 model tree. The preliminary empirical comparisons show higher performance of AdaBoost.RT for most of the considered data sets.
Similar articles
-
SemiBoost: boosting for semi-supervised learning.IEEE Trans Pattern Anal Mach Intell. 2009 Nov;31(11):2000-14. doi: 10.1109/TPAMI.2008.235. IEEE Trans Pattern Anal Mach Intell. 2009. PMID: 19762927
-
Boosting multiclass learning with repeating codes and weak detectors for protein subcellular localization.Bioinformatics. 2007 Dec 15;23(24):3374-81. doi: 10.1093/bioinformatics/btm497. Epub 2007 Oct 22. Bioinformatics. 2007. PMID: 17956879
-
Machine learning in bioinformatics: a brief survey and recommendations for practitioners.Comput Biol Med. 2006 Oct;36(10):1104-25. doi: 10.1016/j.compbiomed.2005.09.002. Epub 2005 Oct 13. Comput Biol Med. 2006. PMID: 16226240 Review.
-
Robustifying AdaBoost by adding the naive error rate.Neural Comput. 2004 Apr;16(4):767-87. doi: 10.1162/089976604322860695. Neural Comput. 2004. PMID: 15025829
-
Artificial intelligence in molecular biology: a review and assessment.Philos Trans R Soc Lond B Biol Sci. 1994 Jun 29;344(1310):353-62; discussion 362-3. doi: 10.1098/rstb.1994.0074. Philos Trans R Soc Lond B Biol Sci. 1994. PMID: 7800705 Review.
Cited by
-
Efficacy of the methods of age determination using artificial intelligence in panoramic radiographs - a systematic review.Int J Legal Med. 2024 Jul;138(4):1459-1496. doi: 10.1007/s00414-024-03162-x. Epub 2024 Feb 24. Int J Legal Med. 2024. PMID: 38400923
-
Machine Learning Models for Predicting the Risk of Hard-to-Heal Diabetic Foot Ulcers in a Chinese Population.Diabetes Metab Syndr Obes. 2022 Oct 29;15:3347-3359. doi: 10.2147/DMSO.S383960. eCollection 2022. Diabetes Metab Syndr Obes. 2022. PMID: 36341229 Free PMC article.
-
Using machine learning to improve the accuracy of genomic prediction of reproduction traits in pigs.J Anim Sci Biotechnol. 2022 May 17;13(1):60. doi: 10.1186/s40104-022-00708-0. J Anim Sci Biotechnol. 2022. PMID: 35578371 Free PMC article.
-
Adaboost-Based Machine Learning Improved the Modeling Robust and Estimation Accuracy of Pear Leaf Nitrogen Concentration by In-Field VIS-NIR Spectroscopy.Sensors (Basel). 2021 Sep 18;21(18):6260. doi: 10.3390/s21186260. Sensors (Basel). 2021. PMID: 34577467 Free PMC article.
-
Alcoholic EEG signal classification with Correlation Dimension based distance metrics approach and Modified Adaboost classification.Heliyon. 2020 Dec 16;6(12):e05689. doi: 10.1016/j.heliyon.2020.e05689. eCollection 2020 Dec. Heliyon. 2020. PMID: 33364482 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources
