Study on Acquisition Functions
Conference: ICMLCA 2021 - 2nd International Conference on Machine Learning and Computer Application
12/17/2021 - 12/19/2021 at Shenyang, China
Proceedings: ICMLCA 2021
Pages: 5Language: englishTyp: PDF
Personal VDE Members are entitled to a 10% discount on this title
Authors:
Sun, Yiming (Wellington School Ayr, Ayrshire, UK)
Wu, Zhengyang (Guanghua Cambridge International School, Shanghai, China)
Gu, Haoyu (Shanghai Experimental Foreign Language School, Shanghai, China)
Zhou, Yuguang (International Department, The Affiliated High School of SCNU, Guangzhou, China)
Abstract:
This paper is about statistical Machine Learning’s hyperparameter tuning, using Bayesian Optimization and its Acquisition Functions (AF). We coded on Python and carried out a simple SVM classification task. In conclusion, by comparison the most balanced in exploration and exploitation and well performed AF is the Expected Improvement (EI) AF. Then, an enhanced Acquisition function is proposed, the Modified EI, including noise. Future attempts are needed to be carried out on different task types to prove its superiority.