Hyper-parameter optimization for latent spaces

Veloso, B.; Carprese, L.; König, H.M.T.; Teixeira S.; Manco, G.; Hoos, H.H.; Gama, J. (2021)

Article in monograph or in proceedings

We present an online optimization method for time-evolving data streams that can automatically adapt the hyper-parameters of an embedding model. More specifically, we employ the Nelder-Mead algorithm, which uses a set of heuristics to produce and exploit several potentially good configurations, from which the best one is selected and deployed. This step is repeated whenever the distribution of the data is changing. We evaluate our approach on streams of real-world as well as synthetic data, wherethe latter is generated in such way that its characteristics change over time (concept drift). Overall, we achieve good performance in terms of accuracy compared to state-of-the-art AutoML techniques.

• AutoML
• Hyper-parameter optimization
• Latent spaces
• Nelder-mead algorithm
• SMAC
• Recommender systems

• All authors: Veloso, B.; Carprese, L.; König, H.M.T.; Teixeira S.; Manco, G.; Hoos, H.H.; Gama, J.
• Editor(s): Oliver, N.; Pérez-Cruz, F.; Kramer, S.; Read, J.; Lozano, J.A.
• Date: 2021
• Title of host publication: Machine Learning and Knowledge Discovery in Databases. Research Track. ECML PKDD 2021
• Pages: 249 - 264
• ISBN (print): 9783030865221
• ISBN (electronic): 9783030865238
• DOI: doi:10.1007/978-3-030-86523-8_16
• Name: 12977
• Conference: Joint European Conference on Machine Learning and Knowledge Discovery in Databasis. ECML PKDD 2021
• Date: 2021-09-13 - 2021-09-17
• Location: Bilbao, Spain