Bayesian Optimization of CVaR with Unknown Hyperparameters

We study Bayesian optimization of the Conditional Value-at-Risk (CVaR) of an expensive black-box function that depends on a decision and an environmental variable. Existing no-regret algorithms assume that the correct Gaussian process (GP) kernel and its hyperparameters are known. In practice, however, they must be estimated from limited data, often yielding a misspecified surrogate. This is especially damaging for CVaR because misspecification can distort the estimated tail-risk and thus lead to catastrophic decisions. We propose HE-CV-UCB, the first no-regret algorithm for CVaR Bayesian optimization with unknown GP hyperparameters. Given a finite candidate set containing a well-specified model, HE-CV-UCB adaptively eliminates those inconsistent with the observed data, actively queries where the survivors disagree, and returns a design that is robust across the surviving candidates. We prove that it attains cumulative regret matching the oracle rate of CV-UCB up to a factor depending only on the candidate set's size. Across synthetic benchmarks and three real-world applications, HE-CV-UCB achieves competitive performance and frequently outperforms existing CVaR Bayesian optimization methods.

1. 12 Dec 2024

   Tail Risk Alert Based on Conditional Autoregressive VaR by Regression Quantiles and Machine Learning Algorithms

   The research uses AI to study tail risk in US financial markets, revealing a significant spillover effect from the credit market to the stock market.

   arXivIn 2024 5th International Conference on Artificial Intelligence and Computer Engineering (ICAICE)

   33cites
2. 13 Nov 2024

   Meta-models for transfer learning in source localization

   A Bayesian multilevel approach is used to predict model hyperparameters in acoustic emission experiments, demonstrating its use in source localization.

   Machine learningIn Data-Centric Engineering

   2cites
3. 10 Sep 2024

   $\mu$GUIDE: a framework for quantitative imaging via generalized uncertainty-driven inference using deep learning

   Bayesian Framework for Imaging: The research introduces a Bayesian framework, $\mu$GUIDE, for estimating tissue microstructure parameters from any biophysical model or MRI signal, providing a solution to the high computational and time cost of traditional Bayesian methods.

   Machine learning

   1cites
4. 16 Oct 2026

   What Do Foundation Models for Market Microstructure Learn? A Controlled Study with Synthetic Limit Order Books

   Autoregressive transformers trained on limit-order-book message streams learn amortized Bayesian inference over market regimes, matching optimal prediction and enabling accurate parameter calibration.

   arXiv

   4fanfare
5. 30 Apr 2025

   An Automated Hyperparameter Tuning Approach For Optimizing Machine Learning Model Performance

   The study suggests a new automated method for fine-tuning machine learning models using optimization techniques like Bayesian Optimization, Genetic Algorithms, and Reinforcement Learning.

   SSRN

   0cites
6. 12 Oct 2023

   Machine learning in algorithmic investment strategies on global stock markets

   Algorithmic investment strategies using machine learning models perform better than passive strategies, with Linear Support Vector Machine and Bayesian Generalized Linear Model being the most effective, research shows.

   RePEc

   31shares