MLINFO COLLECTION

Bayesian Optimization

少数試行で条件探索を進めるベイズ最適化、実験計画、ブラックボックス最適化を扱います。

記事一覧

13 / 18
arxiv

Harnessing Language Models as Optimization Modeling Agents

Large language models (LLMs) can translate natural-language optimization problems into solver programs, but reliably producing correct formulations and implementations remains challenging. Existing…

deep-learning
arxiv

Continuous-depth Deep Gaussian Processes

Deep Gaussian processes (DGPs) are appealing Bayesian regression models, but their standard discrete-depth parameterization often becomes harder to optimize as depth grows. We argue that depth is…

deep-learning
arxiv

Scaling Laws for Generative Reward Models

We study generative reward models (GenRMs) as online preference providers for policy optimization in creative writing. Across Qwen3 reward-model sizes from 0.6B to 14B, Thinking judges trained with…

nlp
arxiv

A Statistical Viewpoint on Adam, Shampoo and Muon

We provide new statistical insights into designing stochastic optimization methods. By modeling the gradient via a normal distribution, we argue that the stochastic gradient should be whitened using…

deep-learning
arxiv

Martingale Posterior Cox Processes

Cox processes provide a principled Bayesian nonparametric framework for modeling event-based data through an underlying intensity function. However, existing inference methods for estimating the…

computer-vision
arxiv

Private Evaluation of High-Dimensional Functions

We study differentially private black-box evaluation of arbitrary high-dimensional functions. Given a dataset $S$ and query access to a function $f$---whose sensitivity may be unknown or…

deep-learning
arxiv

Incentive Alignment in Online Experimentation

Evaluating the causal effect of new features is a central goal for online platforms. While recent literature addresses limited testing traffic via centralized portfolio optimization, this perspective…

nlp