Efficient constrained Gaussian process approximation using elliptical slice sampling - FAYOL / DEMO : Décision en Entreprise : Modélisation, Optimisation Access content directly
Preprints, Working Papers, ... Year : 2024

Efficient constrained Gaussian process approximation using elliptical slice sampling

Abstract

In this paper, Bayesian shape-restricted function estimation using constrained Gaussian processes (GPs) is revisited. The finite-dimensional Gaussian process approximation proposed in [H. Maatouk and X. Bay. Gaussian process emulators for computer experiments with inequality constraints. Mathematical Geosciences, 49(5):557–582, 2017] is considered. This approximation verifies a wide range of shape constraints such as monotonicity, convexity and boundedness constraints in the entire domain. Through this approach, shape constraints are reformulated as equivalent linear inequality constraints on the basis coefficients. To generate a sample from the resulting constrained posterior distribution, we employ a recently efficient circulant embedding technique. This technique involves absorbing a smooth relaxation of the constraint set into the likelihood, a prior distribution, and elliptical slice sampling (ESS). Our contribution in this article is threefold. First, we extend this technique to address sets of linear, quadratic and nonlinear inequalities, enabling the incorporation of more general and multiple shape constraints. These constraints can be applied individually, jointly, and sequentially. Furthermore, this generalization allows the proposed approach to be easily adapted to other basis functions and models. Second, we explore efficient samplers to approximate both the posterior and prior distributions, including Hamiltonian Monte Carlo and the Fast Fourier Transform. Furthermore, we employ a highly efficient, large-scale approach for sampling from the prior distribution, resulting in significant computational advantages. Third, we investigate the capability of this approach to handle higher-dimensional input spaces and manage a large number of observations. The proposed approach demonstrates flexibility, accuracy, and efficiency in both synthetic and real data studies.
Fichier principal
Vignette du fichier
Efficient_Bayesian_CGP.pdf (946.39 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04496474 , version 1 (08-03-2024)

Identifiers

  • HAL Id : hal-04496474 , version 1

Cite

Hassan Maatouk, Didier Rullière, Xavier Bay. Efficient constrained Gaussian process approximation using elliptical slice sampling. 2024. ⟨hal-04496474⟩
41 View
27 Download

Share

Gmail Mastodon Facebook X LinkedIn More