Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userObjective Bayesian approach to the Jeffreys-Lindley paradox
304
0
0.0
(
0
)
Added by
Andrew Fowlie Assoc. Prof.
Publication date
2020
fields
Mathematical Statistics
and research's language is
English
Authors
Andrew Fowlie
Ask ChatGPT about the research
No Arabic abstract
We consider the Jeffreys-Lindley paradox from an objective Bayesian perspective by attempting to find priors representing complete indifference to sample size in the problem. This means that we ensure that the prior for the unknown mean and the prior predictive for the $t$-statistic are independent of the sample size. If successful, this would lead to Bayesian model comparison that was independent of sample size and ameliorate the paradox. Unfortunately, it leads to an improper scale-invariant prior for the unknown mean. We show, however, that a truncated scale-invariant prior delays the dependence on sample size, which could be practically significant. Lastly, we shed light on the paradox by relating it to the fact that the scale-invariant prior is improper.
rate research
Read More
In this paper we propose to make Bayesian inferences for the parameters of the Lomax distribution using non-informative priors, namely the Jeffreys prior and the reference prior. We assess Bayesian estimation through a Monte Carlo study with 500 simulated data sets. To evaluate the possible impact of prior specification on estimation, two criteria were considered: the bias and square root of the mean square error. The developed procedures are illustrated on a real data set.
A common problem in ultra-high energy cosmic ray physics is the comparison of energy spectra. The question is whether the spectra from two experiments or two regions of the sky agree within their statistical and systematic uncertainties. We develop a method to directly compare energy spectra for ultra-high energy cosmic rays from two different regions of the sky in the same experiment without reliance on agreement with a theoretical model of the energy spectra. The consistency between the two spectra is expressed in terms of a Bayes factor, defined here as the ratio of the likelihood of the two-parent source hypothesis to the likelihood of the one-parent source hypothesis. Unlike other methods, for example chi^2 tests, the Bayes factor allows for the calculation of the posterior odds ratio and correctly accounts for non-Gaussian uncertainties. The latter is particularly important at the highest energies, where the number of events is very small.
Variational approaches to approximate Bayesian inference provide very efficient means of performing parameter estimation and model selection. Among these, so-called variational-Laplace or VL schemes rely on Gaussian approximations to posterior densities on model parameters. In this note, we review the main variants of VL approaches, that follow from considering nonlinear models of continuous and/or categorical data. En passant, we also derive a few novel theoretical results that complete the portfolio of existing analyses of variational Bayesian approaches, including investigations of their asymptotic convergence. We also suggest practical ways of extending existing VL approaches to hierarchical generative models that include (e.g., precision) hyperparameters.
We assess the accuracy of Bayesian polynomial extrapolations from small parameter values, x, to large values of x. We consider a set of polynomials of fixed order, intended as a proxy for a fixed-order effective field theory (EFT) description of data. We employ Bayesian Model Averaging (BMA) to combine results from different order polynomials (EFT orders). Our study considers two toy problems where the underlying function used to generate data sets is known. We use Bayesian parameter estimation to extract the polynomial coefficients that describe these data at low x. A naturalness prior is imposed on the coefficients, so that they are O(1). We Bayesian-Model-Average different polynomial degrees by weighting each according to its Bayesian evidence and compare the predictive performance of this Bayesian Model Average with that of the individual polynomials. The credibility intervals on the BMA forecast have the stated coverage properties more consistently than does the highest evidence polynomial, though BMA does not necessarily outperform every polynomial.
We investigate Bayesian and frequentist approaches to resonance searches using a toy model based on an ATLAS search for the Higgs boson in the diphoton channel. We draw pseudo-data from the background only model and background plus signal model at multiple luminosities, from $10^{-3}$/fb to $10^7$/fb. We chart the change in the Bayesian posterior of the background only model and the global p-value. We find that, as anticipated, the posterior converges to certainty about the model as luminosity increases. The p-value, on the other hand, randomly walks between 0 and 1 if the background only model is true, and otherwise converges to 0. After briefly commenting on the frequentist properties of the posterior, we make a direct comparison of the significances obtained in Bayesian and frequentist frameworks. We find that the well-known look-elsewhere effect reduces local significances by about 1$sigma$. We furthermore find that significances from our Bayesian framework are typically about 1 to 2$sigma$ smaller than the global significances, though the reduction depends on the prior, global significance and integrated luminosity. This suggests that even global significances could significantly overstate the evidence against the background only model. We checked that this effect --- the Bayes effect --- was robust with respect to fourteen choices of prior and investigated the Jeffreys-Lindley paradox for three of them.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
