Lewandowski-Kurowicka-Joe distribution
Notation
Parameters (shape)
Support is a positive-definite matrix with unit diagonal
Mean the identity matrix

In probability theory and Bayesian statistics, the Lewandowski-Kurowicka-Joe distribution, often referred to as the LKJ distribution, is a probability distribution over positive definite symmetric matrices with unit diagonals.[1]

Introduction

edit

The LKJ distribution was first introduced in 2009 in a more general context [2] by Daniel Lewandowski, Dorota Kurowicka, and Harry Joe. It is an example of the vine copula, an approach to constrained high-dimensional probability distributions.

The distribution has a single shape parameter and the probability density function for a matrix is

with normalizing constant , a complicated expression including a product over Beta functions. For , the distribution is uniform over the space of all correlation matrices; i.e. the space of positive definite matrices with unit diagonal.

Usage

edit

The LKJ distribution is commonly used as a prior for correlation matrix in Bayesian hierarchical modeling. Bayesian hierarchical modeling often tries to make an inference on the covariance structure of the data, which can be decomposed into a scale vector and correlation matrix.[3] Instead of the prior on the covariance matrix such as the inverse-Wishart distribution, LKJ distribution can serve as a prior on the correlation matrix along with some suitable prior distribution on the scale vector. It has been implemented in several probabilistic programming languages, including Stan and PyMC.

References

edit
  1. ^ Gelman, Andrew; Carlin, John B.; Stern, Hal S.; Dunson, David B.; Vehtari, Aki; Rubin, Donald B. (2013). Bayesian Data Analysis (Third ed.). Chapman and Hall/CRC. ISBN 978-1-4398-4095-5.
  2. ^ Lewandowski, Daniel; Kurowicka, Dorota; Joe, Harry (2009). "Generating Random Correlation Matrices Based on Vines and Extended Onion Method". Journal of Multivariate Analysis. 100 (9): 1989–2001. doi:10.1016/j.jmva.2009.04.008.
  3. ^ Barnard, John; McCulloch, Robert; Meng, Xiao-Li (2000). "Modeling Covariance Matrices in Terms of Standard Deviations and Correlations, with Application to Shrinkage". Statistica Sinica. 10 (4): 1281–1311. ISSN 1017-0405. JSTOR 24306780.
edit

📚 Artikel Terkait di Wikipedia

Disintegration theorem

theorem Joint probability distribution – Type of probability distribution Copula (statistics) – Statistical distribution for dependence between random variables

Vanja Dukic

Journal of the American Statistical Association, Bayesian Analysis, and Statistica Sinica, and as the statistical advisor to the editorial board of Radiology

List of statistics articles

Conway–Maxwell–Poisson distribution Cook's distance Cophenetic correlation Copula (statistics) Cornish–Fisher expansion Correct sampling Correction for attenuation