Home

lnP

lnP is the natural logarithm of a probability or likelihood value, commonly used in statistics and probability theory. The letter P denotes a probability, which may represent either the probability of observed data under a model (the likelihood) or a probability distribution's probability mass or density. Since ln uses base e, ln P is the natural log of P. When P is a likelihood, ln P is called the log-likelihood.

For a dataset x and a parameter vector θ, the likelihood L(θ) = P(x | θ). The log-likelihood is l(θ)

Optimization uses l(θ) rather than L(θ) for maximum likelihood estimation. The score s(θ) = ∂l/∂θ; the observed

Cautions: ln P is defined only for P > 0; zero probabilities yield -∞, requiring care with zero-probability

=
ln
L(θ)
=
∑
ln
p(x_i
|
θ)
for
independent
observations.
Taking
the
log
turns
products
into
sums,
improves
numerical
stability,
and
simplifies
differentiation.
information
I(θ)
=
-∂^2
l/∂θ^2.
The
log-likelihood
ratio
statistic
compares
models
by
2(l1
-
l0).
In
Bayesian
practice,
the
log-likelihood
is
combined
with
a
prior
to
form
the
log-posterior:
ln
p(θ|x)
=
l(θ)
+
ln
p(θ)
-
ln
p(x).
events
or
the
use
of
regularization
or
smoothing.
In
practice,
ln
P
values
depend
on
the
chosen
probability
model
and
data;
ln
denotes
the
natural
logarithm
by
convention
in
statistical
work.