As above, under the statistical model ( \{ 1,2,3 \} , \{ \mathbf{P}_{\mathbf{p}} \} _{\mathbf{p} \in \Delta _3}), we have

L_{12}(\mathbf{x}, \mathbf{p}) = p_1^ A p_2^ B p_3^ C

where

\mathbf{x} = 1, 3, 1, 2, 2, 2, 1, 1, 3, 1, 1, 2.

In the previous problem, you found the specific values for A, B, and C.

Recall that the MLE is given by

\widehat{\mathbf{p}}^{MLE}_ n = \text {argmax}_{\mathbf{p} \in \Delta _3} \log L_ n(X_1, \ldots , X_ n, \mathbf{p}).

By the theory of Lagrange multipliers, one can show that the maximum occurs at the point \mathbf{p} such that there exists \lambda \neq 0 so that

\nabla \log L_ n (X_1, \ldots , X_ n, \mathbf{p}) = \lambda \begin{bmatrix} 1 \\ 1 \\ 1 \end{bmatrix}.

(The gradient above is taken with respect to the parameter \mathbf{p}.)

Using this result and the previous problem, what is the estimate \widehat{\mathbf{p}}^{MLE}_{12} for \mathbf{p} given the data set \mathbf{x}?

(\widehat{\mathbf{p}}^{MLE}_{12})_1 =
unanswered (\widehat{\mathbf{p}}^{MLE}_{12})_2 =
unanswered (\widehat{\mathbf{p}}^{MLE}_{12})_3 =

1 answer

To find the MLE estimate for p given the data set x, we need to maximize the log-likelihood function.

First, let's calculate the log-likelihood function L_n(x, p):

L_n(x, p) = log(p_1^A * p_2^B * p_3^C)
= Alog(p_1) + Blog(p_2) + Clog(p_3)

Next, let's calculate the gradient of the log-likelihood function:

∇logL_n(x, p) = (∂/∂p_1)(Alog(p_1) + Blog(p_2) + Clog(p_3))i + (∂/∂p_2)(Alog(p_1) + Blog(p_2) + Clog(p_3))j + (∂/∂p_3)(Alog(p_1) + Blog(p_2) + Clog(p_3))k

= A/p_1 * i + B/p_2 * j + C/p_3 * k

Now, using the result from the previous problem where A = 5, B = 4, and C = 4, we can solve for p that satisfies the following equation:

∇logL_n(x, p) = λ[1 1 1]

Which can be written as:

5/p_1 * i + 4/p_2 * j + 4/p_3 * k = λ * [1 1 1]

Comparing the coefficients, we have:

5/p_1 = 4/p_2 = 4/p_3

Simplifying further:

p_1 = (5/4) * p_2 = (5/4) * p_3

From this equation, we can solve for p_1, p_2, and p_3 as follows:

p_1 = 5/(5 + 4 + 4) = 5/13
p_2 = 4/(5 + 4 + 4) = 4/13
p_3 = 4/(5 + 4 + 4) = 4/13

Therefore, the MLE estimate for p given the data set x is:

(\hat{p}^{MLE}_{12})_1 = 5/13
(\hat{p}^{MLE}_{12})_2 = 4/13
(\hat{p}^{MLE}_{12})_3 = 4/13