Let X1, . . . , Xn denote a random sample from a N(μ, σ2) distribution, where the mean μ and the variance σ2 are both unknown so that the param- eter vector is given by θ = (μ, σ2)T .Give the parametric function g(θ) that defines the quantile of order α of the normal distribution in terms of μ,σ, and the corresponding quantile zα of the standard normal distribution. (viii) Find the ML estimate of g(θ). (x) Derive the bias of g(θˆ) as an estimator of g(θ) and use it to provide a bias-corrected estimator g ̃ of g(θ).
Question
Let X1, . . . , Xn denote a random sample from a N(μ, σ2) distribution, where the mean μ and the variance σ2 are both unknown so that the param- eter vector is given by θ = (μ, σ2)T .Give the parametric function g(θ) that defines the quantile of order α of the normal distribution in terms of μ,σ, and the corresponding quantile zα of the standard normal distribution. (viii) Find the ML estimate of g(θ). (x) Derive the bias of g(θˆ) as an estimator of g(θ) and use it to provide a bias-corrected estimator g ̃ of g(θ).
Solution
(viii) The quantile of order α of the normal distribution is given by the parametric function g(θ) = μ + σ*zα, where zα is the α-quantile of the standard normal distribution.
The maximum likelihood (ML) estimates of μ and σ^2 are μˆ = ∑xi / n and σˆ^2 = ∑(xi - μˆ)^2 / n, respectively.
So, the ML estimate of g(θ) is g(θˆ) = μˆ + sqrt(σˆ^2)*zα.
(x) The bias of an estimator is defined as the expected difference between the estimator and the parameter it is estimating. In this case, we want to find the bias of g(θˆ) as an estimator of g(θ) = μ + σ*zα.
Bias(g(θˆ)) = E[g(θˆ)] - g(θ)
Since g(θˆ) = μˆ + sqrt(σˆ^2)*zα, we have E[g(θˆ)] = E[μˆ] + E[sqrt(σˆ^2)*zα].
We know that E[μˆ] = μ and E[sqrt(σˆ^2)zα] = σzα because the ML estimates are unbiased. So,
Bias(g(θˆ)) = μ + σzα - (μ + σzα) = 0.
Therefore, g(θˆ) is an unbiased estimator of g(θ), and there is no need for bias correction. The bias-corrected estimator g ̃ of g(θ) is simply g(θˆ) itself.
Similar Questions
Give the parametric function g(θ) that defines the quantile of order α of the normal distribution in terms of μ,σ, and the corresponding quantile zα of the standard normal distribution.
Let X1, . . . , Xn denote a random sample from a N(μ, σ2) distribution, where the mean μ and the variance σ2 are both unknown so that the param- eter vector is given by θ = (μ, σ2)T (i) Show that the joint p.d.f. of X1, . . . , Xn belongs to the two-parameter regular exponential family, stating what the canonical parameter is equal to in terms of θ. (ii) Use the result in (i) to derive the maximum likelihood (ML) estimate of θ, θˆ = (μˆ, σˆ2)T ,
LetX = (X1, . . . , Xn)Tdenote a random sample of size n on a discrete random variable X which hasprobability function f (x; θ), where θ is an unknown parameter.Suppose we wish to estimate f (k; θ), the probability that X is equal to agiven arbitrary (non-negative) integer k. We shall subsequently write f (k; θ)as the function g(θ), suppressing its dependence on the value k.Let U (X1) be a statistic defined as:U (X1) ={1, X1 = k,0, otherwise.(i) On letting T (X1, ..., Xn) denote a sufficient statistic for θ, show thatW (T ) = E{U (X1) | T (X1, ..., Xn)}is a statistic; that is, explain why it does not depend on θ.(ii) Show that W (T ) is an unbiased estimator of g(θ).(iii) Without assuming the result of any theorem, show that the variance ofW (T ) will be less than the variance of U unless U is constant given Twhere in this case W will have the same variance as U .(iv) Explain why W (T ) is the UMVU estimator of g(θ) in the case whereT is a complete, minimal sufficient statistic for θ.
the moment estimator of θ;• the MLE of θ
Let X1, . . . , Xn denote a random sample from a N (µ, σ2) distribution,where the mean µ and the variance σ2 are both unknown so that the param-eter vector is given byθ = (µ, σ2)T .(i) Show that the joint p.d.f. of X1, . . . , Xn belongs to the two-parameterregular exponential family, stating what the canonical parameter isequal to in terms of θ.
Upgrade your grade with Knowee
Get personalized homework help. Review tough concepts in more detail, or go deeper into your topic by exploring other relevant questions.