A note on Likelihood and Likelihood Based Inference

Statistical inference aims to draw conclusions about unknown parameters using observed data. Among the various inferential frameworks, likelihood-based inference occupies a central position because it provides a direct measure of the support that observed data give to competing parameter values. This paper presents a concise review of the likelihood function and its role in statistical inference. The concept of likelihood is introduced for both discrete and continuous probability models, emphasizing its interpretation as a measure of relative evidence rather than a probability distribution for the parameter. Several illustrative examples, including binomial, normal, and exponential models, demonstrate the construction and interpretation of likelihood functions. The paper discusses important properties of likelihood, including invariance under multiplication by positive constants and the combination of independent likelihoods through multiplication. Connections between likelihood and Bayesian inference are examined, showing how posterior information can be viewed as the product of prior and current likelihood information. Fundamental principles of likelihood-based inference, including the Likelihood Principle and the Stopping Rule Principle, are reviewed with classical examples. The role of maximum likelihood estimation as a practical method for parameter estimation is also highlighted. The discussion illustrates how the likelihood function serves as a compact and informative summary of statistical evidence, providing a unified framework for estimation and inference.

Likelihood Function; Likelihood-Based Inference; Likelihood Principle; Maximum Likelihood Estimation; Bayesian Inference; Stopping Rule Principle; Statistical Evidence; Parameter Estimation.

1. Basu, D. (1975). Statistical Information and Likelihood. Sankhya Series A, 37, 1–71 [Google Scholar] [Crossref]

2. Birnbaum, A. (1972). On the Foundations of Statistical Inference. Journal of the American Statistical Association, 57(298), 269–306. [Google Scholar] [Crossref]

3. Birnbaum, A. (1972). More concepts of statistical evidence. Journal of the American Statistical Association 67, 858–861. [Google Scholar] [Crossref]

4. Casella G. and Berger R. L. (2002). Statistical Inference. Duxbury Press. [Google Scholar] [Crossref]

5. Cox D. R. (2006). Principles of Statistical Inference. Cambridge University Press. [Google Scholar] [Crossref]

6. Edwards A. W. F. (1992). Likelihood. Johns Hopkins University Press. [Google Scholar] [Crossref]

7. Fisher R. A. (1922). On the Mathematical Foundations of Theoretical Statistics. Philosophical Transactions of the Royal Society A, 222, 309–368. [Google Scholar] [Crossref]

8. Lehmann E. L. and Casella G. (1998). Theory of Point Estimation. Springer. [Google Scholar] [Crossref]

9. Pawitan Y. (2001) In All Likelihood: Statistical Modelling and Inference Using Likelihood. Oxford University Press. [Google Scholar] [Crossref]

10. Royall R.(1997) Statistical Evidence: A Likelihood Paradigm. Chapman & Hall. [Google Scholar] [Crossref]

• Enhancing Formation Control of Multi Agent Systems Using Ann Based Technique
• Improving Sliding Mode Control with Chattering Reduction using Fuzzy Based Technique
• Cooking Quality, Fasting Blood Glucose, Glycemic Index and Load of High–Fiber Noodles Made from Wheat, Tiger Nut Residue and Cassava Flour Blends
• Matrix Rhythm Therapy Versus Interferential Therapy Combined with Lumbar Stabilization Exercises in Chronic Non-Specific Low Back Pain: A Randomized Comparative Trial
• Formulation and Sensory Evaluation of Functional Cake Prepared from Sweet Potato Powder