Bernoulli distribution: Important properties and comparison of estimation methods

Authors
Keywords:
Bernoulli Distribution, Maximum Likelihood Estimation, Bayes method, Point Estimation, Regression Models
Abstract
The Bernoulli distribution (BD) is a fundamental member of the binary distribution family, with widespread and impactful applications across various fields. It plays a pivotal role in the construction of zero-inflated (ZI) distributions, which require a two-process framework - one of which is governed by the BD. This study aims to explore the key properties of the BD and evaluate the performance of three widely used parameter estimation techniques: Method of Moments (MM), Maximum Likelihood Estimation (MLE), and Bayesian Method (BM). Through extensive simulation studies and analysis of real-world datasets, we assess the accuracy and practicality of each method. The results demonstrate that both MLE and BM yield highly reliable estimates, with MLE offering a more straightforward implementation. Consequently, MLE may be preferable in scientific applications where ease of use is a priority.
References

[1] Yasin Altinisik and Emel Cankaya, New zero-inflated regression models with a variant of censoring, Brazilian Journal of Probability and Statistics 36 (2022), no. 4, 641–674.

[2] Sirinapa Aryuyuen, Winai Bodhisuwan, and Thidaporn Supapakorn, Zero inflated negative binomial-generalized exponential distribution and its applications, Songklanakarin Journal of Science and Technology 36 (2014), no. 4, 483–491.

[3] Yupapin Atikankul, A New Poisson Generalized Lindley Regression Model, Austrian Journal of Statistics 52 (2023), no. 1, 39–50.

[4] Gladys DC Barriga and Francisco Louzada, The zero-inflated Conway–Maxwell–Poisson distribution: Bayesian inference, regression modeling and influence diagnostic, Statistical Methodology 21 (2014), 23–34.

[5] James O. Berger, Statistical decision theory and Bayesian analysis, Springer Science & Business Media, 2013.

[6] Whitten Betty Jones and A. Clifford Cohen, Further considerations of modified moment estimators for Weibull and lognormal parameters, Communications in Statistics-Simulation and Computation 25 (1996), no. 3, 749–784.

[7] J. V. Carnahan, Maximum likelihood estimation for the 4-parameter beta distribution, Communications in Statistics-Simulation and Computation 18 (1989), no. 2, 513–536.

[8] Zdeněk Fabián, Score function of distribution and revival of the moment method, Communications in Statistics-Theory and Methods 45 (2016), no. 4, 1118–1136.

[9] Malay Ghosh, Nonparametric empirical Bayes estimation of certain functionals, Communications in Statistics-Theory and Methods 14 (1985), no. 9, 2081–2094.

[10] Md Mobarak Hossain, Tomasz J. Kozubowski, and Krzysztof Podgórski, A novel weighted likelihood estimation with empirical Bayes flavor, Communications in Statistics-Simulation and Computation 47 (2018), no. 2, 392–412.

[11] Kirtee K. Kamalja and Yogita S. Wagh, Estimation in zero-inflated Generalized Poisson distribution, Journal of Data Science 16 (2018), no. 1, 183–206.

[12] S. Lalitha and Anand Mishra, Modified maximum likelihood estimation for Rayleigh distribution, Communications in Statistics-Theory and Methods 25 (1996), no. 2, 389–401.

[13] Shen-Ming Lee, Kim-Hung Pho, and Chin-Shang Li, Validation likelihood estimation method for a zero-inflated Bernoulli regression model with missing covariates, Journal of Statistical Planning and Inference 214 (2021), 105–127.

[14] Erich L. Lehmann and George Casella, Theory of point estimation, Springer, 1998.

[15] Artur J. Lemonte, Germán Moreno-Arenas, and Fredy Castellares, Zero-inflated Bell regression models for count data, Journal of Applied Statistics (2020).

[16] Roderick J. A. Little, Regression with missing X’s: a review, Journal of the American Statistical Association 87 (1992), no. 420, 1227–1237.

[17] Karl Pearson, On the systematic fitting of curves to observations and measurements, Biometrika 1 (1902), no. 3, 265–303.

[18] Kim-Hung Pho, Zero-inflated probit Bernoulli model: A new model for binary data, Communications in Statistics-Simulation and Computation (2023), 1–21.

[19] Luisa Rivas and Francisca Campos, Zero inflated Waring distribution, Communications in Statistics-Simulation and Computation 52 (2023), no. 8, 3676–3691.

[20] Pornpop Saengthong, Winai Bodhisuwan, and Ampai Thongteeraparp, The zero inflated negative binomial–Crack distribution: some properties and parameter estimation, Songklanakarin J. Sci. Technol 37 (2015), no. 6, 701–711.

[21] K. M. Sakthivel, C. S. Rajitha, and K. B. Alshad, Zero-inflated negative binomial-Sushila distribution and its application, International Journal of Pure and Applied Mathematics 117 (2017), no. 13, 117–126.

[22] C. Satheesh Kumar and Rakhi Ramachandran, On zero-inflated hyper-Poisson distribution and its applications, Communications in Statistics-Simulation and Computation 51 (2020), no. 3, 868–881.

[23] Joseph L. Schafer and John W. Graham, Missing data: our view of the state of the art, Psychological Methods 7 (2002), no. 2, 147.

[24] S. Singh, A note on inflated Poisson distribution, Journal of the Indian Statistical Association 33 (1963), no. 1, 140–144.

[25] Caner Tanıs, Haydar Koç, and Ahmet Pekgör, A new zero–inflated discrete Lindley regression model, Communications in Statistics-Theory and Methods 53 (2024), no. 12, 4252–4271.

[26] Buu-Chau Truong, Van-Buol Nguyen, Hoang-Vinh Truong, and Thi Diem-Chinh Ho, Comparison of optim, nleqslv and MaxLik to estimate parameters in some of regression models, Journal of Advanced Engineering and Computation 3 (2019), no. 4, 532–550.

[27] Mohammad Kafeel Wani and Peer Bilal Ahmad, Zero-inflated Poisson-Akash distribution for count data with excessive zeros, Journal of the Korean Statistical Society 52 (2023), no. 3, 647–675.

Additional Files
Published
11-12-2025
Section
Research Article
License

Copyright (c) 2025 Sal Ly

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

Bernoulli distribution: Important properties and comparison of estimation methods. (2025). Letters on Applied and Pure Mathematics, 3(1), 11-34. https://doi.org/10.66147/lapm.20253129

Similar Articles

You may also start an advanced similarity search for this article.