Expectation Maximization Algorithm: A Review

Authors

  • Md. Masum Bhuiyan Lecturer, Dept of CSE, JU
  • Samsun Nahar Khandakar Assistant Professor
  • Nadia Afrin Ritu Assistant Professor, Dept of CSE, JU
  • Md. Imdadul Islam Professor, Dept of CSE, JU

Abstract

The Expectation-Maximization (EM) model is used to evaluate the maximum likelihood of parameters of a statistical model using an iterative method. The EM algorithm is applicable when the given data set is incomplete, i.e., data has two parts: one is the observed variable (known), the other is the latent variable. Latent (hidden) variables are not directly observed but inferred from observed variables using some mathematical model. Before using the EM algorithm, we need to understand observed variables, latent variables, likelihood, and Jensen’s inequalities. In this review work, the basic theory of all the mathematical models used in the implementation of the EM algorithm, operational steps of the algorithm with explanation, and numerical examples are shown explicitly to get a clear concept of it.

Author Biographies

Md. Masum Bhuiyan, Lecturer, Dept of CSE, JU

Mr. Masum Bhuiyan is a Lecturer in the Department of Computer Science and Engineering at Jahangirnagar University, , teaching and researching AI/ML-based real-world applications. With a distinguished background as a former Software Engineer at Samsung R&D Institute, where he contributed to the development of the Samsung Galaxy Watch and worked on a patent-pending technology graded A1(Highest Grade). Recognized for his outstanding contributions, he earned the Icon Award 2022. Academically, he has excelled with both M.Sc and B.Sc degrees in Computer Science and Engineering from Jahangirnagar University, graduating at the top of his class. As an innovator and leader, he founded Open AIR, a research community dedicated to fostering innovation. His top achievements include being the 2nd Runner-up in the National AI for Bangla 2.0 competition and securing a Special Innovation Fund grant from the ICT Ministry.

Nadia Afrin Ritu, Assistant Professor, Dept of CSE, JU

 Nadia Afrin Ritu received her B.Sc. (Honors) and M.Sc. in Computer Science and Engineering from Jahangirnagar University, Dhaka, Bangladesh in 2016 and 2017 respectively. Previously, she worked as a lecturer in the Department of Computer Science and Engineering, Daffodil International University, Dhaka, Bangladesh. Previously, she also worked as a lecturer in the Department of Computer Science and Engineering, Bangladesh University of Business and Technology (BUBT), Dhaka, Bangladesh . Currently, she is working as a lecturer in the Department of Computer Science and Engineering, Jahanginagar University, Savar, Dhaka-1342, Bangladesh. Her research interest is focused on Artificial Intelligence, Machine Learning and Expert System, and Data Mining. 

Md. Imdadul Islam, Professor, Dept of CSE, JU

Md. Imdadul Islam has completed his B.Sc. and M.Sc Engineering in Electrical and Electronic Engineering from Bangladesh University of Engineering and Technology, Dhaka, Bangladesh in 1993 and 1998 respectively and has completed his Ph.D degree from the Department of Computer Science and Engineering, Jahangirnagar University, Dhaka, Bangladesh in the field of network traffic in 2010. He is now working as a Professor at the Department of Computer Science and Engineering, Jahangirnagar University, Savar, Dhaka, Bangladesh. Previously, he worked as an Assistant Engineer in Sheba Telecom (Pvt.) LTD (A joint venture company between Bangladesh and Malaysia, for Mobile cellular and WLL), from Sept.1994 to July 1996. Dr Islam has a very good field experience in installation and design of mobile cellular network, Radio Base Stations and Switching Centers for both mobile and WLL. His research field is network traffic, wireless communications, wavelet transform, adaptive filter theory, ANFIS, neural network, deep learning and machine learning. He has more than two hundred research papers in national and international journals and conference proceedings.

Downloads

Published

2026-08-25

How to Cite

Md. Masum Bhuiyan, Khandakar, S. N. K., Nadia Afrin Ritu, & Md. Imdadul Islam. (2026). Expectation Maximization Algorithm: A Review. Jahangirnagar University Journal of Electronics and Computer Science, 17. Retrieved from https://ecs.ju-journal.org/jujecs/article/view/54