2022/11/26 by Seyedeh Azadeh Fallah Mortezanejad, Mortezanejad, Seyedeh Azadeh Fallah
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Other Statistics (stat.OT) #Statistical Mechanics and Entropy
paper · pdf · doi:10.48550/arxiv.2211.14602
openalex publication_date 2022/11/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
How to find unknown distributions is questioned in many pieces of research. There are several ways to figure them out, but the main question is which acts more reasonably than others. In this paper, we focus on the maximum entropy principle as a suitable method of discovering the unknown distribution, which recommends some prior information based on the available data set. We explain its features by reviewing some papers. Furthermore, we recommend some articles to study around the generalized maximum entropy issue, which is more suitable when autocorrelation data exists. Then, we list the beneficial features of the maximum entropy as a result. Finally, some disadvantages of entropy are expressed to have a complete look at the maximum entropy principle, and we list its drawbacks as the final step.