On the Rényi Entropy Functional, Tsallis Distributions and Lévy Stable Distributions with Entropic Applications to Machine Learning
DOI:
https://doi.org/10.22105/cz6btf75Keywords:
Shannon entropy functional, Rényi entropy functional, Tsallis non-extensive entropy functional, Lévy stable distributions, Machine learningAbstract
The Rényi entropy function was optimized for the novel findings of this investigation under various conditions. Their research's findings suggest that generalized t-distributions cover the complete spectrum of Lévy stable distributions. Additionally, an exposition was undertaken to prove that the Lévy distribution generalizes the Tsallisian distribution rather than the reverse. The current study is a strong generalization of an existing research work in the literature. Notable entropic applications to machine learning are addressed. Concluding remarks are given, combined with some strong open problems and future research pathways.
References
[1] Mageed, I. A. (2023). The consistency axioms of the stable M/G/1 queue’s z a, b non-extensive maximum entropy formalism with M/G/1 theory applications to 6G networks and multimedia applications. 2023 international conference on computer and applications (ICCA) (pp. 1–6). IEEE. https://doi.org/10.1109/ICCA59364.2023.10401411
[2] Mageed, I. A., Zhang, Q., Kouvatsos, D. D., & Shah, N. (2022). M/G/1 queue with balking shannonian maximum entropy closed form expression with some potential queueing applications to energy. IEEE global energy conference, GEC 2022 (pp. 105–110). IEEE. http://dx.doi.org/10.1109/GEC55014.2022.9987144
[3] Mageed, I. A., & Zhang, Q. (2022). Inductive inferences of z-entropy formalism (ZEF) stable M/G/1 queue with heavy tails. 2022 27th international conference on automation and computing (ICAC) (pp. 1–6). IEEE. https://doi.org/10.1109/ICAC55051.2022.9911090
[4] Mageed, I. A., & FRSS, I. (2023). Where the mighty trio meet: information theory (IT), pathway model theory (PMT) and queueing theory (QT) [presentation]. 39th annual uk performance engineering workshop.
[5] Mageed, I. A. (2023). The entropian threshold theorems for the steady state probabilities of the stable M/G/1 Queue with Heavy Tails with Applications of Probability Density Functions to 6G networks. Electronic journal of computer science and information technology, 9(1), 24–30. https://doi.org/10.52650/ejcsit.v9i1.138
[6] Begum, A., & Choudhury, G. (2023). Analysis of an M/(G1G2)/1 queue with bernoulli vacation and server breakdown. International journal of applied and computational mathematics, 9(1), 9. http://dx.doi.org/10.1007/s40819-022-01481-4
[7] Kloska, S., Pałczyński, K., Marciniak, T., Talaśka, T., Nitz, M., Wysocki, B. J., Davis, P., & Wysocki, T. A. (2021). Queueing theory model of Krebs cycle. Bioinformatics, 37(18), 2912–2919. https://doi.org/10.1093/bioinformatics/btab177
[8] Mollaei, S., Darooneh, A. H., & Karimi, S. (2019). Multi-scale entropy analysis and Hurst exponent. Physica a: statistical mechanics and its applications, 528, 121292. https://doi.org/10.1016/j.physa.2019.121292
[9] Kuaban, G. S., Soodan, B. S., Kumar, R., & Czekalski, P. (2022). A queueing-theoretic analysis of the performance of a cloud computing infrastructure: accounting for task reneging or dropping. 2022 international conference on electrical, computer, communications and mechatronics engineering (ICECCME) (pp. 1–7). IEEE. http://dx.doi.org/10.1109/ICECCME55909.2022.9988250
[10] Kłopotek, M. A., & Kłopotek, R. A. (2023). Towards continuous consistency axiom. Applied intelligence, 53(5), 5635–5663. https://doi.org/10.1007/s10489-022-03710-1
[11] Guo, C., Fang, S., & He, Y. (2023). A generalized stochastic process: fractional G-Brownian motion. Methodology and computing in applied probability, 25(1), 22. https://doi.org/10.1007/s11009-023-10010-9
[12] Scully, Z., & Harchol-Balter, M. (2021). The gittins policy in the M/G/1 queue. 2021 19th international symposium on modeling and optimization in mobile, ad hoc, and wireless networks, wiopt 2021 (pp. 1–8). IEEE. https://doi.org/10.23919/WiOpt52861.2021.9589051
[13] Jessup II, M. A., & others. (2012). Using hybrid simulation/analytical queueing networks to capacitate usaf air mobility command passenger terminals. https://scholar.afit.edu/etd/1214
[14] Nielsen, F. (2020). An elementary introduction to information geometry. Entropy, 22(10), 1100. https://doi.org/10.3390/e22101100
[15] Ouadfeul, S. A. (2024). Fractal analysis-applications and updates. BoD-books on demand.
[16] Palamidessi, C., & Romanelli, M. (2020). Feature selection in machine learning: R’enyi min-entropy vs Shannon entropy. ArXiv preprint arxiv:2001.09654. https://doi.org/10.48550/arXiv.2001.09654
[17] Palamidessi, C., & Romanelli, M. (2018). Feature selection with rényi min-entropy. Artificial neural networks in pattern recognition: 8th IAPR TC3 workshop, ANNPR 2018, Siena, Italy, September 19-21, 2018, proceedings 8 (pp. 226–239). Springer, Cham. https://doi.org/10.1007/978-3-319-99978-4_18
[18] Will-Cole, A. R., Kusne, A. G., Tonner, P., Dong, C., Liang, X., Chen, H., & Sun, N. X. (2022). Application of Bayesian optimization and regression analysis to ferromagnetic materials development. IEEE transactions on magnetics, 58(1), 1–8. https://doi.org/10.1109/TMAG.2021.3125250
[19] Yuan, M., Pun, M. O., & Wang, D. (2023). Rényi state entropy maximization for exploration acceleration in reinforcement learning. IEEE transactions on artificial intelligence, 4(5), 1154–1164. https://doi.org/10.1109/TAI.2022.3185180
[20] Borelli, R., Dovier, A., & Fogolari, F. (2022). Data structures and algorithms for k-th nearest neighbours conformational entropy estimation. Biophysica, 2(4), 340–352. https://doi.org/10.3390/biophysica2040031
[21] Lim, H. D., & Lee, D. (2022). Regularized Q-learning. ArXiv Preprint ArXiv:2202.05404. https://doi.org/10.48550/arXiv.2202.05404
[22] Rathie, P. N., & Da Silva, S. (2008). Shannon, Lévy, and Tsallis: A note. Applied mathematical sciences, 2(28), 1359–1363.
[23] Mageed, I. A., & Zhang, Q. (2022). An information theoretic unified global theory for a stable M/G/1 queue with potential maximum entropy applications to energy works. 2022 global energy conference (GEC) (pp. 300–305). IEEE. https://doi.org/10.1109/GEC55014.2022.9986719
Metrics
