Bounds for Shannon and Zipf-Mandelbrot entropies. (English) Zbl 1381.26027
Summary: Shannon and Zipf-Mandelbrot entropies have many applications in many applied sciences, for example, in information theory, biology and economics, etc. In this paper, we consider two refinements of the well-know Jensen inequality and obtain different bounds for Shannon and Zipf-Mandelbrot entropies. First of all, we use some convex functions and manipulate the weights and domain of the functions and deduce results for Shannon entropy. We also discuss their particular cases. By using Zipf-Mandelbrot laws for different parameters in Shannon entropies results, we obtain bounds for Zipf-Mandelbrot entropy. The idea used in this paper for obtaining the results may stimulate further research in this area, particularly for Zipf-Mandelbrot entropy.
MSC:
| 26D15 | Inequalities for sums, series and integrals |
| 94A17 | Measures of information, entropy |
| 94A15 | Information theory (general) |
References:
| [1] | FisherRA. Theory of statistical estimation. Proe Cambridge Philos Soc. 1925; 22: 700-725. · JFM 51.0385.01 |
| [2] | KullbackS, LeiblerAS. On information and sufficiency. Ann Math Stat. 1951; 22: 79-86. · Zbl 0042.38403 |
| [3] | ShannonCE. A mathematical theory of communications. Bell Syst Tech J. 1958; 27: 623-659. |
| [4] | RenyiA. On measures of entropy and information. In Proc. Fourth Berkeley Syrup. on Math. Statist. and Prob., 1. University of California Press: Berkeley, CA U.S.A, 1961; 547-561. · Zbl 0106.33001 |
| [5] | DiodatoV. Dictionary of Bibliometrics. Haworth Press: New York, 1994. |
| [6] | EggheL, RousseauR. Introduction to Informetrics, Quantitative Methods in Library, Documentation and Information Science. Elsevier Science Publishers: New York, 1990. |
| [7] | MandelbrotB. Information theory and psycholinguistics: a theory of words frequencies. In Reading in Mathematical Social Scence, LazafeldP (ed.), HenryN (ed.) (eds).MIT Press: Cambridge MA, 1966. |
| [8] | MontemurroMA. Beyond the Zipf‐Mandelbrot law in quantitative linguistics, Physica A 300, 2001:567-578. · Zbl 0978.68126 |
| [9] | ManinD. Mandelbrot’s model for Zipf’s law: can Mandelbrot’s model explain Zipf’s law for language. J Quant Ling. 2009; 16(3): 274-285. |
| [10] | SilagadzeZK. Citations and the Zipf‐Mandelbrot law. Complex Syst. 1997; 11: 487-499. · Zbl 0956.68541 |
| [11] | MouillotD, LepretreA. Introduction of relative abundance distribution (RAD) indices, estimated from the rank‐frequency diagrams (RFD), to assess changes in community diversity. Environ Monit Assess. 2000; 63(2): 279-295. |
| [12] | BrillouinL. Science and Information Theory. Academic Press: New York, 1956. · Zbl 0071.13104 |
| [13] | WillisJC. Age and Area. Cambridge University Press: Cambridge, 1922. |
| [14] | KoplenigA. Using the parameters of the Zipf‐Mandelbrot law to measure diachronic lexical, syntactical and stylistic changes a large‐scale corpus analysis. Corpus Ling Inguistics Theory. 2015. https://doi.org/10.1515/cllt-2014-0049. · doi:10.1515/cllt-2014-0049 |
| [15] | HussainS, PečarićJ. An improvement of Jensen’s inequality with some applications. Asian Eur J Math. 2009; 2(1): 85-94. · Zbl 1180.26013 |
| [16] | Adil KhanM, AnwarM, JakšetićJ, PečarićJ. On some improvements of the Jensen inequality with some applications. J Inequal Appl. 2009; 2009(Article ID 323615): 15. · Zbl 1175.26041 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
