Journal article
The entropy of ordered sequences and order statistics
Abstract
The entropy of a sequence of random variables under order restrictions is examined. A theorem that shows the amount of entropy reduction when the sequence is ordered is presented. Upper and lower bounds to the entropy reduction and conditions under which they are achieved are derived. Some interesting properties of the entropy of the individual order statistics are also presented. It is shown that the difference between the average entropy of …
Authors
Wong KM; Chen S
Journal
IEEE Transactions on Information Theory, Vol. 36, No. 2, pp. 276–284
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Publication Date
March 1990
DOI
10.1109/18.52473
ISSN
0018-9448