The Entropy of a Discrete Real VariableReport as inadecuate


The Entropy of a Discrete Real Variable


The Entropy of a Discrete Real Variable - Download this document for free, or read online. Document in PDF available to download.

SPAWAR Systems Center Atlantic, Joint Base Charleston, North Charleston, SC 29406, USA





Abstract The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set of probabilities, but the indeterminacy in a real-valued discrete variable depends on both the allowed outcomes x and the corresponding probabilities Þ. A fundamental measure that is sensitive to both x and p is derived here from the total differential entropy of a continuous real variable and its conjugate in the discrete limit, where the conjugate is universally eliminated. The asymptotic differential entropy recovers H plus the new measure, named ≡, which provides a novel probe of intrinsic organization in sequences of real numbers. View Full-Text

Keywords: Shannon entropy; information entropy; information theory Shannon entropy; information entropy; information theory





Author: Scott Funkhouser

Source: http://mdpi.com/



DOWNLOAD PDF




Related documents