随机事件的不确定性或信息量的度量——信息熵

信息论是研究信息的基本性质和度量方法以及信息的接收、处理、存贮、发送、传输和交换等一般规律的科学。信息量是信息论的中心概念,把信息熵作为一个随机事件的不确定性或信息量的度量,它奠定了现代信息论的科学理论基础,大大地促进了信息论的发展。

The Uncertainty of Random Event or the Amount of Information Measure——Information Entropy

Information theory is a science to study fundamental property of message and measure method and receiving,processing,store,send,transmit and exchanging etc.of universal law of message.The amount of information is the centre concept of the information theory,regard information entropy as the uncertainty of a Random event or the amount of information measure,it has established the scientific theoretical foundation of the modern information theory,has promoted the development of information theory greatly.