information theory
the principles relating to the communication or transmission of information, which is defined as any message that reduces uncertainty. These principles deal with such areas as the encoding and decoding of messages, types of channels of communication and their capacity to throughput information, the application of mathematical methods to the process, the problem of noise (distortion), and the relative effectiveness of various kinds of feedback.