Entropy is a concept borrowed from thermodynamics and information theory. In communication, it measures the degree of uncertainty or unpredictability in a message system. The greater the number of possible messages a source could send, the higher the entropy — because the receiver cannot predict with confidence what will arrive next. Consider a coin toss (low entropy, only two outcomes) versus selecting one square on a 64-square chessboard (high entropy, 64 possible outcomes). High entropy means more information value per message received, because the message resolves greater uncertainty. However, very high entropy also makes communication more difficult because there is little predictability to guide decoding. This is why communication systems balance entropy with redundancy — repeating or reinforcing elements that the receiver can use to reconstruct meaning even under noisy conditions.