Korva
Science

Shannon Turned Every Message Into Measurable Bits

A wartime job checking secret codes led to a 1948 paper that made every message countable.

AI image
Founders · How Claude Shannon Invented The Future

Before Claude Shannon, who worked at Bell Labs during World War II, information was not something science could measure. It arrived as a wired message, a picture, a block of prose, or a tune, each one its own kind of thing. The comparison used for him is to physics before Isaac Newton, when objects had inertia but no one had defined it for hard science.

His path to an answer ran through secret wartime work. Shannon was assigned to vet the math that let a scrambled message be decoded intact after it traveled. That job gave him a window into encoded speech, the transmission of information, and cryptography at the same time, a combination that may have existed nowhere else but Bell Labs at that moment.

Out of that window came a simplifying step. Shannon recognized that any message, whatever it meant and whoever sent or got it, could be boiled down to a string of simple yes-or-no choices. Bits, in his account, were information's fundamental unit. A love song and a battle order were different in meaning, but as information they were made of the same measurable stuff.

He published the idea in 1948 after eight years of scribbling, refining, and night work when he sensed he was onto something even more fundamental. The paper is now considered among the past century's most important science papers. It laid the theoretical foundation for the web, methods for shrinking files, methods for fixing transmission mistakes, digital phone networks, modern computers, and much of today's AI systems.

That is why the digital world can treat every kind of message the same way. Once information became bits, it could be counted, squeezed smaller, sent over long distances, and rebuilt correctly, which is what phones, computers, and networks do all day.

Questions people ask

What exactly is a bit?

A bit is the smallest unit of information, a single yes-or-no choice represented as a 1 or a 0. Strings of bits can stand for numbers, letters, sounds, or pictures, which is why computers store everything in the same form. Eight bits make a byte, enough to represent one text character.

What is data compression?

Data compression is a method for representing the same information with fewer bits, so files take up less space and travel faster. A common trick is to find repetition and describe it once instead of many times. Your phone uses it every time you stream music or send a photo.

What are error-correcting codes?

Error-correcting codes add carefully designed extra bits to a message so the receiver can detect and fix mistakes caused by noise. They allow a scratched DVD, a faint cell signal, or a transmission from deep space to arrive intact. The idea grows directly from Shannon's work on sending messages reliably.