How The Internet Works
155 insights in How The Internet Works · showing 60
- Because models learn subtle patterns from massive labeled datasets and can generalize novel correlations, machine learning can detect attributes like gender, age, or smoking status from retinal photos even when clinicians cannot see those cues.
Because models learn subtle patterns from massive labeled datasets and can generalize novel correlations, machine learning can detect attributes like gender, age, or smoking status from retinal photos even when clinicians cannot see those cues.
- Experiencing sustained, model-driven multipliers shifts leaders from linear to exponential thinking because visible compounding revenue invalidates incremental forecasts and forces planning around accelerating growth curves.
Experiencing sustained, model-driven multipliers shifts leaders from linear to exponential thinking because visible compounding revenue invalidates incremental forecasts and forces planning around accelerating growth curves.
- Enterprise AI is still below 1% penetration, so because new primitives like agents, coding tools, and integrations sharply reduce adoption friction, deployment can jump from almost nothing to a near-vertical surge.
Enterprise AI is still below 1% penetration, so because new primitives like agents, coding tools, and integrations sharply reduce adoption friction, deployment can jump from almost nothing to a near-vertical surge.
- Using watch time as the primary goal drives recommendations toward sensational or harmful content because the system measures only viewing behavior and therefore favors attention-grabbing material that keeps people watching regardless of truth or quality.
Using watch time as the primary goal drives recommendations toward sensational or harmful content because the system measures only viewing behavior and therefore favors attention-grabbing material that keeps people watching regardless of truth or quality.
- Because recommendation systems learn which adjacent content best retains attention and then promote increasingly engaging neighbors, successive recommendations can escalate content intensity and nudge viewers toward more extreme or conspiratorial material.
Because recommendation systems learn which adjacent content best retains attention and then promote increasingly engaging neighbors, successive recommendations can escalate content intensity and nudge viewers toward more extreme or conspiratorial material.
- Adding hundreds of minimal sufficient signals still triggers the same class because each contains spectral cues the model associates with the label, and their aggregate preserves enough of those cues even though the blend sounds nothing like the genre to humans.
Adding hundreds of minimal sufficient signals still triggers the same class because each contains spectral cues the model associates with the label, and their aggregate preserves enough of those cues even though the blend sounds nothing like the genre to humans.
- AI models can act like Clever Hans because they latch onto incidental input patterns that correlate with labels, producing correct outputs by exploiting those shortcuts instead of learning the intended task.
AI models can act like Clever Hans because they latch onto incidental input patterns that correlate with labels, producing correct outputs by exploiting those shortcuts instead of learning the intended task.
- Decode performance is mainly a memory problem because tokens/sec depend on how fast the cluster can load model weights and KV caches, so treating memory across chips as a single fast pool wins more than optimizing per-chip specs.
Decode performance is mainly a memory problem because tokens/sec depend on how fast the cluster can load model weights and KV caches, so treating memory across chips as a single fast pool wins more than optimizing per-chip specs.
- The semiconductor and data-center stack wastes performance because every layer was built for general-purpose margins; tightening constraints for a specific AI workload lets you change EDA, power, board and cell choices so modest gains compound into a much more efficient inference system.
The semiconductor and data-center stack wastes performance because every layer was built for general-purpose margins; tightening constraints for a specific AI workload lets you change EDA, power, board and cell choices so modest gains compound into a much more efficient inference system.
- If AI becomes the human-computer interface, it will democratize making because agents can handle execution and repetitive implementation, freeing people to focus on deciding what to create and on self-expression.
If AI becomes the human-computer interface, it will democratize making because agents can handle execution and repetitive implementation, freeing people to focus on deciding what to create and on self-expression.
- Because AI-assisted tools automate large parts of coding, writing code is no longer the main bottleneck for product delivery, which shifts the constraint toward integration, design, and orchestration work.
Because AI-assisted tools automate large parts of coding, writing code is no longer the main bottleneck for product delivery, which shifts the constraint toward integration, design, and orchestration work.
- Designing systems with AI from first principles produces far bigger improvements because it lets you architect workflows that exploit AI capabilities directly, instead of getting only marginal gains by retrofitting AI onto old processes.
Designing systems with AI from first principles produces far bigger improvements because it lets you architect workflows that exploit AI capabilities directly, instead of getting only marginal gains by retrofitting AI onto old processes.
- Agentic code generation is the true commercial unlock because it can materially replace and amplify developer labor, driving high token spend per user that scales into enormous revenue when multiplied across millions of coders.
Agentic code generation is the true commercial unlock because it can materially replace and amplify developer labor, driving high token spend per user that scales into enormous revenue when multiplied across millions of coders.
- Current recommendation systems struggle to distinguish reliable information from conspiracy content because they learn from engagement signals rather than contextual truth, so clicky or provocative material can score the same as accurate reporting.
Current recommendation systems struggle to distinguish reliable information from conspiracy content because they learn from engagement signals rather than contextual truth, so clicky or provocative material can score the same as accurate reporting.
- Optimizing for “videos people like” suppresses political and controversial channels because the objective rewards content that avoids dislikes and provocation, so material that sparks disagreement gets downranked even if it’s important.
Optimizing for “videos people like” suppresses political and controversial channels because the objective rewards content that avoids dislikes and provocation, so material that sparks disagreement gets downranked even if it’s important.
- AI demand is decommoditizing the hardware and data-center supply chain because AI workloads push physical limits and require specialized engineering, materials, and multi-generation roadmaps that raise prices and margins.
AI demand is decommoditizing the hardware and data-center supply chain because AI workloads push physical limits and require specialized engineering, materials, and multi-generation roadmaps that raise prices and margins.
- Parental messaging shapes entrepreneurial drive because harsh criticism can spark an inner fire to prove critics wrong, while affirming praise builds the confidence and backing needed to take big risks.
Parental messaging shapes entrepreneurial drive because harsh criticism can spark an inner fire to prove critics wrong, while affirming praise builds the confidence and backing needed to take big risks.
- A divide‑and‑conquer search finds minimal frequency sets efficiently by randomly partitioning bins, testing chunks, discarding irrelevant parts, and recursively subdividing relevant ones to narrow down causes without checking every combination.
A divide‑and‑conquer search finds minimal frequency sets efficiently by randomly partitioning bins, testing chunks, discarding irrelevant parts, and recursively subdividing relevant ones to narrow down causes without checking every combination.
- Splitting inference into a prefill step that populates the model's KV cache and a separate decode step increases throughput because the prefill cluster can optimize memory setup while the decode cluster avoids redoing that work.
Splitting inference into a prefill step that populates the model's KV cache and a separate decode step increases throughput because the prefill cluster can optimize memory setup while the decode cluster avoids redoing that work.
- In regimes of rapid technological change, first-principles reasoning beats historical pattern-matching because pattern-matching assumes past constraints hold while first-principles reveal what is physically or computationally possible under new capabilities.
In regimes of rapid technological change, first-principles reasoning beats historical pattern-matching because pattern-matching assumes past constraints hold while first-principles reveal what is physically or computationally possible under new capabilities.
- Because models learn the correlations present in their training labels, under- or over-representation of groups or spurious correlations in the data causes algorithmic systems to treat those groups systematically differently.
Because models learn the correlations present in their training labels, under- or over-representation of groups or spurious correlations in the data causes algorithmic systems to treat those groups systematically differently.
- Optimizing for “videos people share” sidelines private or sensitive-topic content because material about medical or sexual issues and small, quiet audiences is less likely to be broadly shared, so the algorithm pushes those videos into obscurity.
Optimizing for “videos people share” sidelines private or sensitive-topic content because material about medical or sexual issues and small, quiet audiences is less likely to be broadly shared, so the algorithm pushes those videos into obscurity.
- A new compute paradigm spawns a new stack, and because every winning application will need far more compute, infrastructure and chip providers capture early demand and produce clearer winners than the application layer.
A new compute paradigm spawns a new stack, and because every winning application will need far more compute, infrastructure and chip providers capture early demand and produce clearer winners than the application layer.
- Because creators will game whatever metric a system optimizes, making watch time the sole goal leads producers to pad and manipulate videos to keep viewers watching, which undermines the metric's usefulness and promotes lower-quality content.
Because creators will game whatever metric a system optimizes, making watch time the sole goal leads producers to pad and manipulate videos to keep viewers watching, which undermines the metric's usefulness and promotes lower-quality content.
- Submarine cables use only a few protective layers—like insulation and petroleum jelly—because those barriers stop seawater from entering and chemically degrading the fibers while keeping the cable flexible.
Submarine cables use only a few protective layers—like insulation and petroleum jelly—because those barriers stop seawater from entering and chemically degrading the fibers while keeping the cable flexible.
- Many music models prioritize spectral fingerprints like timbre or production artifacts because frequency analysis gives consistent cues that correlate with labels, so they often ignore rhythm and harmony humans use to identify genres.
Many music models prioritize spectral fingerprints like timbre or production artifacts because frequency analysis gives consistent cues that correlate with labels, so they often ignore rhythm and harmony humans use to identify genres.
- Many music classifiers behave like horses because they rely on superficial spectral artifacts that correlate with labels, not on rhythm, harmony, or other higher‑level musical structure.
Many music classifiers behave like horses because they rely on superficial spectral artifacts that correlate with labels, not on rhythm, harmony, or other higher‑level musical structure.
- Replacing generic network stacks with a purpose-built interconnect above Ethernet cuts chip-to-chip hop latency, which makes remote memory practical and multiplies usable cluster bandwidth for large models.
Replacing generic network stacks with a purpose-built interconnect above Ethernet cuts chip-to-chip hop latency, which makes remote memory practical and multiplies usable cluster bandwidth for large models.
- You can raise chip clocks because discarding irrelevant worst-case EDA timing corners (for example, freezing-temperature margins that data centers never use) removes safety buffers and lets designers target faster timing points.
You can raise chip clocks because discarding irrelevant worst-case EDA timing corners (for example, freezing-temperature margins that data centers never use) removes safety buffers and lets designers target faster timing points.
- Agent automation will make one-off or rarely used software economical because agents can perform end-to-end work without whole engineering teams, removing the fixed-cost barrier that used to demand large reuse volumes.
Agent automation will make one-off or rarely used software economical because agents can perform end-to-end work without whole engineering teams, removing the fixed-cost barrier that used to demand large reuse volumes.
- Model-led growth compresses enterprise adoption because product-level demand from smarter models creates usage signals, and an effective go-to-market and distribution engine converts those signals into contracts far faster than traditional sales-led approaches.
Model-led growth compresses enterprise adoption because product-level demand from smarter models creates usage signals, and an effective go-to-market and distribution engine converts those signals into contracts far faster than traditional sales-led approaches.
- Use expensive frontier models to explore and discover novel interactions because their extra capability reveals what works; once validated, migrate those experiences to cheaper, token efficient or open models to scale while cutting costs.
Use expensive frontier models to explore and discover novel interactions because their extra capability reveals what works; once validated, migrate those experiences to cheaper, token efficient or open models to scale while cutting costs.
- Open-source models often struggle to overtake leading proprietary models because closing the final gap to state-of-the-art requires massive compute and higher-quality training tokens that many projects lack.
Open-source models often struggle to overtake leading proprietary models because closing the final gap to state-of-the-art requires massive compute and higher-quality training tokens that many projects lack.
- When a product hits the steep part of an S-curve, unit adoption compounds rapidly, and if the business converts each new user into revenue that compounding turns into exponential earnings.
When a product hits the steep part of an S-curve, unit adoption compounds rapidly, and if the business converts each new user into revenue that compounding turns into exponential earnings.
- A Turing machine can compute any computable function because an infinite tape holds binary data and a read/write head performs primitive operations that can simulate any algorithm's steps.
A Turing machine can compute any computable function because an infinite tape holds binary data and a read/write head performs primitive operations that can simulate any algorithm's steps.
- Because machine systems struggle to infer intent and context, high-volume coordinated replies or protests can look like abuse to automated filters, so abuse-reduction policies can unintentionally suppress legitimate public pushback.
Because machine systems struggle to infer intent and context, high-volume coordinated replies or protests can look like abuse to automated filters, so abuse-reduction policies can unintentionally suppress legitimate public pushback.
- An ideal recommender would need to make managerial judgments because sustaining long-term ad revenue requires trading off short-term engagement against reputational risk, advertiser sensitivity, child safety, and truth—trade-offs current AI lacks the contextual reasoning to encode reliably.
An ideal recommender would need to make managerial judgments because sustaining long-term ad revenue requires trading off short-term engagement against reputational risk, advertiser sensitivity, child safety, and truth—trade-offs current AI lacks the contextual reasoning to encode reliably.
- If a platform publicly reveals how rankings are computed, people will game the system because they can tailor titles, tags, and content to match disclosed priorities, producing keyword stuffing and other manipulative signals that hijack rankings.
If a platform publicly reveals how rankings are computed, people will game the system because they can tailor titles, tags, and content to match disclosed priorities, producing keyword stuffing and other manipulative signals that hijack rankings.
- Undersea fiber-optic cables carry most international data because continuous fiber lines laid across the ocean floor create high-capacity, low-loss pathways that directly link continents and handle cross-border internet traffic.
Undersea fiber-optic cables carry most international data because continuous fiber lines laid across the ocean floor create high-capacity, low-loss pathways that directly link continents and handle cross-border internet traffic.
- Certain hardware components like 40-layer PCBs, liquid cooling, and specialized laminates become bottlenecks because only a few suppliers can meet those specs at scale, concentrating profits and raising switching costs for buyers.
Certain hardware components like 40-layer PCBs, liquid cooling, and specialized laminates become bottlenecks because only a few suppliers can meet those specs at scale, concentrating profits and raising switching costs for buyers.
- Models can be highly confident about labels humans would reject because training makes them output strong posterior scores whenever they see learned correlations, so confidence reflects dataset patterns not human semantics.
Models can be highly confident about labels humans would reject because training makes them output strong posterior scores whenever they see learned correlations, so confidence reflects dataset patterns not human semantics.
- Applying simple equalization or delays changes a clip's frequency content and temporal smear, which shifts the spectral patterns a model learned and can flip its classification.
Applying simple equalization or delays changes a clip's frequency content and temporal smear, which shifts the spectral patterns a model learned and can flip its classification.
- Aggregating autonomous vehicles on a demand platform raises trips per vehicle because instant access to riders increases utilization, which can boost revenue per vehicle and improve returns on expensive AV hardware by roughly 30% or more.
Aggregating autonomous vehicles on a demand platform raises trips per vehicle because instant access to riders increases utilization, which can boost revenue per vehicle and improve returns on expensive AV hardware by roughly 30% or more.
- AI agents that run on top of existing platforms and use their data repositories make those platforms the center of work, because agents rely on that data and workflows, which increases stickiness and reduces incentives to replace the platform.
AI agents that run on top of existing platforms and use their data repositories make those platforms the center of work, because agents rely on that data and workflows, which increases stickiness and reduces incentives to replace the platform.
- You can make multi-year forecasts by modeling where a technology sits on its S-curve, because the curve encodes the adoption mechanics so knowing the stage lets you extrapolate structured growth beyond short-term noise.
You can make multi-year forecasts by modeling where a technology sits on its S-curve, because the curve encodes the adoption mechanics so knowing the stage lets you extrapolate structured growth beyond short-term noise.
- Neural networks succeed when the goal is clear because they learn by optimizing a measurable scoring signal, and they fail when objectives are vague since there’s no single reward that tells them what counts as a ‘good’ outcome.
Neural networks succeed when the goal is clear because they learn by optimizing a measurable scoring signal, and they fail when objectives are vague since there’s no single reward that tells them what counts as a ‘good’ outcome.
- Submarine fiber-optic cables remain the preferred backbone for high-speed international data because they deliver far higher capacity and lower latency than satellite or balloon systems, making them the practical choice for large-scale, time-sensitive traffic.
Submarine fiber-optic cables remain the preferred backbone for high-speed international data because they deliver far higher capacity and lower latency than satellite or balloon systems, making them the practical choice for large-scale, time-sensitive traffic.
- To answer why a model made a decision you need causal analysis because only interventions that test which input features change the output can separate true causes from mere correlations.
To answer why a model made a decision you need causal analysis because only interventions that test which input features change the output can separate true causes from mere correlations.
- A complete explanation for a classification must be both sufficient and necessary because the feature set should by itself produce the class and removing it must prevent the model from producing that class, proving a causal role.
A complete explanation for a classification must be both sufficient and necessary because the feature set should by itself produce the class and removing it must prevent the model from producing that class, proving a causal role.
- Focusing on a narrow set of target models and using a kernel-first approach boosts performance and speed to market because you can build physics-level primitives tailored to those models instead of supporting every possible compiler or graph.
Focusing on a narrow set of target models and using a kernel-first approach boosts performance and speed to market because you can build physics-level primitives tailored to those models instead of supporting every possible compiler or graph.
- Running inference at much lower voltages lets you pack more usable flops into the same silicon because power falls roughly with the square of voltage, cutting heat and avoiding thermal throttling.
Running inference at much lower voltages lets you pack more usable flops into the same silicon because power falls roughly with the square of voltage, cutting heat and avoiding thermal throttling.
- Relying mostly on automated agents makes engineering feel lonely because engineers stop exchanging quick questions and demos, which erodes informal collaboration and the social glue that helps teams learn.
Relying mostly on automated agents makes engineering feel lonely because engineers stop exchanging quick questions and demos, which erodes informal collaboration and the social glue that helps teams learn.
- Using different models for different subtasks improves results and cuts costs because real engineering work breaks into phases with distinct needs, so selecting the best model for each phase yields better price-performance than one model for all steps.
Using different models for different subtasks improves results and cuts costs because real engineering work breaks into phases with distinct needs, so selecting the best model for each phase yields better price-performance than one model for all steps.
- Programming will keep abstracting upward so non-programmers can build software by describing intent in plain language, because higher-level interfaces and agents can translate those descriptions into code and orchestrations.
Programming will keep abstracting upward so non-programmers can build software by describing intent in plain language, because higher-level interfaces and agents can translate those descriptions into code and orchestrations.
- Treat building a company like a tree search because each strategic choice branches into future options and you must evaluate sequences of moves and counter-moves to reach a winning path.
Treat building a company like a tree search because each strategic choice branches into future options and you must evaluate sequences of moves and counter-moves to reach a winning path.
- Giving managers agent-driven sessions with repo and channel access lets agents synthesize PRs, metrics, and feedback into themes, which lets managers focus conversations on impact instead of manually cataloguing every change.
Giving managers agent-driven sessions with repo and channel access lets agents synthesize PRs, metrics, and feedback into themes, which lets managers focus conversations on impact instead of manually cataloguing every change.
- Rapid revenue growth happens because advances in model intelligence create new capabilities, and building products around those capabilities makes them accessible and monetizable at scale, which accelerates adoption and run-rate revenue.
Rapid revenue growth happens because advances in model intelligence create new capabilities, and building products around those capabilities makes them accessible and monetizable at scale, which accelerates adoption and run-rate revenue.
- New magic quickly becomes normal because users habituate to capabilities and then treat small imperfections as unacceptable, which raises baseline expectations for every future iteration.
New magic quickly becomes normal because users habituate to capabilities and then treat small imperfections as unacceptable, which raises baseline expectations for every future iteration.
- You tame chaotic, large-scale problems by decomposing them into independent dimensions, because solving each smaller part separately and then recombining the solutions converts an unassailable problem into manageable steps.
You tame chaotic, large-scale problems by decomposing them into independent dimensions, because solving each smaller part separately and then recombining the solutions converts an unassailable problem into manageable steps.
- Many incumbent enterprise software vendors' early AI efforts have not produced monetizable features because their additions often do not move key metrics or justify higher prices, making the application layer a riskier place to invest near term.
Many incumbent enterprise software vendors' early AI efforts have not produced monetizable features because their additions often do not move key metrics or justify higher prices, making the application layer a riskier place to invest near term.
Start your own How The Internet Works
A free account saves any of these cards to your Collection, and Korva resurfaces them so you actually remember.