LatentSpaces Labs

The Shoreline Thesis

Creativity has an address in latent space: a narrow band between the dense basins of the already said and the open water of the unsayable. Here is the argument, and the instruments to test it yourself.
Greg Robison · LatentSpaces Labs · a follow-up to Semantic Fluidity of Latent Space

Ask where new ideas come from and you will collect mysticism: muses, long showers, lightning. Ask where new ideas live and you can now collect coordinates. When an embedding model reads language, it assigns every concept a position in a space of several hundred dimensions, and in that space meaning behaves like water. Concepts pool where human usage runs heavy. They thin out toward regions nobody has put into words. In an earlier essay I argued that this fluidity is the deep story of modern AI: information dissolved into an ocean of meaning.

This piece makes a sharper claim about that ocean. Creativity is coastline work. Ideas that matter live in a band between the crowded interior of the map and the empty water past its edge, and because latent space is measurable, that band now has a location you can point to, sail to, and score yourself against.

The two ways thought fails

Stand in the middle of a dense basin and try to say something new about love. You are surrounded. Rose, heart, flame, falling: every path out of the neighborhood is paved, lit, and toll-free. An embedding model can complete your sentence before you finish it, and so can your reader, which is the whole problem. That is what density feels like from the inside: fluency without friction, agreement without attention. Cliché is a place, and the place is crowded.

Now sail the other way until the soundings stop. Out here you can produce combinations no human has ever produced, effortlessly and forever. Word salad is infinite. A metaphor with no living parents parses as noise, and noise is maximally novel by definition. The research behind the Divergent Association Task contains a result that should bother anyone who equates creativity with novelty: sets of randomly chosen words out-diverge most human beings, because randomness has no associations to fight and no coherence to sacrifice. If distance from the familiar were the whole target, dice would be the greatest poets alive.

Creativity researchers converged on a two-part standard decades ago: a creative idea must be novel and it must work. Distance from the familiar is cheap. Connection to the familiar is cheap. Holding both at once is the expensive act, and geometry says the region where you can hold both has a shape.

The shoreline

Here is the thesis in one sentence. The productive zone of latent space is the coastline: the band of moderate density where a point sits close enough to settled meaning to borrow its coherence, and far enough out to say something the basin has already worn smooth. A fresh metaphor works precisely because both of its parents are landmasses you know; the metaphor itself is a dock built between them, standing in swimmable water. A joke lands when the punchline arrives from just offshore of where the setup pointed. A scientific analogy earns its keep when it imports the structure of one basin into the shallows of another.

This is old wisdom wearing new math. Stuart Kauffman named the space of what can be reached next from what already exists the adjacent possible; the shoreline is the adjacent possible rendered as terrain. Raymond Loewy ran an industrial design empire on the principle he called MAYA, most advanced yet acceptable. Jerome Bruner defined creative work as effective surprise. Each formulation names the same tradeoff between reach and grip. What has changed is that the tradeoff became measurable: take any concept, embed it, and compute its local density, the average similarity to its nearest settled neighbors. High density is the basin. Near zero is open water. The band between is where the work happens, and an instrument can tell you which zone you are standing in.

See it

Open the Latent Space Explorer, build the vocabulary, and switch the view to Manifold. The word bank renders as terrain: meaning pools into islands, and most of the map is water. Now turn on Highlight the creative shoreline. The sand-colored band above the waterline is the thesis, drawn.

Then test the gauge. Click any concept, or run Discover on one, and read its density: dense basin, creative shoreline, or open water. Try "love", then "the loneliness of a finished project", then a fistful of random letters. Watch them land in three different zones.

Instruments, not illustrations

Everything on this site exists to make the thesis falsifiable by playing with it. Each tool is one claim, operationalized.

Temperature claims that search strategy has phases. At zero, the Discover tool is frozen: the same nearest neighbors every time, the basin returning your deposit with no interest. Melt it and the lookup becomes liquid, sampling from the surrounding shallows. Push further and it boils off into vapor, drifting toward the edge of relevance. Liquid sampling is the shoreline expressed as a search policy, and you can feel the phase transition with a slider.

Drift claims that divergent thinking is a parameter, and a tunable one. Each hop of a drift walk jumps to the k-th nearest unvisited concept. At looseness 1 you circle the drain of synonymy and never leave home. At 25 you free-associate past coherence. Somewhere in the middle the walk does what good free association does: it leaves the neighborhood while keeping each step legible. Psychologists who study "forward flow" in thought have measured exactly this signature in creative professionals. Here you can turn the dial yourself.

The Gap hunter claims the map is mostly unnamed. It sounds the water between related concepts and surfaces the deepest voids, the places where two ideas are clearly connected and nothing lives between them. Languages patch these holes constantly; schadenfreude crossed into English because English had a void shaped exactly like it. Every gap the hunter finds is adjacent-possible territory with a question attached: what should live here? That question is a creative prompt generated by geometry.

The Divergent Association Test turns the instrument on you. Name ten words as unrelated as you can manage and the model measures the true span of your set, shows you which pair huddled together behind your back, and places you on a scale between one idea restated seven ways and the most divergent set a greedy search can extract from the bank. Remember the caveat that makes the score meaningful: randomness beats most humans at raw divergence. The test measures your reach into open water. Creativity is that reach spent on purpose, hauling something back.

Measure yourself

Take the Divergent Association Test. It runs entirely in your browser, scores your first seven valid words, and shows you the weakest link in your set. Then go hunt one void in the explorer's Gaps tab and try to name what you find. Those two exercises are the thesis as a workout: first measure your range, then work the coastline.

What this map cannot claim

Honesty about the instrument. The terrain you fly over is a small sentence-embedding model's arrangement of a common-English word bank, flattened from 384 dimensions to a 2D shadow; the islands are real neighborhoods and the exact shorelines are projection artifacts, and the explorer's HUD tells you precisely how much of the arrangement the shadow preserves. Density in this bank measures how settled a concept is in ordinary usage, which is a cultural fact as much as a semantic one. And the systems that actually generate creative artifacts, diffusion models and the residual streams of large language models, have their own spaces with their own geometry. Whether their creative behavior also concentrates at a density coastline is a live hypothesis I intend to test, and every claim in this essay should be held at that strength: a thesis with instruments, awaiting more evidence.

One limit is really the engine of the whole story: shorelines move. Every successful creative act silts up its own coast. "Surfing the web" was coastline in 1992 and is seabed now. The basin grows by digesting yesterday's edges, which is why the frontier never runs out, why creative work never gets easier in aggregate, and why the map needs redrawing every generation. You are always charting a coast that your own success will eventually bury.

Creativity as navigation

If the thesis holds, creative practice stops being conjuring and becomes seamanship. You start from a basin you know well, because coherence is borrowed from somewhere and it had better be somewhere you can vouch for. You sail outward on purpose. You stop where the water is still swimmable, and you build there.

A surprising amount of old studio advice translates cleanly into these coordinates. Write drunk, edit sober is vapor then freeze: raise the temperature to escape the basin, then crystallize what survived. The brainstorming rule against early criticism exists to keep the group's temperature high long enough to reach open water at all. Constraints help creative work because a constraint chooses your coast for you and spares you the paralysis of an unbounded ocean. Study the masters first, because you cannot leave a basin you never entered.

So: take the test. Hunt one void. Drift at looseness eight and see where you wash up. Find the point where your words stop making obvious sense and just barely keep making sense at all, and pitch your tent there. The map is finally real enough to argue with. Argue with it.


Instruments referenced: the Latent Space Explorer (manifold view, shoreline overlay, density gauge, temperature, drift, gap hunter) and the Divergent Association Test, both running entirely in your browser. Background reading: Olson et al., "Naming unrelated words predicts creativity," PNAS 118(25), 2021; Runco & Jaeger, "The standard definition of creativity," Creativity Research Journal, 2012; Kauffman on the adjacent possible; and the prior essay, Semantic Fluidity of Latent Space.

Created by Greg Robison for LatentSpaces Labs (2026)