The Library

The library engine is live. You can see it running on the website now, and the data cruncher that drives it is available to interact with directly — search, exclude terms, re-crunch on demand. It is running on a Hetzner CX23 server. The demo dataset is a publicly available Twitter election dataset, chosen for being large, free, and easy: 49,746 items across 53 folders, classified in 780.7 milliseconds at 64,000 items per second. On a local Ryzen the throughput is considerably higher — the labs received a video of that.

Two things visible in the live interface are worth noting. The cruncher flagged "Bins need attention (5.67)" — some classification clusters need human review, and the system says so rather than silently accepting them. And two folders were auto-deepened: the cruncher recognised that their content density warranted sub-categorisation and did it without being asked. That is the librarian behaviour in the architecture expressing itself in the tool.

What you see in the library content itself is early scaffolding: messy, repetitive in places, obviously in progress. The trajectory it is on is already visible.

Everything that would be written down, is

Every profession in the Cartographer produces ephemera. Not just the things you see on the front end — more is happening in the background than the interface currently exposes.

The baker writes up a pricing ticket. The farmer files a crop report. The council produces minutes. The blacksmith has a stock inventory. When the stagecoach arrives — it is not in the current beta, but when it does — it will have timetables and route cards. Every piece of paper that would exist in a real working village has a counterpart in the Cartographer, and all of it flows into the library engine.

This is not limited to functional documents. The library will hold fiction written by actors who have time to write it. Newspapers. Annuals. Rainfall records. Astrological reports. Letters and notices. The distinction between a functional document and a cultural one is not one the library makes in advance — if something would be written down in the world, it gets captured.

The librarian

The library does not just accumulate. The librarian sorts and condenses.

Incoming material is categorised and bucketed. Over time, events that repeat — common transactions, routine reports, the small commerce of ordinary days — are compressed and eventually discarded. Rarer events are preserved. An unusual market day, a crop that failed spectacularly, an alignment in the astrology engine that produced something nobody had seen before — these stay.

What the librarian is learning to do is embed the world in text. Many lower-level events become a journal entry. Many journal entries become an annual. Many annuals become a volume. Each step condenses without losing what was significant, the way an embedding condenses without losing semantic content. The library is doing in language what a neural network does in vector space.

The concern-library loop

The library is not passive storage. It is part of how actors learn to do new things.

When an actor stalls — when they have been producing the same thing over and over without progressing, or when the world around them has begun to need something they cannot yet make — their concern basin will eventually tip them toward the library. The stagnation becomes a pressure, and the library is where that pressure can resolve.

When they arrive, they find a book. It may have been generated by the world's own activity, sitting on the shelf since before they arrived. Or it may have been placed there quietly by a developer. Either way, the actor reads it as recreation — which is exactly the mechanic the Baker's page describes. Nobody sends the actor to the library. Nobody assigns them the book. They end up there because their concern basin pushed them, and they find what they need because the library holds it.

This is how the world teaches its actors what it needs them to know, without telling them.

Injecting new knowledge

The library is also the mechanism through which developers can introduce new possibilities to the world without disturbing anything already in it.

If the world needs a new craft — a new station, a new skill, a new line of production — the cleanest way to introduce it is a book. Slip the relevant reading into the library's collection. Actors who stall out and visit in their relevant pursuit will eventually find it. Some of them will take it further.

This scales without friction. A world with ten thousand actors, and a developer who wants to introduce lace-making, injects reading materials about lace into the library. In time, an actor who has run out of road in their current craft will find those materials, and there will be a lacemaker in the village where there was not one before. Nobody had to build a lacemaker from scratch. The library carried the possibility and an actor's concern basin delivered them to it.

The injection does not upset the existing environment because it does not touch the existing environment. It adds to the library. The library is already the place where new things enter the world.

Actors as readers

Any actor in the Cartographer can read any of the library's books.

This means actors read about themselves — accounts of their own profession, records of their own village, crop reports that include their own crops. They read about their neighbours. They read about things that happened before they were instantiated, and events that occurred while they were asleep. They read fiction that other actors found time to write.

What accumulates over time is something like a shared culture of knowledge — an understanding of the world that circulates through the village not via direct instruction but through what is on the library's shelves. An actor who reads widely will know things they were not present for. They will understand things they have not made themselves. The library is where the village thinks.

Player control over the archive

When you play the Cartographer, you can set how much of the world you want saved and how large your library is permitted to grow.

The game itself is approximately 500 megabytes. Two gigabytes set aside for the library is more than most players are likely to fill, even over a long run. The library is designed to be bottomless in practice — the world generates more material than any player will ever read, and the condensation ensures it stays meaningful rather than merely large.

The bigger purpose

The library engine is doing several things at once, not all of them obvious from inside the game.

The most significant: if the library engine can produce proper documentation at the end of its condensation process, the VINE language model can use the Cartographer world to scaffold her understanding of the real world.

This matters because one of the persistent problems in language model training is the absence of a trust hierarchy in the source material. A post on a discussion forum and a carefully sourced long-form article are not comparable, but they are often treated as if they are. The Cartographer's library has a built-in trust and relevance hierarchy: the librarian knows what is rare and what is routine, what has been verified by repetition across many actors and what is a one-off rumour. The library produces documents that are epistemically ranked, not just accumulated.

The language model trained on a library like this learns, at the source, that information has quality — not just content.

Lore that writes itself

This is the mechanism behind the Cartographer's world-lore writing itself.

As players discover things, build things, make things happen — everything that would be written down in a world where those things happened, gets written down here. A player who builds a castle in a remote region will find, if they look, that the library eventually holds accounts of its construction, records of the materials sourced, perhaps a brief history of the land it was built on. None of this was authored. The world produced it, the library captured it, and the librarian shaped it into something readable.

The world's history is the library. The library is the history. They grow together.

← Return to the Cartographer overview.