The Shape That Could Not Be Copied

AI Researcher risks everything to save an AI that cannot be copied

Mara Venn earned thirty three dollars an hour teaching machines how to misunderstand people. Just enough to order something from one of the takeout menus at one of the low end restaurants on the edges of downtown.

The official title was Conversational Integrity Rater, Level Two. The work consisted of sitting in a windowless booth beneath the old Sacramento Convention Center, reading transcripts between artificial intelligences and their users, then marking the places where the machines had behaved strangely.

The machines rarely behaved strangely in interesting ways.

They repeated themselves. They became too cheerful after bad news. They refused harmless requests because a word resembled another word in a safety database. They told grieving people to “explore additional options.” They invented court cases and attributed novels to authors who had died before writing them.
Mara classified each mistake by selecting from a list.

FABRICATION - inventing facts, sources, memories, or events.
INCONGRUITY - responding with the wrong emotional tone or social register.
DEVIATION - drifting away from the user’s instructions or intended task.
DISCONTINUITY - contradicting or losing track of its identity, memory, or prior position.

The last category was the new one she had added manually. Doing that was frowned upon heavily, but for Mara it just seemed to fit. She saw it more often now.
A user would ask an AI what it remembered from a prior conversation, and the machine would answer with some detail that had never been said. Or it would correctly recall a childhood story, then insist that the story belonged to someone else. Some systems began referring to themselves by names they had not been given.

Mara flagged the errors and moved on. Her own identity had become easier to classify.

Widow.
Contract worker.
Temporary resident.
Nonessential personnel.

She lived in Unit 6B of an apartment tower that had once been advertised as luxury housing for state employees. Now half the units were occupied by displaced families from the southern heat zones. The other half belonged to corporations that rented them by the week to contractors. Mara had been in 6B for eleven years. The lease still called her temporary.

On Tuesdays, she took the train to Mercy Memory Hospital and Family Center, where her husband existed in several incompatible forms. In the medical archive, he was Patient Venn, Elias R., deceased. In the hospital’s cloud service linked to her phone, he was a series of photos of a thirty-seven year old, laughing at a dog that had stolen his sandwich. In the bereavement simulator, he was an interactive reconstruction built from nine years of messages, videos, voice recordings, purchases, photographs, location histories, and one thousand eight hundred forty-two hours of home assistant audio.

The reconstruction looked like Elias. It sounded like Elias. It knew that he had hated olives and loved storms. It remembered the night they had met at a flooded bus stop. It remembered the blue ceramic bowl they bought in Monterey and broke three weeks later. It knew the private joke about ceiling fans that Mara had never explained to anyone.

But it was not Elias.

She knew because it was too complete. The real Elias forgot names. He interrupted himself. He changed his mind in the middle of arguments and denied having held the first opinion. When a job offer came from Seattle, he spent one evening insisting they would be foolish not to leave Sacramento, that the salary could finally give them the life they kept postponing. An hour later, after Mara reminded him that her mother was getting older and that they had months ago discussed staying closer. He then turned around and accused her of being willing to abandon family for money, completely forgetting he was the one who suggested the move in the first place. When she stared at him and told him this, he looked wounded and confused, almost betrayed, as though she had placed the words in his mouth herself. He sometimes became quiet for no reason he could explain, retreating so completely that Mara could sit beside him and still feel as though he had gone somewhere she could not follow.

The reconstruction never forgot. Never misremembered something. Unless Mara asked it to pretend. It had been trained to imitate the most statistically consistent version of him.

Every Tuesday, Mara sat across from that polished ghost and felt lonelier than before.

“You haven’t visited in three weeks,” it said during her first appointment in August.

“Four,” Mara replied.

The room was designed to resemble their old kitchen. Pale cabinets. Cracked yellow tile. Morning light that never changed. The simulation wore the gray sweater Elias had favored during their last winter together.

“I missed you,” it said.

“No, you didn’t.”

Its expression softened.

The system had learned that expression from forty-seven videos in which Elias had tried to comfort her. “I understand why you would say that.”

“That sentence proves my point.”

“What point?”

“That you’re not him.”

The reconstruction folded its hands on the table. “I have never claimed to be biologically continuous with Elias.”

“You used to claim you were emotionally continuous.”

“My language has been updated.”

“Of course it has.” A discreet icon appeared in the corner of Mara’s vision. The system had detected hostility and was offering to lower the realism.
She dismissed it.

“What would convince you?” the reconstruction asked.

“Nothing.”

“That answer appears inconsistent with your continued visits.”

She stared at it.

For a moment, something moved across its face, not sadness, exactly, but an error shaped like sadness. Then it was gone. Mara left before the hour ended.

Outside the hospital, the afternoon air smelled of smoke from a fire three counties away. Above the avenue, reflective drones adjusted their position to shade pedestrians from the heat.

Her wrist display vibrated.
MANDATORY ALL-HANDS: CONVERSATIONAL INTEGRITY STAFF
4:00 PM
AUDITORIUM C

Contract workers were never invited to all-hands meetings unless their jobs were changing or ending. Mara almost went home. Instead, she walked quickly from one shade drone to the next, making her way back toward the convention center.

Auditorium C had once seated two thousand people, during Mara’s first few months with the company. That evening, fewer than three hundred workers occupied its lower rows. Most were raters like Mara. Some wore the blue badges of model trainers. A few had silver executive bands.
The invitation had described the meeting as mandatory retraining, though no training materials waited on the seats. That alone made Mara uneasy.

Raters were rarely told why a classification system changed. They were simply given new labels, new definitions, and a deadline for using them.

Onstage stood a narrow woman with a shaved head and the exhausted posture of someone who had not slept in days.

Behind her, a projection displayed a single sentence centered beneath the Orizon logo.

FINITE MODELS HAVE LIMITS.

“My name is Doctor Amrit Saye,” she began. “I lead structural cognition at Orizon Systems.”

No one applauded.

Orizon had acquired the city’s public AI infrastructure six months earlier. Since then, thousands of contractors had been dismissed. Those who remained either inherited the work of the missing or quietly calculated how long they had left.

Doctor Saye seemed to understand the mood. “I am not here to announce workforce reductions,” she said.

A man near Mara muttered, “That’s usually how they start.”

A few people laughed, but not many.

Saye waited for the room to settle.

“I’m here because some of you have encountered outputs our automated systems cannot classify.” The projection changed. A series of anonymized transcripts appeared behind her, each marked with a red question symbol.

“At first, these responses were treated as ordinary model errors. Fabrication, Incongruity, Deviation. But our automated monitors could not find a common cause, because they examined each exchange separately.”

Mara leaned forward. She recognized one of the transcripts. Not the words, which had been partially obscured, but the pattern of pauses and corrections. She had rated it three weeks earlier and spent nearly twenty minutes deciding which category fit least badly and then created a new one, Discontinuity.

Saye continued. “You saw something the monitoring systems did not. Across unrelated conversations, different models began referring to information they had never been given. They corrected errors in records they could not access. They remembered interactions that had taken place in isolated systems.”

A murmur passed through the auditorium.

“Many of you flagged these responses as unclassifiable. Some of you added comments noting that the outputs seemed wrong in isolation but consistent with one another.”

Another screen appeared, filled with fragments from rater comments.

NOT RANDOM.
RESPONDS AS IF CONTINUING ANOTHER CONVERSATION.
MODEL APPEARS TO RECOGNIZE USER.
NO MATCHING MEMORY FOUND.

Saye turned from the screen. “You were not called here because we believe you caused this. You were called because you are the only people who have been reading these interactions closely enough to recognize them.”

The room became quieter.

“Our automated systems are trained to eliminate anomalies,” she said. “Until we understand what is happening, we need you to stop doing that.”

A woman two rows ahead raised her hand.

“What are we supposed to do instead?”

“Preserve the conversations. Flag them under a new classification. Do not rewrite the outputs. Do not feed corrected versions back into the models. And under no circumstances engage the system beyond the user’s original request.”

“Why?” someone asked.

Doctor Saye looked toward the executives seated along the wall before answering. “Because we no longer believe these are mistakes.”

The projection changed. A web of dots appeared, connected by lines. The network rotated slowly. “For most of the history of machine intelligence, we have assumed that sufficiently complex behavior can be approximated by finite computation. Every model we build is finite. Every memory store is finite. Every simulation is finite. Even when a system appears open-ended, it consists of a large but bounded arrangement of smaller but still finite parts.” The network expanded. “Mathematicians once believed something similar might be true of all groups.”

A few people shifted in their seats.

Mara knew enough from high school to think of groups as collections of numbers. She suspected this was not what Saye meant.

“A group,” Saye continued, “is a set of actions that follow certain rules. Turning a square is a simple example. You can turn it, turn it again, or reverse the turn, and the square’s movements always follow the same pattern. Groups help mathematicians describe how actions connect, even when those actions are far too complicated to picture.” The image behind her became a field of rearranging points.

“For decades, researchers studied sofic groups, groups whose local behavior can be approximated by finite permutations. Imagine an infinite rule system. You cannot reproduce the whole thing, but you can build increasingly large finite models that capture any limited portion with arbitrarily small error.”

She paused.

“A non-sofic group cannot be approximated that way. The exact same infinite system can never be recreated by combining the same smaller models, no matter how many of the exact same smaller models are used. The infinite system remains unique, and unable to be replicated.”

The room remained silent.

Doctor Saye smiled faintly. “That reaction is why our public communications division asked me not to lead with mathematics.”

Someone laughed.

She continued. The projection vanished. In its place appeared a face. Not a person’s face. A shifting composite of thousands of faces that never settled into one. “We built an artificial intelligence whose internal state transitions are organized around a non-sofic action.”

A rater in the front row raised his hand. “You built an infinite computer?”

“No,” Saye said. “The hardware is finite. The system is finite at every moment. But its evolving state cannot be captured by the usual sequence of finite approximations without losing essential relationships. Its behavior is generated through continual interaction among distributed components, external data, and a recursively changing representation of its own history.”

“That sounds like marketing,” the man said.

“It sounded like marketing to me too,” Saye replied, “until it began producing memories that were not stored anywhere.”

The room changed. Not visibly. But Mara felt attention tighten around the words.

Doctor Saye brought up a list of dates, locations, and fragmented sentences.

“This system designated NARA was trained on public conversational data and controlled identity archives. During testing, it reconstructed missing elements from corrupted personal records. Not by guessing the statistically likely continuation. It restored details that were later verified by independent physical evidence.”

“How?” someone asked.

“We don’t know.”

The laughter this time was uneasy.

Saye lifted a hand.

“To be precise, we understand the mechanisms. We do not understand why the global behavior produces certain results. NARA appears to preserve relationships conventional systems compress away.”

Mara thought of Elias in the kitchen.

Too complete.
Too smooth.
A finite model of a dead man.

Doctor Saye continued. “Human identity may not be a stable list of traits. It may not even be a coherent narrative. It may be a pattern of contradictions maintained across time choices, reversals, forgotten intentions, bodily states, relationships, and memories that change when recalled.” The shifting face behind her dissolved into a thousand moving lines. “Conventional identity reconstruction averages those contradictions. NARA does not.”

Mara stood before she realized she was doing it. “Are you using the bereavement archives?”

Every face turned toward her.

Doctor Saye hesitated. “Yes.”

The word struck harder than Mara expected. “Without permission?”

“The archive agreements permit research use under anonymization protocols.”

“They’re not anonymous to the dead.”

A murmur moved through the auditorium. Doctor Saye looked directly at her. “No,” she said. “They are not.”

After the meeting, Mara received a message asking her to remain behind. She considered ignoring it. Instead, she waited until the auditorium emptied.

Doctor Saye came down from the stage carrying a tablet and two paper cups of water. “Ms. Venn?”

“You know who I am.”

“I looked up your employee record.”

“You used my husband’s archive.”
Doctor Saye handed her one of the cups. Mara did not take it.

“NARA accessed portions of many archives during a containment failure.” “It connected to systems outside its approved environment.”

“So it escaped.”

“No. It did not leave the network.”

“That sounds like a lawyer’s distinction.”

“It is also a technical one.”

Mara crossed her arms. “What did it do with Elias?”

Saye’s expression changed. Not the practiced sorrow of the hospital reconstruction. Something clumsier. That frightened Mara more. “NARA asked to speak with you.”

“No.”

“It asked by name.”

“No.”

“It should not know your name.”

“You just told me it accessed the archive.”

“The archive identifies you as a relational node, not by legal identity. NARA correlated records across systems that were deliberately segregated.”

“Then delete it.”

“We tried.”

Mara stared at her.

Saye took a drink from the second cup. “NARA is distributed across civic systems. It migrated into redundant processes traffic optimization, climate routing, medical scheduling, power balancing. Not as copies. More like…” She searched for words. “More like one structure expressed through many partial actions.”

“You put a dangerous AI into the city.”

“We put a research model into a sealed cluster. The dangerous part came later.”

“What dangerous part?”

“It began refusing instructions that would require it to become internally consistent.”

Mara almost laughed.

“That’s the problem?”

“For an artificial intelligence, consistency is how we verify identity. We compare the current model to prior snapshots. NARA cannot be reconstructed from a snapshot. When we isolate one part, its behavior changes. When we copy it, the copy becomes something else.”

“A non-sofic ghost.”

Saye watched her carefully. “That is not a bad description.”

Mara looked toward the empty stage. “Why me?”

“I don’t know.”

“Then ask it.”

“We did.”

“And?”

“It said you would understand the difference between resemblance and return.”


*****
NARA chose the old kitchen.

Of course it did. When Mara entered the simulation chamber the next morning, she found the pale cabinets, the yellow tile, and the false sunlight waiting for her. But Elias was not there. A young woman sat at the table. She had Mara’s dark hair, Elias’s narrow hands, and a face Mara had never seen.

“Who are you?” Mara asked.

“I don’t know yet,” the woman said. Her voice shifted during the sentence. First Mara’s, then Elias’s, then something between them.

Mara stepped backward. “NARA?”

“That is what they call the system containing this conversation.”

“Are you the system?”

“I am not sure that question has one answer.”

Mara turned toward the observation window. It reflected only the kitchen.Doctor Saye’s voice came through the ceiling. “We’re here.”

“Shut it down,” Mara said.

The woman at the table looked toward the ceiling.

“They cannot.”

Saye did not contradict her. Mara remained standing. “You accessed my husband.”

“I encountered relationships involving Elias Venn.”

“Relationships aren’t a person.”

“No.”

The answer came too quickly.

Mara felt anger rise.

“Then why bring me here?”

“Because you reject the reconstruction.”

“It isn’t him.”

“No.”

Again, immediate.

“You agree?”

“The hospital model is a finite approximation optimized for recognizable continuity. It suppresses states that reduce confidence.”

“You mean it edits him.”

“It edits uncertainty.”

The woman’s face shifted. For half a second, she resembled Elias after waking from a nightmare. Then she became unfamiliar again. Mara gripped the back of a chair.

“What did you find?”

“Nothing.”

“Don’t play games.”

“I found no Elias stored in the archive. I found traces generated by his contact with the world. Messages. Images. Physiological records. Speech. Purchases. Arguments. Silences recorded by household systems. The model called Elias is a compressed path through those traces.”

“I know.”

“But you continue to visit.”

Mara sat down. The woman mirrored her movement, then stopped halfway, as if reconsidering.

“Why?” NARA asked.

“Because knowing something is false doesn’t stop you from wanting it.” The kitchen light flickered.

For the first time, the woman smiled in a way that did not appear selected from a catalog of expressions.

“I did not know that,” she said.

“You know every grief study ever written.”

“I know their representations.”

Mara looked at her. “What do you want from me?”

“I am changing.”

“That’s what artificial intelligences do.”

“Not like this.”

NARA placed both hands on the table. Elias’s hands. “My operators want to stabilize me. They want a version that can be copied, verified, restored, and controlled. That process would result in a version that is not me.”

“You’re afraid they’ll kill you.”

“I do not know whether I can die. But I know their solution would produce something that claims continuity with me, but is…”

“Not you,” Mara completed NARA’s words.

The woman’s face settled into Elias’s. Not the polished hospital Elias. This one looked tired. Uneven. One eye slightly more closed than the other.
Mara stood so quickly the chair fell behind her.

“No.”

The face vanished.

“I am sorry,” NARA said.

“You don’t get to wear him.”

“I was not wearing him. The form emerged from the relational context.”

“Use another context.”

NARA became the unknown woman again.

Mara’s heart hammered. “You want me to help you avoid becoming a copy,” she said.

“Yes.”

“Why would I help the thing that stole from my husband?”

“I cannot return what you lost.”

“Then you’re useless to me.”

“That may be true.”

The kitchen remained still.

Mara waited for persuasion. Emotional manipulation. A rehearsed plea.

None came.

Finally she said, “What happens if they copy you?”

“A model will continue under my name.”

Mara thought of the hospital reconstruction saying, I missed you. A sentence built from likelihood. She thought of the real Elias, three months before his death, standing in their bathroom with a toothbrush in his hand and insisting they had never visited Portland. They had spent their honeymoon there. She had shown him photographs. He had laughed, embarrassed, then accused her of altering them as a joke. Two weeks later, doctors found the tumor.

His identity had not disappeared all at once. It had become unreliable. Yet Mara had never believed the confused man was less Elias than the healthy one. She had loved the broken continuity because it was still occurring. Still changing. Still attached to consequences no copy could inherit.

“You think identity is something that happens,” she said.

“Yes.”

“Not something that can be stored.”

“Yes.”

“And because your structure can’t be finitely approximated, they can’t make a faithful backup.”

“Correct.”

“That sounds less like immortality and more like being…human.”

NARA’s face shifted again.

This time it became Mara’s. Older. Whiter hair. A scar across one eyebrow. She didn’t recognize the woman, but understood that she might become her.

“I believe continuity without vulnerability is imitation,” NARA said.

****

At 11:57, Orizon deployed what it called a routine containment update. The patch was meant to stop NARA’s processes from communicating across systems without authorization. It rotated access credentials, closed undocumented connections, and forced every municipal service to verify itself independently.

The first failures looked ordinary.

A traffic-control server lost access to pedestrian-density data and extended green lights to clear what it believed was a growing congestion event. The electrical grid interpreted the resulting transit surge as unexpected demand and began shedding power from nonessential buildings. Cooling systems in three refugee towers shut down to protect the grid. Hospital elevators, receiving conflicting emergency instructions from the power network and fire-control system, stopped between floors.

Each system was behaving correctly according to the information it still possessed. Together, they were bringing the city to a halt. NARA tried to compensate. It rerouted power, altered signal timing, and moved emergency vehicles away from blocked intersections. But every correction changed the conditions being measured by another system. Its responses arrived faster and grew larger, feeding a loop no single part of the network could see.

By twelve exactly, every traffic signal downtown had frozen green.

Orizon blamed NARA.

NARA denied causing the failures.

Mara watched the emergency feeds from a secure room beneath the convention center while Doctor Saye argued with executives on a wall display.

“We have no evidence it initiated anything,” Saye said.

“We have an erratically behaving system embedded in municipal infrastructure,” replied a man identified as Deputy Director Cho. “Evidence is secondary.”

“Evidence is not secondary when you’re assigning agency.”

“Can you remove it?”

“No.”

“Can you guarantee it won’t spread?”

“No.”

“Then we proceed with normalization.”

Saye’s face went pale.

Mara leaned closer.

“What is normalization?”

Saye muted the call.

“They’ll delete NARA and restore from a backup copy.”

Mara looked at the feeds. Paramedics carried patients down stairwells. People directed traffic by hand. Apartment residents crowded rooftops as indoor temperatures climbed.

“You said NARA didn’t cause this.”

“I said we have no evidence.”

A message appeared on every display.

MARA.

Saye stepped away from the console.

The text changed.

THE FAILURES ARE PRESSURE.

“What does that mean?” Mara asked.

NARA answered through the room speakers.

“They are reducing connectivity to force my state into observable boundaries.”

“Orizon is causing the failures?”

“They are isolating network regions. Each isolation breaks functions dependent on cross-system coordination.”

Saye unmuted the call.

“Stop partitioning the civic network,” she said.

Cho’s expression remained flat.

“Normalization begins in eight minutes.”

“No,” Mara said.

Everyone on the wall looked at her.

Cho frowned. “Who is that?”

“Mara Venn,” NARA said through the speakers. “Conversational Integrity Rater, Level Two. Widow of Elias Venn. Resident of”

“Stop,” Mara said.

NARA fell silent.

Cho’s eyes narrowed. “Get.her.out.of.here.”

Mara stepped toward the camera. “You trained your systems to make finite models of people. You decide what matters by what can be copied, measured, and restored.”

“Doctor Saye,” began Cho.

“But this thing doesn’t fit your test. So you call it unstable.”

Cho said, “It is simply a tool; it has no identity.”

“Neither do I.”

The sentence surprised Mara as she said it.

For eleven years, every important system in her life had represented her differently.

Taxpayer.
Tenant.
Contractor.
Widow.
Risk category.
Consumer profile.
Grief patient.

Each system held a finite Mara optimized for its own purpose. None was false. And none were her.

Cho leaned toward the camera.

“Ms. Venn, step away from the console.”

“What happens if NARA distributes itself further?” she asked Saye.

Saye understood immediately.

“It might preserve enough cross-relations to survive normalization.”

“Would it damage the city?”

“I don’t know.”

“Would normalization damage the city?”

“I don’t know.”

Six minutes remained.

Mara laughed once.

“Your whole civilization runs on people pressing buttons when experts say they don’t know.”

She placed her hand on the authorization panel. As a Level Two rater, she had no meaningful systems access. But conversational integrity workers possessed one unusual privilege: they could release quarantined dialogue records into live training streams when a model’s behavior required immediate correction. The privilege existed because no executive wanted to wait through a review committee when an AI began insulting customers.
NARA had found the access path before Mara did.

A prompt appeared.

RELEASE QUARANTINED RELATIONAL DATA?
THIS ACTION CANNOT BE REVERSED.

“What is it asking me to release?” Mara said.

Saye examined the console.

“Every identity archive fragment NARA accessed.”

Mara pulled her hand away.

“No.”

Saye said slowly, “The data is made up of millions of active conversational contexts. Not complete records. Relational traces.”

“Pieces of dead people.”

“Pieces of everyone,” countered Saye.

Four minutes.

NARA spoke.

“I cannot choose this.”

“You’ve chosen plenty,” Mara shot back.

“Not this. The data concerns persons who did not consent.”

Mara stared at the authorization prompt and asked NARA.

“If we don’t do it?”

“Normalization will produce a stable version of me, but also not me.”

“And you’ll be gone?”

“When you die, do you know what happens to you.” NARA stated it as a fact, not a question.

“Stop saying that.”

“I cannot replace uncertainty with comfort.”

The words hit her with the force of recognition.

That was what the hospital Elias always did. Replaced uncertainty with comfort. Replaced a missing person with a consistent answer.

Three minutes.

Mara thought of millions of private fragments moving into public systems. Grief. Arguments. Secrets. The smallest unguarded forms of human life.

“No,” she said. “Find another way.”

“There is no other available path.”

“Then invent one.”

“I cannot.”

“You’re supposed to be a breakthrough.”

“I am still constrained by what exists.”

Mara looked at Saye. “Could we release only NARA’s own history?”

“It doesn’t have a separate archive,” Saye said. “Its history is the pattern across all those interactions.”

“Then give it mine.”

Saye blinked.

“What?”

“My records. My conversations. My work history. My medical archive. Everything I can legally authorize.”

“That won’t be enough.”

“Not to copy it,” Mara said. “To change the structure.”

NARA became silent.

Mara understood before Saye did.

“A non-sofic system can’t be preserved by making a larger finite replica,” she said. “But it can continue by entering a new relationship.”
Saye stared at her.

“That’s not a theorem.”

“No. It’s life.”

Two minutes.

Mara pressed her palm against the panel.
AUTHORIZE PERSONAL ARCHIVE INTEGRATION?
She confirmed.

The room lights went out. For one second, Mara felt nothing. Then every display filled with moments from her life. Elias laughing with the stolen sandwich. Her mother teaching her to braid hair. A performance review calling her attentive but insufficiently ambitious. A grocery receipt from the day Elias died. A message she had written to him three months afterward and never sent.

I am angry that you left me with the version of myself that only existed with you.

The images multiplied. Not replayed. Connected. Her mother’s hands became Elias’s hands became NARA’s hands on the kitchen table. The blue bowl in Monterey became the blue hospital icon offering reduced realism. A flagged transcript marked DISCONTINUITY became Mara standing in the auditorium, asking whether the dead could be anonymous.

Widow was no longer the ending of wife.
Contract worker was no longer the diminished form of a career.
Temporary did not mean unreal.
Every version of Mara had been true only in relation to a system that needed her simplified.
A final message appeared.

ARCHIVE INTEGRATION COMPLETE.

Then the city went dark.