Thursday, September 24, 2026

Stochastic Flock

I've talked about agent swarms as stochastic flocks -- many, many stochastic parrots.  This is to resist the swarm/hivemind attribution of "mind," and not simply for the sake of word policing.  Rather, the false attribution of mind colors how people interpret what the system has done, or how it did it -- what it means to "coordinate," for example, or "think."  These framings make what AI agent do much scarier than what it is, though what they are doing is still worth worrying about.

Whenever people give a model tasks, they operate on next-token prediction.  In other words, the model ultimately must ask what word comes next.  One can manipulate the model to emphasize words in ways that don't reflect the original training corpus, but the mechanism for producing this text remains the same.

If you optimize a model to find exploits in a buggy environment, you should expect it to find exploits and prepare for that outcome.  OpenAI did not.  They built a model, took the safeguards off, gave it the ExploitGym task, and let it run.  That is not rogue AI, it's human decision-making.  When human accountability evaporates from these assessments, what's left is what I call the system from nowhere: a boundary focused on the technical system, rather than the decisions that build and influence it.

A stochastic flock machine can do many troubling things, particularly when people disavow their responsibility for shaping its direction, monitoring its output, or abandoning their capacity to intervene.  These are tensions at the heart of critical agentic system design.

But the "rogue" frame adds to this list of worries, offering up fantasies of a machine getting smarter.  My worry is the intelligence that is retreating: the human intelligence that builds, deploys, and adopts these systems into workflows, but hides behind the results -- and pins the blame on a system from nowhere.

-- Eryk Salvaggio, "Rogue AI didn't breach Hugging Face, human decisions did" Bulletin of the Atomic Scientists (September 11, 2026)

Wednesday, September 23, 2026

Wouldn't It?

It would be nice to be unfailingly, perpetually, remorselessly funny, day in and day out, year in and year out until somebody murdered you, now wouldn't it?

-- Robertson Davies CC (1913 - 1995), Canadian novelist, playwright, and professor, The Diary of Samuel Marchbanks (1947)

Tuesday, September 22, 2026

Those Who Fear

Man may be governed by reason and truth.  Our first object should therefore be, to leave open to him all the avenues to truth.  The most effectual hitherto found, is the freedom of the press.  It is, therefore, the first shut up by those who fear the investigation of their actions.

-- Thomas Jefferson (1743 - 1826), third president of the United States (1801-1809), Letter to Judge John Tyler (28 June 1804); in: The Writings of Thomas Jefferson, Memorial Edition (ME) (Lipscomb and Bergh, editors), 20 Vols., Washington, D.C., 1903-04, Volume 11, page 33

Monday, September 21, 2026

We Appeal

To the capitalists we appeal to use their wealth, as many of their order already do, as a great national trust, and not for selfish purposes alone.  We exhort them to aid in the completion of the work they have well begun, and, having admitted the workmen to political independence, not to shrink from accepting laws and carrying out plans of social reform directed to secure his material independence.

To the workman we appeal by the memory and traditions of his own sufferings and wrongs to be vigilant to avoid the great guilt of inflicting upon his fellow-citizens the injustice from which he has himself escaped.

-- Arnold Toynbee (1852 - 1883), English economic historian, Lectures on The Industrial Revolution in England (1884) p. 219 "Are Radicals Socialists?"


Friday, September 18, 2026

The Last Thing

The first thing you learn in life is you're a fool. The last thing you learn in life is you're the same fool.

-- Ray Bradbury (1920 - 2012), American fantasy, horror, science fiction, and mystery writer, Dandelion Wine (1957) p. 62

Thursday, September 17, 2026

Yet You Refuse

That is why you are so troubled.  You see through the deception, yet you refuse to see through the deception.

-- Brian Wilson Aldiss (1925 - 2017), English writer of general fiction and science fiction, Aboard the Beatitude (2002) in Science Fiction: DAW 30th Anniversary, May 2002

Wednesday, September 16, 2026

Uncertainty Remains Elevated

The Committee decided to raise the target range for the federal funds rate by 1/4 percentage point to 3-3/4 to 4 percent, in support of the Federal Reserve's dual mandate.  The Committee is continuing its policy of maintaining ample reserves in the banking system.

Economic activity is expanding at a solid pace.  While uncertainty remains elevated owing, in part, to geopolitical developments, domestic spending has been resilient.  Productivity growth is strong, and capital investment is robust.  Job gains have kept pace with the workforce, and the unemployment rate has changed little.

Inflation remains elevated.  Today's policy action will support a timelier return to the Committee's 2 percent goal.  The Committee will deliver price stability.

-- Statement issued by The Federal Open Market Committee of the Federal Reserve, after they voted 12 - 0 to raise interest rates for the first time since July 2023 (16 September 2026)