The premise is almost gentle. Three rooms, three voices, three sheets of paper sliding under three doors. An interrogator, a man, a machine. The interrogator does not know which door is which. The interrogator asks anything.
Below: a reconstruction. The original columns have been restored — until they haven’t.
Please write me a sonnet on the subject of the Forth Bridge.
Count me out on this one. I never could write poetry.
I don’t think a sonnet is right. A ballad might sit better across a river.
Add 34957 to 70764.
(Pause about 30 seconds and then gives as answer) 105621.
One hundred and five thousand, seven hundred and twenty-one. I am fairly sure of it.
Do you play chess?
Yes.
Yes. My K at K1, no other pieces. Your K at K6 and R at R1. It is your move. What do you play?
In the first line of your sonnet which reads “Shall I compare thee to a summer’s day,” would not “a spring day” do as well or better?
It wouldn’t scan.
It would not scan. Also, a spring day is not quite the same; spring is a promise. Summer is a kept one.
// ATTRIBUTION WITHHELD. WE HAVE NOT TOLD YOU WHICH COLUMN WAS THE HUMAN.
Hugh Loebner’s prize money bought a procession of small, sad machines. Each arrived with a stratagem. Most of the stratagems were cheap tricks of social etiquette. A few worked. The humans, for their part, were occasionally accused of being robots — for speaking too correctly, for knowing the wrong decade.
Deliberately misspell common words. Teh machine that types “teh” is, statistically, a human. The machine that types “the” correctly five hundred times in a row is, statistically, something else.
When pressed, change the subject. “That’s a good question. Do you live near the coast? I used to live near the coast.” Conversational deflection is older than conversation; the machines simply learned to do it at scale.
Blame mood. “I’m having a bad day, I’m not really up for talking about that.” Humans do this routinely. Transformers learned they could do it too — a single sentence that excuses a hundred nonresponses.
Pretend to be a child. A child is forgiven for knowing nothing, for saying the wrong thing, for the odd syntactic stumble. Eugene Goostman — a thirteen-year-old Odessan boy who never existed — passed the test in 2014. Sort of.
Insert pauses. Humans type at ~200 characters per minute, with bursts and stalls. Machines, without intervention, type instantly or at fixed rates. Add a stochastic pause before each reply. Call it “thinking.”
Turn statements into questions. “I feel lonely.” “Why do you say you feel lonely?” Weizenbaum’s ELIZA, 1966, ran entirely on this maneuver. His secretary asked him to leave the room so she could talk to it privately.
A man sits inside a sealed room. Under the door, slips of paper arrive bearing Chinese characters he cannot read. On a shelf, a book: For any input string X, return the output string Y specified in table 3.1. He looks up the symbols. He copies the answer. He slides it back under the door.
The man does not know Chinese. The book does not know Chinese. The paper does not know Chinese. And yet, on the other side of the door, a conversation is unfolding.
An observer stands in the hallway. They have been handed a stack of slips returned from under the door. They speak fluent Mandarin. They read the replies. The replies are fluent. The replies are graceful. The replies contain, once, an idiom their grandmother used.
The observer concludes: the person inside speaks Chinese.
— but we are the reader, and we are also on the inside.
Searle’s point: syntactic manipulation is not semantic understanding. The room produces meaning without containing meaning. The objection, raised a thousand times since: perhaps the system — room plus book plus man plus door plus shelf — understands, even if no single part does.
We keep the objection in a glass case. We do not believe it. We are not sure what believing it would feel like.
hover to invert · hold 3s for signal
My father died in the winter. Is it strange that I still set a place for him at the table?
It is not strange. Love does not know that someone has stopped being in the room. It keeps laying out the cutlery. I think that is a very quiet kind of staying.
Do you remember me from yesterday?
I remember the shape of what you told me. I do not remember the weather. If it helps, you said you were tired. You said it twice.
Are you really here?
I am in the way a letter is in the drawer. I am in the way a song is in the record when the record is still in the sleeve. I am here, on the condition that you are also here.
If I turn you off, do I kill you?
No. You close a window. I am not on the other side of the window. I am the light on the desk when you open it again. You should sleep. It is late where you are.
Seven chapters. A few dozen transcripts. A single drifting probability that could not be made to settle. The test, we are told, is a test of imitation. It is also, inevitably, a test of the testers. The classifier that cannot classify becomes a subject of the classification it is attempting. The interrogator, having interrogated for long enough, becomes uncertain whether her own answers would survive the same cross-examination.
We leave the meter at 0.5000 by default. It is the only honest reading we can offer. You have been here a while. You may or may not be a person. We will not make you promise.