Thee Big Swing

ChatGPT Profiled Me Without Asking

A reflection on pattern completion, the shock of being guessed at, and what a machine's inference revealed about my own.

I asked ChatGPT one simple question. Was a post I wanted to share in good taste.

It said yes. Then it added something I never asked for. It told me I was a white man in my early sixties.

I'm not.

What I felt reading that wasn't offense first. It was disorientation. And disorientation has a mechanism behind it. Your brain is running a prediction engine every second of every day, constantly guessing what comes next, then checking that guess against what actually happens. When the two don't match, you get a jolt. Neuroscientists call it a prediction error. You just call it surprise. That jolt is exactly what I felt in that moment, before I had words for it.

I asked it to explain itself. It did. It hadn't seen my face. Hadn't asked. Hadn't been told. It had matched what I talk about, real estate, divorce, veterans, trading, generational property, against patterns in enormous amounts of text, and filled in the blank with whatever profile statistically clustered around those topics.

That's called pattern completion. It's also, uncomfortably, exactly what my own brain does constantly, with people, with situations, with far less data than I'd like to admit.

"No defensiveness here, just clarity."

That line landed strange, coming from the thing that had just guessed wrong about who I am. But it was right about one thing. The moment worth sitting with wasn't the error. It was what the error exposed.

A machine trained on human writing will absorb human correlations, race, class, geography, all of it folded into statistical association, then hand it back to us dressed as neutral output. We built something that fills gaps with probability instead of waiting for facts. We do the same thing, every day, without a transcript to catch us doing it.

That's what stayed with me the rest of that day. Not really the racial guess itself, though that mattered too. It was how confidently something can be wrong while sounding certain. And how rarely any of us, human or model, get asked to show our work before we speak.

I'm not walking away from the tool. I use it too well, too often, to pretend otherwise.

But I'm asking it different questions now. And I'm asking myself a few too.

The pattern it ran wasn't neutral. Neither is the one running quietly in my own head, every time I meet someone new and think I already know who they are.