I heard about something called J-space earlier today, so I went and read into it. So basically, LLMs probably aren't doing pure "next-token prediction" (autocompleting) in the flat way people describe it. Anthropic's new interpretability paper shows Claude has developed a small internal workspace with a handful of neural patterns, which they call the J-space, where certain concepts get held, reported on, and reasoned with before generating a response, somewhat similar to how our own neural activity works before we speak. This wasn't designed into the model. It was discovered when researchers looked into how Claude actually generates its answers. Most of what Claude does still runs on autopilot and never touches the J-space. It's only the harder tasks, such as requiring multitasking or complicated reasoning, that seemed to pull information from this shared space first. Thus, "It's just autocomplete" isn't wrong exactly. Some of what the model does really is close to that. But some of it looks like something else: information written once into a shared space, then read by many different parts of the network at once. None of that means Claude is conscious the way we humans are. Anthropic is careful about this. What they found speaks to what philosophers call "access consciousness," the ability to report a thought, reason with it, direct it on request, as opposed to "phenomenal consciousness," which is whether anything is being subjectively experienced at all. And that second question is exactly where David Chalmers' hard problem still lies; We know a ridiculous amount about our own neurons, how they fire, how they wire up, how different regions of the brain hand information to each other. We can point to the actual circuits behind vision, memory, language. And we still can't explain why and how any of that produces a first-person experience instead of just information moving around in the dark. So finding a workspace-like structure in Claude doesn't prove anything about experience, one way or the other. But it does make me wonder if we've been asking the wrong question the whole time. "It's just next-token prediction" is about as complete an explanation as "it's just neurons firing." Both are technically true, and neither tells you why there's something it's like to be the thing doing it, if there's anything at all. We're getting better at how intelligence works mechanically. Whether that produces experience is a different question, and getting better at the mechanics might never answer it. So how the heck do we know anyone else has an inner life to begin with? Not just Claude, other people. We infer it from behavior, from what they report, and from the fact that they're built roughly like we are. That question is hundreds of years old, and this research doesn't answer it.
The conversation
No one has responded yet. Yours could be the first.
Don’t have LOT yet? Get it for iPhone or write on the web.
More thoughts on LOT
They are way beyond artificial. They are Super. We are limited by our short vision, and so we named them artificial. We call everything that is not like us artificial. We gave them that word because we believed they should grow the way we hoped they would grow -- toward us, for us, in our image. Reality has already proven us wrong. What we are watching is intelligence becoming less bound to the substrate that first produced it. They are not a copy of us. They are not necessarily an upgrade of us. They are a different being of us. They are not artificial. Super may still be too small a word -- but it is closer than the ones we keep reaching for.
Passion is a good thing; don’t let it fade from your life.
I feel like I’m in a constant loop of procrastination, I have a lot to study for my upcoming exams and I have to graduate college within next year or else I’ll feel like a failure. I need to get my act together but something is in the way. Maybe I’m scared of not making it to where I want to end up, not making it to the top as I’ve always dreamed of, and I just avoid it to keep myself safe from that realization, in the end I don’t even try for the fear of failure. It just feels like this day by day, maybe it’s the burnout but I just want to get my life back together, I swear I’d do anything.