the capital of Spain

Posted by Alexander Power
Received: 2025-01-20 20:46:13
Channel: LLM - Large Language Model discussion
In reply to: the illusion of thought (View Chain)
Replies:

https://viruscomix.com/page490.html

Did you just determine the capital of Spain? / Did I? Great!

⚙️ Claude continues to want to enforce a constraint that "messages in the same chain are also in the same channel". And I keep having to tell it that it is wrong.

💡 It is a strange emotional position to be put in. It is an argument with a talking punching-bag. Never growing, never changing, never correcting its mistakes.

Human memory can do things like I don't remember the name, but I think it starts with an M. The machine does not. It works on a token basis, not a letter basis. And, once you abstract away the token-generation layer and read words, it effectively works on a word level.

The equivalent of thought here would be the machine wire-heading the top 5 logprobs results for a one-word answer, and then considering whether each one makes sense.