levy rozman tries to understand the machine
https://www.youtube.com/watch?v=JHq4EKMg7fI📺
Mr. Rozman doesn't know anything about how to get the best results from LLMs. But he won't let that stop him. In fact, his job is to do everything he can to present the machine as incompetent, in an amusing way.
He can't rely on the machine generating legal moves. ⚔️( he probably could, but he doesn't.) ⚙️( he defines what a "flank pawn" is. because he assumes there will be a lot of non-regular viewers.)
And he describes the machine explaining the history of the English Opening. Because long-windedness is a feature.
The machine can't (or at least doesn't) generate a list of legal candidate moves. 💡( it probably should. Human players don't explicitly do that, because they do it subconsciously faster than they can notice.)
I can't watch all of this. His schtick is too aggravating. So I jump ahead ten minutes. The machine is now hallucinating pieces.
Because, there is no "board", and there are no constraints. 🔥( this would be less non-sensical if you couldn't see the board.)
There is more of the logic that isn't logic in its output.
Question: is there motivation for an LLM that can actually analyze chess positions well?
That is: to give an accurate summary of a position? 💡( by mechanically generating the first two layers of processing, ChatGPT could probably do it now.) ⚙️( for example: the white knight on c6 is attacking the (defended) black rook on e7, the (defended) black pawn on b4, and defending the white bishop on d8.) 💡( of course, it won't be able to go down long lines of calculation without doing the calculation. which, without a lot of fine-tuning, it can't do.)