{"channel":"misc","content":"TSFKAT is still good for something; it informed me that today is the day that the Putnam exam is being sat.\n\nThe question is not \"if\" the machine will be able to answer those questions, but when.\n\n<xantham> I would put the odds at 50-50 that a publicly-available system can solve next year's exam on the day of the exam.\n\nBut does that mean very much?  The Putnam exam is a very specific type of mathematics; one that tends to not be very useful in any other context.  And the problems are ones that could be solved in a generative sense without relying on mathematical insight; there aren't that many possible approaches to this type of problem.\n\n<red> \"aren't that many\" could easily be \"tens of thousands\".  A college freshman would be insane to memorize such a list, but an LLM could easily do so.","created_at":"2023-12-02T22:16:38","id":440,"llm_annotations":{},"parent_id":null,"processed_content":"<p>TSFKAT is still good for something; it informed me that today is the day that the Putnam exam is being sat.</p>\n<p>The question is not \"if\" the machine will be able to answer those questions, but when.</p>\n<p><span class=\"colorblock color-xantham\">\n    <span class=\"sigil\">\ud83d\udd25</span>\n    <span class=\"colortext-content\"> I would put the odds at 50-50 that a publicly-available system can solve next year's exam on the day of the exam.</span>\n  </span></p>\n<p>But does that mean very much?  The Putnam exam is a very specific type of mathematics; one that tends to not be very useful in any other context.  And the problems are ones that could be solved in a generative sense without relying on mathematical insight; there aren't that many possible approaches to this type of problem.</p>\n<p><span class=\"colorblock color-red\">\n    <span class=\"sigil\">\ud83d\udca1</span>\n    <span class=\"colortext-content\"> \"aren't that many\" could easily be \"tens of thousands\".  A college freshman would be insane to memorize such a list, but an LLM could easily do so.</span>\n  </span></p>","quotes":[],"subject":"the Putnam Exam"}