If you ask a local LLM to multiply numbers together without using any external tools, it will still get more right than the average person (who isn’t using any external tools, like pen and paper)
it’s not a high bar because it’s the wrong tool for that, why is that even an argument. Are we evaluating CS students by their ability to compile C code too?
If you ask a local LLM to multiply numbers together without using any external tools, it will still get more right than the average person (who isn’t using any external tools, like pen and paper)
Thats… Not a high bar, and a low bar for electric sand we fought to think.
it’s not a high bar because it’s the wrong tool for that, why is that even an argument. Are we evaluating CS students by their ability to compile C code too?