Mr Mathematicians, all that won't work well for mathematics. After all that not-I models gives good results.
So long term approach is: discover all theorems that are easy for llm's and take over with harder things where langage tricks do not work.
Or: ack that llms are better at math and keep rechecking results. And even that will result of trees of potential research that no one prompted (yet) for. becouse understanding is a key concept in science. of course there will be brute-force attempts to automatically search new results in related language tricks. Like in "protein folding" "research" - blindly looking for something and checking what's random folds folded. But that is not true edge science anymore.
Anyway, local llms are just tools, use it when convenient. I will repeat: local llms.
And than all what was proposed in article can be used to judge scientific output and scientists. But, yeah, do not freely donate and do not allow to steal your or others work.
Mr Mathematicians, all that won't work well for mathematics. After all that not-I models gives good results.
So long term approach is: discover all theorems that are easy for llm's and take over with harder things where langage tricks do not work.
Or: ack that llms are better at math and keep rechecking results. And even that will result of trees of potential research that no one prompted (yet) for. becouse understanding is a key concept in science. of course there will be brute-force attempts to automatically search new results in related language tricks. Like in "protein folding" "research" - blindly looking for something and checking what's random folds folded. But that is not true edge science anymore.
Anyway, local llms are just tools, use it when convenient. I will repeat: local llms.
And than all what was proposed in article can be used to judge scientific output and scientists. But, yeah, do not freely donate and do not allow to steal your or others work.
LOCAL llms.