I find it strange that there are still people who say that LLMs don’t think or create creatively in any specific way. apparently creative thinkers! By objective measurement I mean experiments that test intelligence and reasoning by evaluating results and not by empty philosophical speculations that control AIs by definition. Here is a great paper, Can LLMs Generate Novel Research Ideas? Large Human Research with 100+ NLP Researchers, showing one such experiment. The authors asked top researchers in the field of natural language processing to propose research ideas which were then presented in a standardized format to a rating panel of other NLP experts. Ideas generated by AI are judged more creative than human ideas.
Now one might argue that people weren’t giving their best ideas—some data in the paper suggests they were giving ideas between those of the top researchers—and people might be looking for ideas that might be easier to get funding directly. because they were Underneath art but very possible. Either way, however, AIs are coming up with great ideas that can complement ideas generated by humans.
Source link