Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If all or most LLMs are susceptible to failing this test, why would an LLM be a good means of evaluating performance on this test without being given a rubric?


Because evaluating a performance is different task from creating a performance. Someone who plays an instrument badly often has a different perception from someone who has to listen to it. ;)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: