I had a conversation with a large group of friends and we independently came to the conclusion that Openai/Claude does not deliver more than a open source model. It takes about the same and the quality is about the same, and this does not mean it is good
I'm just glad the dweebs who were parroting "OMG, Distillation attacks!!1!" have been empirically proven wrong, and discussion around open-weight models are more rational now.
Distilled data or no, the Chinese labs are bringing a lot of solid original work in training and inference efficiency. Deepseek's work has probably made everyone's AI cheaper to run by this point.
