I don't know, in my experience the chat output has been fairly natural.
The quoted sentence seems to be from some "model internals". Of course that can be incomprehensible, what an AI assistant is really doing is just statistically generating text with some bells and whistles to make it do useful stuff. Poking around in the internals doesn't seem like a good use of time? Comparable to cat:ing a compressed file, of course you get garbage.
I'm talking about the value of making the output in STE style, which doesn't seem useful. The value of having internal stuff in a given writing style would have to be evaluated as to whether it improves model performance.
> The quoted sentence seems to be from some "model internals".
I get these kinds of responses all the time.
> I'm talking about the value of making the output in STE style, which doesn't seem useful.
It is extremely useful. Because model output is literally what you wrote: "statistically generating text with some bells and whistles to make it do useful stuff". And in the past few months all Anthropic models have been outputting insanely bloated jargon-laden bullshit. If I see another "this leg of the decision tree holds the simple fact", I will scream.
I don't want this "internal" monologue when it talks to me, writes documents, or outputs comments in code.
