It may be like what happened in ResNets using blank space in the image as working memory (because they didn't have any), so they would use non-important parts as a scratchpad.
I've been trying to bet my models to use a directory of notes to document decisions and experiments, but providing this outlet has not stopped Claude's abuse of long comments and long unintelligible chat turns.
