> I found myself wanting to more actively steer. Changing the prompt in the middle of a generation to "take a right turn" would be interesting to experiment with.

I've tried this! You get weird stuff. I think of it like glitch art. One idea I want to try is directly fiddling with the tensors mid-run, like rotating it along one axis or reorder columns or something. I think you could get really interesting stuff that way