It's pretty straightforward, different optimizers have different requirements. Some require example inputs/outputs, others will just optimize on whatever you've got. You can use codex/claude code to set it up in order to bootstrap quickly, they're decent at it.

Does dspy support structured outputs?

Yes, I was using it for structured outputs before the dedicated structured outputs got their act together.

Yes using signatures with types