What I don't get is how did the pilots not see it? Are they that hard to see, or was vision obscured? The balloon in the attached picture looks pretty large.
Fighters can pick up balloons like this on radar, and you can see them in targeting pods (e.g. cued from the radar). You can see them with eyes if you get close, but it's not a guarantee.