My personal take is to minimize the amount of temperature variance over time so I'd invest time and money in insulation, weather stripping, other upgrades first as well as reducing my electrical usage in general.

Right now, I'm at a point where I need to use a FLIR to investigate more improvements after which will I then think about solar but it's nice to read up on solar improvements.