I had a pretty similar setup with sway too, idle power usage was pretty bad, but no external display became a deal breaker at some point.