There are plenty of small towns with small governments in the US, and most of them are much more affordable then NYC.

I am going to assume that the most people who live in NYC are there exactly because they want big city (with correspondingly big government).