The secondary market for any asset, whether housing or equity, is what allows the primary market to raise large amounts of capital, so no, speculation is not bad at all. It indirectly leads to more investment in housing construction.