That's it exactly. If the index funds get so big that they basically are the market, then active investors will have to adjust their view of the market to be effectively just whatever the index funds do.

It may be possible that although they can't beat other active investors enough to justify their fees, they can beat a big dumb index fund enough to make their services worthwhile. That remains to be seen however.