This is absurd. Libraries are a legal construct that artists accept in order to provide a tradeoff between profit and benefit to society, the library still purchases copies of the work, and as those copies wear out over time and new ones need to be purchase, an individual is still indirectly and effectively paying a small amount to the artist (although, again, even if they weren't it wouldn't matter, because the creator agreed to the terms of the library, unlike with digital theft). They're not remotely comparable to piracy.
Can you link to an example of such a contract? And besides, I thought the First Sale Doctrine meant that no matter what your contract said, once the book was sold that the copyright holder didn't have any say over that copy of it anymore.