Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

These are two very different cost factors. Scrapers don't use the available data dumps, that's why they scrape. They are also kind of dumb as they get lost in link structures constantly, which leads to unecessary traffic spikes.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: