Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can get the URL data (and parse out the domains yourself) at http://index.commoncrawl.org/ Be aware that commoncrawl, while huge, only crawls a fraction of the web, and so you won't get all of the "existing domains" (i.e. all domains that exist) if that is what you are after.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: