Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Curious: what does "/-/" it their robots.txt[1] do?

    User-agent: *
    Disallow: /-/
    Disallow: /account/
1: http://www.quip.com/robots.txt


Informs search engines not to index the http://www.quip.com/-/ directory.


OK, cheers. I assumed it must be some kind of regexp because according to the Web Archive (see my comment below) the entire domain is disallowed.


That's just where we put the ajax paths to keep a cleaner URL space


Interesting. However, it seems to block bots entirely: http://web.archive.org/web/*/http://www.quip.com


We just opened up the file at launch... Maybe caching or latency?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: