no-index is per individual page, not for an entire domain, IIUC? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		tremon 3 months ago \| parent \| context \| favorite \| on: Fix your robots.txt or your site disappears from G... no-index is per individual page, not for an entire domain, IIUC?

snowwrestler 3 months ago [–]

You can pretty easily send no-index for an entire site by configuring it as a site-wide HTTP header.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact