Colquhoun.AI
← All guides

Research Guides

“Keep This Page Out”: Turn a Vague SEO Request into a Clear Visibility Decision

· Colquhoun.shop editorial

“Please hide this page” sounds like a small maintenance request. It is actually an incomplete specification. Hide it from whom: search visitors, automated crawlers, or everyone except authorized customers?

Before choosing a setting, write the desired outcome in ordinary language. That prevents an SEO change from being mistaken for a privacy control, and gives the person testing the change something concrete to verify.

This worksheet is for reviewing pages you own or are authorized to manage. It is not an instruction to probe someone else's private content.

Three questions, three different outcomes

Should ordinary visitors be allowed to open the content? If the answer is no, begin with access protection. Google recommends password protection for confidential material. A search exclusion is not a substitute: a public page carrying noindex can still be visited directly or through a link. Google's content-sharing guidance

Should the page appear in Google Search? For accessible content that should be excluded, Google supports noindex in an HTML meta tag or an HTTP response header. Googlebot must be able to retrieve the resource to discover that instruction. Adding a crawl block can therefore prevent it from observing the exclusion. Google's noindex documentation

Is the problem unnecessary crawler traffic? Robots.txt addresses crawler access, not confidentiality. Google explains that a blocked page's URL can still appear in search if discovered elsewhere, and that crawler compliance is not universally enforced. Do not label a robots.txt rule “privacy enabled.” Google's robots.txt introduction

These questions should be answered separately even when one page needs more than one kind of review.

Write a visibility brief before opening settings

Use one record per page or clearly defined page group:

Field What to record
Exact scope Full URL, environment and any related downloadable resource
Intended audience Everyone, a named customer group, or an internal team
Search decision Eligible for discovery, intentionally excluded, or undecided
Reason A business requirement, not just “SEO cleanup”
Current evidence What an authorized signed-out check actually showed
Proposed change The narrow setting and the person responsible
Guardrail A nearby page whose behavior must stay unchanged
Verification Test, reviewer and review date

Keep sensitive contents out of the record. “Customer statement was accessible” is usually enough for triage; the statement itself does not belong in a shared SEO worksheet.

Do not collapse “unverified” into “working.” A dashboard toggle is evidence of a setting, not evidence of the response that visitors receive.

A fictional example: three pages, one misleading ticket

Imagine a small consultancy receives a ticket reading: “Hide our old workshop pages.” Its inventory contains three very different items:

The reviewer should not apply a single blanket rule. The first item needs an access-control decision. The second needs a search-visibility decision. The third needs an editorial decision: age alone does not tell the team whether to exclude it.

The useful result of the review is three clear requirements, not three identical checkmarks.

Test the requirement, not just the implementation

Ask the responsible developer or administrator to test the exact production URLs using approved access. Include one affected example and one deliberately unaffected control page. Record the observation time and whether the check was signed in or signed out.

For a search exclusion, inspect the delivered instruction and use the site's authorized Search Console access to check Google's evidence. A successful configuration change is not an immediate search-result guarantee; Google documents that it needs to revisit a page to observe a new noindex instruction. Google's verification guidance

For restricted information, require an access-control check rather than waiting for a search result to disappear. Never make private content public merely so a crawler can read a directive.

Close the ticket with two sentences: what changed, and what was verified. If those sentences describe different outcomes, the ticket is not finished.

This guide describes the built-in Web Reader and Keyword Density behavior verified for this publication. Available data depends on the page response; these tools do not measure visits or search rankings.