Google-Extended rules

Set Google-Extended rules without blocking Googlebot

Google-Extended is a robots.txt control token. Use it separately from Googlebot so regular Google Search crawling remains open when organic traffic matters.

Generate Google-Extended rules

Watch for this mistake

Do not copy a generic blocklist that blocks Googlebot unless you intentionally want to reduce Google Search crawling. Use Google-Extended for Gemini-related control.

Official reference

Re-check Google's current crawler documentation before publishing production rules: Google crawler overview.