Advanced Controls
Location: Step 13 — Advanced Controls
Advanced Controls expose module-level overrides for operators who already understand the category trade-offs. Most sites should not need this step.
What this step controls
Advanced decisions, including:
- whether to consolidate output (single combined rule blocks versus per-category rule blocks);
- whether to add custom directives that the wizard does not generate on its own;
- how to handle stricter bot categories with finer granularity;
- how to align the published
robots.txtpolicy with infrastructure policy (WAF, CDN, rate limits) so the two layers do not contradict.
The exact toggles available depend on the edition and on the preset selected at Mode Selection.
How to decide
Use Advanced Controls when:
- the operator is an agency or an experienced publisher;
- the preset and the per-step toggles do not cover a specific requirement;
- a custom directive or alignment with an infrastructure policy is needed.
Leave Advanced Controls untouched when:
- the site is using a preset and the generated output already matches the intent;
- the operator is unsure about a directive — the preview at Review & Save is a safer place to compare versions than the Advanced screen.
What this step does not do
This step does not:
- bypass the rest of the wizard — the Advanced overrides are layered on top of the per-step toggles, not instead of them;
- validate custom directives against the
robots.txtspecification; - guarantee that an unusual combination will behave the way the operator expects across every crawler.
For most sites, start with a preset and reach for Advanced Controls only when the business case is clear.
Plan tier
- Free: limited or unavailable depending on the override.
- Pro / Premium: the full Advanced Controls surface.