Track GPTBot, ClaudeBot, and OAI-SearchBot with nginx

Step 1

Copy your generated nginx block

Open AI Traffic while signed in to copy this block with your workspace identifier filled in. The identifier is safe in server configuration and cannot read account data or act as an authenticated Foglift API key.

# Foglift AI crawler map v2026-07-18
# Re-copy this block when Foglift adds crawler patterns.
map $http_user_agent $foglift_ai_crawler {
    default 0;
    ~*(GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|Claude-SearchBot|Claude-User|Claude-Web|anthropic-ai|PerplexityBot|Perplexity-User|Googlebot|Google-CloudVertexBot|Google-NotebookLM|Google-Read-Aloud|Google-Agent|Amazonbot|Amzn-SearchBot|Amzn-User|Applebot|bingbot|DuckAssistBot|MistralAI-User|MistralAI-Index|meta-externalagent|meta-externalfetcher|cohere-ai|Bytespider|CCBot) 1;
}

server {
    # Add this beside your existing location blocks.
    location / {
        mirror /_foglift_ai_crawler;
        mirror_request_body off;
        # Keep your existing proxy_pass / try_files directives here.
    }

    location = /_foglift_ai_crawler {
        internal;
        if ($foglift_ai_crawler = 0) { return 204; }
        proxy_pass https://foglift.io/api/v1/crawler-analytics;
        proxy_method POST;
        proxy_pass_request_body off;
        proxy_set_header Content-Length "";
        proxy_set_header X-Foglift-Mirror 1;
        proxy_set_header X-Foglift-Site-Token YOUR_WORKSPACE_ID;
        proxy_set_header X-Foglift-Original-Host $host;
        proxy_set_header X-Foglift-Original-URI $uri;
        proxy_set_header X-Foglift-Original-User-Agent $http_user_agent;
    }
}

Step 2

Merge it with the existing server block

Place the generated map in the nginxhttp context. Merge the mirror directive and internal reporting location into the relevant server configuration.

• Keep every existing proxy_pass, try_files, cache, TLS, and security directive.
• Forward $uri, never $request_uri, so query strings remain excluded.
• Do not remove the internal boundary on the reporting location.

Step 3

Validate, reload, and verify

1. Run nginx -t. Fix every reported error before continuing.
2. Reload nginx only after validation passes, using the command approved for your server or hosting environment.
3. Open AI Traffic and choose Verify install. Foglift sends a unique workspace-bound request and confirms when nginx mirrors it.

The crawler pattern list is frozen into the copied configuration. Re-copy the block whenFoglift adds patterns; the dated version comment shows which map is installed.