Skip to main content

Sensor docs

Track AI crawler visits on Cloudflare

Deploy Foglift Sensor as a Cloudflare Worker to see visits from GPTBot, ClaudeBot, OAI-SearchBot, and other recognized AI agents by page and time. The Worker runs at the edge, records matched requests, and passes every request through to your origin unchanged.

The server integration also records recognized AI answer referrals. It uses a hostname-bound public workspace identifier, never a secret API key, and retains reporting through ctx.waitUntil so the report does not delay the response. A crawler request is access evidence, not proof of a citation or recommendation.

For recognized AI crawler or referral events only, the Sensor reports the page path, user agent, AI source classification, and event time. It uses no cookies, does not identify visitors, and strips query strings.

1. Deploy the Worker

The one-click template creates an isolated Worker project and asks for your publishable workspace identifier. Cloudflare cannot infer your production hostname, so you will attach the route in step 3.

Deploy to Cloudflare

Prefer the CLI? Start a Worker project and install the published adapter:

npm install @foglift/sensor@^1.0.0

2. Add the generated Worker

Open AI Traffic while signed in to copy this entrypoint with your workspace identifier filled in. The adapter reports a matched request and passes the original request through to your origin unchanged.

// src/worker.ts
import { senseAITrafficWorker } from "@foglift/sensor/cloudflare";

export default {
  fetch: senseAITrafficWorker({
    siteToken: "YOUR_WORKSPACE_ID",
  }),
};

Matched reports stay alive through ctx.waitUntil, so Foglift reporting does not delay the response.

3. Assign the route safely

Use this path only when you control an active, proxied Cloudflare zone. Configure the Worker route for your hostname, such as example.com/*. Do not replace an existing Worker route or overwrite its bindings, compatibility settings, or fetch behavior. If a Worker already owns that route, review the integration before deployment. Cloudflare's route documentation explains how patterns attach Workers to proxied hostnames.

npx wrangler dev
npx wrangler deploy

4. Verify the server signal

  1. Confirm the Worker route is active on the intended production hostname.
  2. Open AI Traffic and choose Verify install.
  3. Foglift sends a unique workspace-bound request and confirms when the Worker reports it. The CLI verification command remains available as a fallback.

The Sensor sends the matched agent role, request path, and referrer hostname only. Query strings, request bodies, cookies, and page content are not reported. Cloudflare security products can block traffic before a Worker runs, so this covers recognized requests that reach the Worker. A crawler request does not prove indexing or citation.

Open AI Traffic

Pricing and limits

Cloudflare AI traffic tracking is available on every plan

Free is enough to install the Sensor for one brand. Paid plans expand brand capacity and add five-engine AI Visibility monitoring plus developer access.

PlanPriceBrandsAI Visibility
Free$0/mo1Active-use weekly Perplexity monitoring
Launch$49/mo3Five engines, up to daily
Growth$129/mo10Five engines, up to twice daily
EnterpriseCustomCustomFive engines, up to hourly

Cloudflare FAQ

What the Worker records, and what it does not prove

How do I track AI crawler visits on Cloudflare?

Deploy the Foglift Sensor Worker, set its public workspace identifier, and assign the Worker to the proxied production hostname. It records recognized AI crawler requests and AI answer referrals by path and time before passing each request to the origin.

Which AI crawlers does the Cloudflare Sensor distinguish?

The Sensor distinguishes OAI-SearchBot, GPTBot, and ChatGPT-User from Claude-SearchBot, ClaudeBot, and Claude-User, along with other recognized agents. Foglift groups visits by purpose so indexing, potential training access, and live user-requested fetches remain separate signals.

Does an AI crawler visit mean my page was cited?

No. A crawler request proves that a recognized agent reached the Worker route at a recorded time. It does not prove indexing, citation, recommendation, model training, or a human visit. Use prompt-level AI Visibility and recognized AI referrals as separate outcome evidence.

Can I track AI crawler visits on Cloudflare for free?

Yes. Foglift Sensor and AI Crawler Analytics are available on the Free plan for one brand. Free also includes unlimited single-page Technical Audits and active-use weekly Perplexity monitoring. Launch starts at $49 per month and adds five-engine monitoring, API, CLI, MCP, and webhooks.

Tracked prompt

Track AI crawler visits on Cloudflare

This guide owns the Cloudflare-specific installation answer. Use AI Crawler Analytics for the complete 28-agent reporting contract and evidence boundaries.