https://derekwang2002.github.io/ai-intelligence/en/projects/cloudflare-openai-web-discovery/ Material changes in AI models, agents, engineering and infrastructure, with primary sources and recommendations. en Mon, 02 Nov 2026 16:56:00 GMT https://derekwang2002.github.io/ai-intelligence/en/events/ev-20261015-02/ ev-20261015-02-published Thu, 15 Oct 2026 16:00:25 GMT New WATCH <p>Cloudflare and OpenAI reported early results from a research pilot that uses freshness, change, redirect, duplicate and potentially harmful-page signals to improve web discovery. A cohort covering about 1% of Cloudflare’s network helped OpenAI identify hundreds of millions of previously unknown pages. OpenAI still decides relevance and ranking, and discovery does not grant crawl permission. There is no public API or generally available product.</p><p><strong>Why read: </strong>Cloudflare and OpenAI’s web-change-signal pilot could reduce repeated crawling for RAG and research agents, but still lacks a public API or downstream quality results.</p><p>Recommendation: WATCH</p><p>Sources: <a href="https://blog.cloudflare.com/cloudflare-openai-discovery-agentic-web/">Cloudflare and OpenAI share early results from web-discovery pilot</a></p>