{"id":25046,"date":"2025-07-01T17:51:34","date_gmt":"2025-07-01T14:51:34","guid":{"rendered":"https:\/\/forklog.com\/en\/cloudflare-introduces-content-marketplace-for-ai-and-websites\/"},"modified":"2025-07-01T17:51:34","modified_gmt":"2025-07-01T14:51:34","slug":"cloudflare-introduces-content-marketplace-for-ai-and-websites","status":"publish","type":"post","link":"https:\/\/forklog.com\/en\/cloudflare-introduces-content-marketplace-for-ai-and-websites\/","title":{"rendered":"Cloudflare Introduces Content Marketplace for AI and Websites"},"content":{"rendered":"<p>Cloudflare has launched the Pay per Crawl service, creating a content marketplace for authors and AI companies.<\/p>\n<blockquote class=\"twitter-tweet\">\n<p lang=\"en\" dir=\"ltr\">Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content. <a href=\"https:\/\/t.co\/PUrlSs636k\">https:\/\/t.co\/PUrlSs636k<\/a><\/p>\n<p>\u2014 Cloudflare (@Cloudflare) <a href=\"https:\/\/twitter.com\/Cloudflare\/status\/1940017715055301118?ref_src=twsrc%5Etfw\">July 1, 2025<\/a><\/p><\/blockquote>\n<p> <script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n<p>As part of the experiment, website owners can allow or deny AI scanners access to their resources and set a fixed fee for each page crawl.<\/p>\n<p>Additionally, they can offer free page analysis or block it entirely.<\/p>\n<p>The tool allows users to see the purpose for which <span data-descr=\"Crawlers \u2014 automated programs that 'crawl' (i.e., scan) websites by following links and collecting information from pages\" class=\"old_tooltip\">crawlers<\/span> are viewing the site:<\/p>\n<ul class=\"wp-block-list\">\n<li>for AI training;<\/li>\n<li>to provide answers via an AI search engine;<\/li>\n<li>for other purposes.<\/li>\n<\/ul>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-qw.googleusercontent.com\/docsz\/AD_4nXdwJY18DwyWKkHQMp9LJ_Ws3aoLJBYgP8AkSwCAMlZpO9w0lzqZKfSv4RguOigzzORP5fJLtP5gi2Q2I_5SZEEevp3FomWIeOC6kLAeJ35KuTxQtWVVwjlyS4zcNhwHoXWQFgnHAg?key=fs9fLSeceOGbFtW-FMWfeQ\" alt=\"Cloudflare \u0437\u0430\u043f\u0443\u0441\u0442\u0438\u043b\u0430 \u0440\u044b\u043d\u043e\u043a \u043a\u043e\u043d\u0442\u0435\u043d\u0442\u0430 \u0434\u043b\u044f \u0418\u0418 \u0438 \u0441\u0430\u0439\u0442\u043e\u0432\"\/><figcaption class=\"wp-element-caption\">Page view for Pay per Crawl users. Data: Cloudflare.<\/figcaption><\/figure>\n<p>Cloudflare provides services for the protection, acceleration, and stable operation of websites and internet applications. The cloud infrastructure provider accounts for 20% of internet traffic.<\/p>\n<p>The new service represents a significant idea that could offer a potential business model in the age of artificial intelligence. The launch comes at a time when news publishers face existential questions about reaching readers, Google Search traffic is declining, and users are opting for chatbot searches.<\/p>\n<p>Some companies, like The New York Times, <a href=\"https:\/\/forklog.com\/en\/news\/openai-accuses-new-york-times-of-hacking-chatgpt\">have filed<\/a> lawsuits against tech firms for training their AI models on news articles without permission or payment. Others <a href=\"https:\/\/forklog.com\/en\/news\/openai-to-access-content-from-vogue-and-major-media-outlets\">have struck<\/a> multi-year deals to license content.<\/p>\n<p>Cloudflare aims to create a more sustainable system where publishers can set prices on their terms.<\/p>\n<p>The company also announced that all new websites created with Cloudflare will now block AI crawlers by default. If owners wish to allow automated data collectors access to their resources, they must grant permission. This gives each new domain &#8220;default control,&#8221; the firm asserts.<\/p>\n<p>To test Pay per Crawl, AI companies and publishers need to have Cloudflare accounts. Both parties can set rates in their accounts at which they agree to buy and sell content.<\/p>\n<p>Currently, cryptocurrencies are not involved in the new solution, although some experts <a href=\"https:\/\/forklog.com\/en\/news\/aptos-ceo-advocates-blockchain-access-for-ai-agents\">believe<\/a> that this asset class is ideally suited for such interactions.<\/p>\n<p>In June, federal judge William Alsup <a href=\"https:\/\/forklog.com\/en\/news\/landmark-ruling-court-permits-anthropic-to-train-ai-on-copyrighted-books\">ruled<\/a> that Anthropic had the right to train models on published books without the authors&#8217; permission.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cloudflare has launched the Pay per Crawl service, creating a content marketplace for authors and AI companies. Pay per crawl is a new feature to allow content creators to charge AI crawlers for access to their content. https:\/\/t.co\/PUrlSs636k \u2014 Cloudflare (@Cloudflare) July 1, 2025 As part of the experiment, website owners can allow or deny [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":25045,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"select":"","news_style_id":"","cryptorium_level":"","_short_excerpt_text":"","creation_source":"","_metatest_mainpost_news_update":false,"footnotes":""},"categories":[3],"tags":[438,1800],"class_list":["post-25046","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-and-analysis","tag-artificial-intelligence","tag-cloudflare"],"aioseo_notices":[],"amp_enabled":true,"views":"66","promo_type":"","layout_type":"","short_excerpt":"","is_update":"","_links":{"self":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/25046","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/comments?post=25046"}],"version-history":[{"count":0,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/posts\/25046\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media\/25045"}],"wp:attachment":[{"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/media?parent=25046"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/categories?post=25046"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/forklog.com\/en\/wp-json\/wp\/v2\/tags?post=25046"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}