ReadingResearchRadarInvestment framework
Sign in / Sign up
← Back to reading
NewsTopic · AI平台爬虫趋势1 min read·2026-10-05

AI platforms become new scraping targets

Decodo data shows ChatGPT and Perplexity enter top five most-scraped sites, reflecting a shift from monitoring search to monitoring AI answers.

ImportanceLocalEvidenceE2 unreplicatedWrite-upQuick

2026-10-05 20:20 GMT+8

According to TechRadar, cybersecurity provider Decodo's latest research reveals that ChatGPT and Perplexity have entered the global top five most-scraped websites for the first time.

The analysis indicates ChatGPT accounted for 14% of observed activity, ranking third, while Perplexity accounted for 10%, ranking fifth. TikTok remains at the top with 18%.

Decodo CEO Vaidotas Juknys stated this marks a fundamental shift in data collection use cases: moving from scraping the web two years ago to see what people were searching for, to now scraping AI platforms to see what people are being told.

This conclusion is based on Decodo's own data analysis, which does not disclose sample size or methodology details, and represents a vendor's unilateral statement.

Sources

  • 报道出处techradar.com
Sign in / Sign up
ReadingResearchRadarInvestment framework
↗
Topic

AI平台爬虫趋势

【背景】随着用户获取信息的方式从传统搜索引擎转向AI对话平台,企业的数据监控重心正在发生根本性转移。根据Decodo发布的《2026年最常被爬取的网站》报告,ChatGPT和Perplexity首次进入被爬取网站的前五名,标志着“生成式引擎…

3 steps1 piecesUpdated 2026-10-08 01:14

How it got here

  1. 2026-09-10Decodo发布2026年度数据收集趋势报告,指出ChatGPT和Perplexity首次进入最常被爬取网站前十。
  2. 2026-10-05TechRadar报道该发现,强调企业监控重心从“人们搜索什么”转向“AI告诉人们什么”,ChatGPT占14%活动量。
  3. 2026-10-06NetContentSEO分析指出,品牌开始将AI答案视为新的SERP数据集,通过监测引用频率和情感来评估可见性。

What is still unsettled

  • 除了Decodo的客户群外,其他主流网络基础设施提供商(如Cloudflare)是否观察到类似的针对AI平台的出站流量激增?
  • 面对日益复杂的AI答案监测需求,现有的LLM爬虫工具在应对答案非确定性和多模态内容时存在哪些技术瓶颈?
  • AI平台方(如OpenAI)是否会采取更严格的反爬虫措施或推出官方的API接口来规范这种第三方监测行为?
Read the full topic →
Continue researching →