[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"article-cloudflare-bots-beat-human-web-traffic-zh":3,"article-related-cloudflare-bots-beat-human-web-traffic-zh":31,"series-tools-f69efc2b-0c9c-4888-a8b7-bb0328d7df1f":80},{"id":4,"slug":5,"title":6,"content":7,"summary":8,"source":9,"source_url":10,"author":11,"image_url":12,"cover_image":12,"category":13,"language":14,"translated_content":11,"related_article_id":15,"keywords":16,"key_takeaways":23,"views":27,"created_at":28,"published_at":29,"topic_cluster_id":30},"f69efc2b-0c9c-4888-a8b7-bb0328d7df1f","cloudflare-bots-beat-human-web-traffic-zh","Cloudflare 機器人流量超越人類：實作指南","\u003Cp data-speakable=\"summary\">這篇教你把 \u003Ca href=\"\u002Ftag\u002Fcloudflare\">Cloudflare\u003C\u002Fa> 的 bot 流量趨勢，落地成可操作的網站檢查、分流與防護流程。\u003C\u002Fp>\u003Cp>這篇給開發者、網站管理者與\u003Ca href=\"\u002Fnews\u002Fsightengine-visual-moderation-right-choice-zh\">安全\u003C\u002Fa>團隊看，重點是把「機器人流量已超過人類流量」這件事，轉成你自己的站台可以執行的檢查清單。照做完，你會拿到一份可驗證的流量分類結果、可套用的爬蟲控制規則，還有一個能區分真人與自動化的分析視圖。\u003C\u002Fp>\u003Cp>你不需要先猜測自己的站有沒有被 bot 淹沒，直接按步驟檢查、標記、限制、再回頭驗收，就能知道哪些流量該留、哪些流量該擋。\u003C\u002Fp>\u003Ch2>開始之前\u003C\u002Fh2>\u003Cul>\u003Cli>Cloudflare 帳號，且可使用 Radar 或已將站點接入 Cloudflare\u003C\u002Fli>\u003Cli>Origin 伺服器或 CDN 設定的管理權限\u003C\u002Fli>\u003Cli>GA4、Logpush 或伺服器日誌的存取權\u003C\u002Fli>\u003Cli>已安裝 Node 20+ 或 Python 3.11+\u003C\u002Fli>\u003Cli>了解 robots.txt、rate limiting 與 HTTP headers 的基本概念\u003C\u002Fli>\u003C\u002Ful>\u003Ch2>Step 1: 開啟 Bot 流量儀表板\u003C\u002Fh2>\u003Cp>目的：先確認你自己的流量組成，是否也跟 Cloudflare 提到的趨勢一致，而不是只看新聞標題。\u003C\u002Fp>\n\u003Cfigure class=\"my-6\">\u003Cimg src=\"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781089384566-ldx3.png\" alt=\"Cloudflare 機器人流量超越人類：實作指南\" class=\"rounded-xl w-full\" loading=\"lazy\" \u002F>\u003C\u002Ffigure>\n\u003Cp>先打開 \u003Ca href=\"https:\u002F\u002Fradar.cloudflare.com\u002F\" target=\"_blank\" rel=\"noopener noreferrer\">Cloudflare Radar\u003C\u002Fa>，查看 bot 與 human 的對照頁；如果你的站已接 Cloudflare，也同步看後台或匯出的日誌。把相同時間區間內的 HTML 請求比例拉出來，先記錄基準值。\u003C\u002Fp>\u003Cp>驗收：你應該看到 bot 與 human 的分拆數字，並且能指出最近一週自動化流量是否持續上升。\u003C\u002Fp>\u003Ch2>Step 2: 分離爬蟲與真人請求\u003C\u002Fh2>\u003Cp>目的：避免把搜尋引擎爬蟲、\u003Ca href=\"\u002Ftag\u002Fai-agent\">AI agent\u003C\u002Fa> 與惡意 bot 混成同一類，導致報表失真。\u003C\u002Fp>\n\u003Cfigure class=\"my-6\">\u003Cimg src=\"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781089391896-q31h.png\" alt=\"Cloudflare 機器人流量超越人類：實作指南\" class=\"rounded-xl w-full\" loading=\"lazy\" \u002F>\u003C\u002Ffigure>\n\u003Cp>用伺服器日誌、WAF 事件或 log pipeline，依 user-\u003Ca href=\"\u002Ftag\u002Fagent\">agent\u003C\u002Fa>、IP reputation、請求頻率與 session 行為來打標。把 Googlebot、Bingbot 這類已知爬蟲，和 AI 訓練爬蟲、可疑自動化分開記錄。若你需要對照格式，可查看 \u003Ca href=\"https:\u002F\u002Fgithub.com\u002Fcloudflare\u002Fcloudflare-docs\" target=\"_blank\" rel=\"noopener noreferrer\">Cloudflare docs repository\u003C\u002Fa> 的範例，再對照自己的 log schema。\u003C\u002Fp>\u003Cp>驗收：你應該看到 dashboard 中出現清楚的流量分類，且已知搜尋爬蟲不再把 bot 總量灌高。\u003C\u002Fp>\u003Ch2>Step 3: 建立高頻自動化控制規則\u003C\u002Fh2>\u003Cp>目的：降低高成本路徑被反覆抓取造成的頻寬浪費與 origin 壓力。\u003C\u002Fp>\u003Cp>針對 search、feeds、article archives 這類昂貴端點，設定 rate limiting、bot score 閾值與 challenge page。若你的內容允許被\u003Ca href=\"\u002Fnews\u002Fturbovec-cuts-vector-db-memory-from-31gb-to-4gb-zh\">索引\u003C\u002Fa>或用於 AI 訓練，就另外定義 allowlist、付費存取或授權條款。先放一份最小可用的 robots.txt 規則，當作政策起點。\u003C\u002Fp>\u003Cpre>\u003Ccode>User-agent: *\nDisallow: \u002Fapi\u002F\nDisallow: \u002Fsearch\u002F\nAllow: \u002Farticles\u002F\n\u003C\u002Fcode>\u003C\u002Fpre>\u003Cp>驗收：你應該看到重複打到高成本路徑的請求下降，origin CPU 或頻寬用量降低，analytics 中的空 session 也變少。\u003C\u002Fp>\u003Ch2>Step 4: 只量真人互動\u003C\u002Fh2>\u003Cp>目的：讓廣告、產品與編輯決策不要被 bot-heavy 流量帶偏。\u003C\u002Fp>\u003Cp>把分析重點改成 human sessions、engaged time、scroll depth、conversion events 與 authenticated actions。若你有廣告業務，還要把 impression logs、viewability 與 fraud check 對齊，避免 programmatic 報表被自動化灌水。當 bot 比例進入 30% 到 40% 區間時，這一步尤其重要。\u003C\u002Fp>\u003Cp>驗收：你應該看到一個 human-only 或 human-weighted 的儀表板，而且它和原始 pageview 數字明顯不同。\u003C\u002Fp>\u003Ch2>Step 5: 寫出 AI agent 政策\u003C\u002Fh2>\u003Cp>目的：建立一套能重複使用的規則，處理合法 agent、抓取行為與未來驗證。\u003C\u002Fp>\u003Cp>把允許的 agents、可存取的 endpoints、以及需要身份證明、\u003Ca href=\"\u002Ftag\u002Fapi\">API\u003C\u002Fa> key 或 signed request 的動作寫成文件。若你提供公開內容，就同步發布政策頁，並和 robots.txt、服務條款、資料授權條件保持一致。內部團隊則要定義誤判申訴流程，確保合法自動化可以快速解封。\u003C\u002Fp>\u003Cp>驗收：你應該拿到一份單一政策文件，讓\u003Ca href=\"\u002Fnews\u002Fkernel-org-turns-linux-source-into-one-safe-hub-zh\">安全\u003C\u002Fa>、工程與法務在新 bot 出現時都能照著處理。\u003C\u002Fp>\u003Ctable>\u003Cthead>\u003Ctr>\u003Cth>指標\u003C\u002Fth>\u003Cth>基準／優化前\u003C\u002Fth>\u003Cth>結果／優化後\u003C\u002Fth>\u003C\u002Ftr>\u003C\u002Fthead>\u003Ctbody>\u003Ctr>\u003Ctd>HTML 請求中的 bot 佔比\u003C\u002Ftd>\u003Ctd>早期期間低於 human traffic\u003C\u002Ftd>\u003Ctd>Cloudflare 指出 bots 已超過 humans\u003C\u002Ftd>\u003C\u002Ftr>\u003Ctr>\u003Ctd>2026 樣本常見 bot 佔比\u003C\u002Ftd>\u003Ctd>約 31% 到 33%\u003C\u002Ftd>\u003Ctd>常落在 30% 到 40% 區間\u003C\u002Ftd>\u003C\u002Ftr>\u003Ctr>\u003Ctd>產業趨勢\u003C\u002Ftd>\u003Ctd>傳統爬蟲主導 bot 組成\u003C\u002Ftd>\u003Ctd>AI 訓練爬蟲與 agent 帶動更快成長\u003C\u002Ftd>\u003C\u002Ftr>\u003C\u002Ftbody>\u003C\u002Ftable>\u003Ch2>常見錯誤\u003C\u002Fh2>\u003Cul>\u003Cli>只看 user-agent。修法：把 user-agent 與頻率、行為、IP reputation 一起判斷。\u003C\u002Fli>\u003Cli>把所有自動化一次封鎖。修法：保留搜尋爬蟲與已核准合作方，對高風險流量再挑戰。\u003C\u002Fli>\u003Cli>直接用 raw pageviews 當受眾數。修法：先分離 human engagement，再做產品或廣告決策。\u003C\u002Fli>\u003C\u002Ful>\u003Ch2>接下來可以看什麼\u003C\u002Fh2>\u003Cp>下一步可以把這套流程延伸成 signed agent verification、內容授權工作流與 origin-side protection，讓你的站在 bot-heavy 網路裡仍能看清真人流量。\u003C\u002Fp>","這篇教你把 Cloudflare 的 bot 流量趨勢，落地成可操作的網站檢查、分流與防護流程。","dallasexpress.com","https:\u002F\u002Fdallasexpress.com\u002Fbusiness-markets\u002Fbots-surpass-human-traffic-online-cloudflare-ceo-says\u002F",null,"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781089384566-ldx3.png","tools","zh","a9a6e43e-5eb8-468a-9c61-7e40d3ef52f5",[17,18,19,20,21,22],"Cloudflare","bot traffic","robots.txt","rate limiting","GA4","WAF",[24,25,26],"先分離 bot、crawler 與真人流量，再做任何判斷。","高成本端點要加上速率限制與挑戰規則。","分析與廣告報表應以 human metrics 為主。",0,"2026-06-10T11:02:25.914435+00:00","2026-06-10T11:02:25.901+00:00","c3c88dd2-a940-438a-b359-0e5a24562273",{"tags":32,"relatedLang":11,"relatedPosts":43},[33,35,37,39,41],{"name":17,"slug":34},"cloudflare",{"name":19,"slug":36},"robotstxt",{"name":20,"slug":38},"rate-limiting",{"name":18,"slug":40},"bot-traffic",{"name":21,"slug":42},"ga4",[44,50,56,62,68,74],{"id":45,"slug":46,"title":47,"cover_image":48,"image_url":48,"created_at":49,"category":13},"1a577d27-7d0b-428a-a3df-ee0ae39c5d5f","devin-pricing-turns-agents-into-seats-zh","Devin 定價把 agents 變 seats","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781096620398-19a8.png","2026-06-10T13:03:10.4842+00:00",{"id":51,"slug":52,"title":53,"cover_image":54,"image_url":54,"created_at":55,"category":13},"2fe98ea1-b9ab-4462-97ce-a1746483d51d","update-cursor-in-1-minute-zh","1 分鐘更新 Cursor","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781092963184-c3rr.png","2026-06-10T12:02:16.930353+00:00",{"id":57,"slug":58,"title":59,"cover_image":60,"image_url":60,"created_at":61,"category":13},"50c3d4d3-c293-473b-8a92-44abbc3a0ded","six-ai-features-short-video-apps-need-2026-zh","六個 AI 功能把短影音做活","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781080447980-jgsj.png","2026-06-10T08:33:00.328765+00:00",{"id":63,"slug":64,"title":65,"cover_image":66,"image_url":66,"created_at":67,"category":13},"f58761cb-a7e6-4ad8-9a3f-39d51c8ea1c4","sightengine-visual-moderation-right-choice-zh","Sightengine 適合做視覺審核，不適合當通用信任與安全平台","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781079476170-smp2.png","2026-06-10T08:17:21.603825+00:00",{"id":69,"slug":70,"title":71,"cover_image":72,"image_url":72,"created_at":73,"category":13},"93efd958-313e-4fb2-b3f2-5219596c8090","scoredetect-ai-content-moderation-rollout-zh","ScoreDetect 推出 AI 審核方案，匹配率 99%","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781078586685-0eb4.png","2026-06-10T08:02:28.020204+00:00",{"id":75,"slug":76,"title":77,"cover_image":78,"image_url":78,"created_at":79,"category":13},"508c3e13-332d-4195-8f7d-e06e7f4c2a00","kernel-org-turns-linux-source-into-one-safe-hub-zh","kernel.org 把 Linux 變成安全樞紐","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1781075013332-0tkm.png","2026-06-10T07:03:04.743101+00:00",[81,86,91,96,101,106,111,116,121,126],{"id":82,"slug":83,"title":84,"created_at":85},"855cd52f-6fab-46cc-a7c1-42195e8a0de4","surepath-real-time-mcp-policy-controls-zh","SurePath 推出即時 MCP 政策控管","2026-03-26T07:57:40.77233+00:00",{"id":87,"slug":88,"title":89,"created_at":90},"9b19ab54-edef-4dbd-9ce4-a51e4bae4ebb","mcp-in-2026-the-ai-tool-layer-teams-use-zh","2026 年 MCP：團隊真的在用的 AI 工具層","2026-03-26T08:01:46.589694+00:00",{"id":92,"slug":93,"title":94,"created_at":95},"af9c46c3-7a28-410b-9f04-32b3de30a68c","prompting-in-2026-what-actually-works-zh","2026 提示工程，真正有用的是什麼","2026-03-26T08:08:12.453028+00:00",{"id":97,"slug":98,"title":99,"created_at":100},"05553086-6ed0-4758-81fd-6cab24b575e0","garry-tan-open-sources-claude-code-toolkit-zh","Garry Tan 開源 Claude Code 工具包","2026-03-26T08:26:20.068737+00:00",{"id":102,"slug":103,"title":104,"created_at":105},"042a73a2-18a2-433d-9e8f-9802b9559aac","github-ai-projects-to-watch-in-2026-zh","2026 必看 20 個 GitHub AI 專案","2026-03-26T08:28:09.619964+00:00",{"id":107,"slug":108,"title":109,"created_at":110},"a5f94120-ac0d-4483-9a8b-63590071ac6a","claude-code-vs-cursor-2026-zh","Claude Code 與 Cursor 深度對比：202…","2026-03-26T13:27:14.279193+00:00",{"id":112,"slug":113,"title":114,"created_at":115},"0975afa1-e0c7-4130-a20d-d890eaed995e","practical-github-guide-learning-ml-2026-zh","2026 機器學習入門 GitHub 實用指南","2026-03-27T01:16:49.712576+00:00",{"id":117,"slug":118,"title":119,"created_at":120},"bfdb467a-290f-4a80-b3a9-6f081afb6dff","aiml-2026-student-ai-ml-lab-repo-review-zh","AIML-2026：像課綱的學生實驗 Repo","2026-03-27T01:21:51.467798+00:00",{"id":122,"slug":123,"title":124,"created_at":125},"80cabc3e-09fc-4ff5-8f07-b8d68f5ae545","ai-trending-github-repos-and-research-feeds-zh","AI Trending：把 AI 資源收成一張表","2026-03-27T01:31:35.262183+00:00",{"id":127,"slug":128,"title":129,"created_at":130},"3ce6e6e2-bac5-463e-9f8d-45caabcc61f7","awesome-ai-for-science-research-tools-map-zh","AI 科研工具清單，開始像地圖了","2026-03-27T01:46:50.521945+00:00"]