How to scrape data from a Cloudflare-protected site for authorized research
何時使用: You need to extract data from a site you're authorized to access but standard scraping tools get blocked.
前置條件
- stealth-browser-mcp installed — Clone repo, pip install -r requirements.txt
- Authorization to access the target site — Ensure you have permission to scrape the site
步驟
-
Navigate to the siteOpen a stealth browser and navigate to https://example.com/data. Wait for the page to fully load.✓ 已複製→ Page loaded successfully, bypassing protection
-
Extract dataQuery all elements matching the product listing cards. Extract titles, prices, and URLs.✓ 已複製→ Structured data from the page
結果: Data extracted from the protected site for authorized analysis.
注意事項
- Running too many concurrent browsers — Keep to 1-2 browser instances at a time to avoid detection patterns