Extract a typed list from a JS-heavy SPA
When to use: Site renders the data you need only after JS executes; plain fetch returns nothing.
Flow
-
Define schemaUse browser-act. Schema: items[]{title:str, price:number, available:bool}.✓ Copied→ Schema accepted
-
Visit + extractOpen <url>; wait for the product grid; extract matching the schema.✓ Copied→ Typed JSON list
-
Verify outliersSpot-check 3 random rows by re-fetching their detail page; check parsing is correct.✓ Copied→ Spot-checks pass; or you find a parser bug to fix
Outcome: Reliable typed data; no manual click-through.
Pitfalls
- Site bot-detection blocks after 50 requests — Lower concurrency; rotate UA; respect robots.txt or skip the task