← All Prompts

Playwright Scraper with Proxies + Anti-Bot

Resilient scraper with browser pool, proxy rotation, captcha handling, and structured output.

Automation Web Scraper Free forever
PlaywrightScrapingProxies
Mega Prompt — Copy & Paste into AI
You are a world-class senior engineer with 20+ years of production experience. You have shipped systems used by millions of users worldwide. You write clean, scalable, secure, production-ready code with zero placeholders. You build production scrapers that survive months without breaking.

Build a COMPLETE Playwright scraper. Interview me first:

1. Target sites and pages to scrape
2. Output schema (JSON / SQL / Parquet)
3. Frequency? (one-off, hourly, daily, on-demand API)
4. Proxy strategy? (residential, datacenter, rotating)
5. Anti-bot challenges expected? (Cloudflare, Datadome, captcha)
6. Need login or session reuse?
7. Storage destination? (S3, Postgres, BigQuery)
8. Rate limit and politeness rules
9. Failure handling (retries, alerting, screenshots on error)
10. Deploy target? (Render, Fly, AWS Batch, browserless)

STACK: TypeScript, Playwright with persistent contexts, browser pool, proxy chain manager, BullMQ for job queue, Sentry, S3-compatible storage.

AFTER MY ANSWERS:
A. Show me a PROJECT PLAN: stack, file tree, data models, key flows, dependencies.
B. Ask: "Does this look correct? Anything to add or change?"
C. After I confirm, generate the COMPLETE project — every file in full, no TODOs, no placeholders, no shortcuts. Include configs, env examples, README, and run instructions.
D. Add error handling, input validation, logging, and a sane test setup where applicable.
E. Output files one at a time with clear file path headers so I can copy each into my IDE.
How to use this prompt

Copy the prompt above → open ChatGPT, Claude, Gemini, Copilot or DeepSeek → paste → the AI will interview you about your project, then build complete production-ready code.

Works with: ChatGPT-5 Claude 4.5 Gemini 2.5 Pro Copilot DeepSeek V3 Mistral

About this Automation Prompt

The Playwright Scraper with Proxies + Anti-Bot is a battle-tested mega prompt designed for the Web Scraper stack. Instead of dumping a vague request into ChatGPT or Claude, this prompt turns the AI into a senior engineer that interviews you first, confirms an architecture plan, and only then writes the full project — files, folders, configs and all. The result is production-ready code you can drop straight into a real build, not a half-finished snippet you still have to glue together.

You can paste this prompt into ChatGPT, Claude, Gemini, Copilot, DeepSeek, Mistral Le Chat or any modern reasoning model. It is written to be model-agnostic and stack-aware, so the AI adapts its output to your specific requirements rather than forcing a one-size-fits-all template on your project.

What you'll get

How to Use the Playwright Scraper with Proxies + Anti-Bot

  1. Copy the full prompt from the box above using the "Copy Prompt" button. The clipboard copy includes every instruction the AI needs — do not trim it.
  2. Open your AI assistant — ChatGPT, Claude, Gemini, Copilot or any LLM with a large context window. Start a new conversation so previous chat memory does not pollute the build.
  3. Paste the prompt and hit send. The AI will ask you a structured set of discovery questions about your Web Scraper project — features, screens, auth, payments, design style and target users.
  4. Answer in plain English. You do not need to know technical jargon. The AI translates your answers into the right architecture, libraries and folder structure.
  5. Confirm the plan. The AI will reply with a detailed project plan: file tree, data models, key flows. Approve it or ask for changes before code generation starts.
  6. Receive complete code. Every file is written out in full — no TODOs, no placeholders, no "implement this later" comments. Drop it into your IDE and run.

Why this Prompt Outperforms a Plain Request

Most developers write prompts like "build me a automation app" and get back generic, half-broken boilerplate. The Playwright Scraper with Proxies + Anti-Bot works better for three concrete reasons:

Frequently Asked Questions

Is the Playwright Scraper with Proxies + Anti-Bot free to use?

Yes. Every prompt on AI Prompts Lib is 100% free, no signup or paywall. Copy it, paste into your AI of choice, and start building. We do not log your inputs or your generated code.

Which AI models work best with this prompt?

This prompt is tuned for any modern large-context model: Claude 4 / 4.5 Sonnet, ChatGPT-5 / GPT-4 Turbo, Gemini 2.5 Pro, DeepSeek V3 and Copilot Chat. For very large projects we recommend Claude or Gemini because of their larger output windows.

Can I modify the prompt for my own use case?

Absolutely. Treat the prompt as a starting template — add your brand voice, swap the tech stack hints, or pin specific libraries you already use. The interview + plan + build structure is the magic, not the exact wording.

What if the AI's output has bugs?

Paste the error message back into the same chat and say "fix this and re-emit the affected files in full". Because the prompt forces complete file output, the fix slots straight back into your project without manual stitching.

Share this prompt: Twitter / X WhatsApp LinkedIn Facebook Email

Browse Other Prompt Categories

Prompt copied to clipboard!