> ## Documentation Index
> Fetch the complete documentation index at: https://docs.r28.ai/charter/llms.txt
> Use this file to discover all available pages before exploring further.

# batch_scrape

> Scrape multiple URLs in one batch job. Poll status with batch_scrape_status.

<div className="tool-route"><span className="tool-row-method" data-method="POST">POST</span><code>{"https://api.firecrawl.dev/v2/batch/scrape"}</code></div>

```python firecrawl_batch_scrape.py theme={null}
from charter.packs import firecrawl

result = await firecrawl.batch_scrape.ainvoke({"urls": ...})
```

## Body

<div className="reference-table">
  | Field                                                        | Type                                                                                                                            | Description                                                                                                                                                 |
  | ------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------- |
  | `formats`                                                    | [FormatType](/charter/charter/packs/firecrawl/scrape/objects#formattype) \| [Format](/charter/charter/packs/firecrawl/search/objects#format)\[] | Output formats to include in the response. Strings or objects. The server applies markdown when this is absent.                                             |
  | `onlyMainContent`                                            | `boolean`                                                                                                                       | Only return the main content of the page excluding headers, navs, footers, etc. The server applies true when this is absent.                                |
  | `onlyCleanContent`                                           | `boolean`                                                                                                                       | Beta. LLM pass over markdown to remove residual boilerplate that onlyMainContent can miss.                                                                  |
  | `includeTags`                                                | `string`\[]                                                                                                                     | Tags to include in the output.                                                                                                                              |
  | `excludeTags`                                                | `string`\[]                                                                                                                     | Tags to exclude from the output.                                                                                                                            |
  | `maxAge`                                                     | `integer`                                                                                                                       | Returns a cached version of the page if it is younger than this age in milliseconds. The server applies 172800000 (2 days) when this is absent.             |
  | `minAge`                                                     | `integer`                                                                                                                       | When set, the request only checks the cache and never triggers a fresh scrape.                                                                              |
  | `headers`                                                    | map of `string`                                                                                                                 | Headers to send with the request.                                                                                                                           |
  | `waitFor`                                                    | `integer`                                                                                                                       | Specify a delay in milliseconds before fetching the content. The server applies 0 when this is absent.                                                      |
  | `mobile`                                                     | `boolean`                                                                                                                       | Emulate scraping from a mobile device.                                                                                                                      |
  | `skipTlsVerification`                                        | `boolean`                                                                                                                       | Skip TLS certificate verification when making requests.                                                                                                     |
  | `timeout`                                                    | `integer`                                                                                                                       | Timeout in milliseconds. The server applies 60000 when this is absent. <span className="field-constraints">≥ 1000; ≤ 300000</span>                          |
  | `parsers`                                                    | `string` \| [PdfParser](/charter/charter/packs/firecrawl/search/objects#pdfparser)\[]                                                   | Controls how files are processed during scraping.                                                                                                           |
  | `actions`                                                    | [Action](/charter/charter/packs/firecrawl/search/objects#action)\[]                                                                     | Actions to perform on the page before grabbing the content.                                                                                                 |
  | `location`                                                   | [ScrapeLocation](/charter/charter/packs/firecrawl/search/objects#scrapelocation)                                                        | Location settings for the request.                                                                                                                          |
  | `removeBase64Images`                                         | `boolean`                                                                                                                       | Removes all base64 images from the markdown output.                                                                                                         |
  | `blockAds`                                                   | `boolean`                                                                                                                       | Enables ad-blocking and cookie popup blocking.                                                                                                              |
  | `proxy`                                                      | `"basic" \| "enhanced" \| "auto"`                                                                                               | Specifies the type of proxy to use.                                                                                                                         |
  | `storeInCache`                                               | `boolean`                                                                                                                       | If true, the page will be stored in the Firecrawl index and cache.                                                                                          |
  | `lockdown`                                                   | `boolean`                                                                                                                       | Serve from cache only and never make an outbound request. On miss, returns 404 SCRAPE\_LOCKDOWN\_CACHE\_MISS.                                               |
  | `redactPII`                                                  | `boolean` \| [RedactPIIOptions](/charter/charter/packs/firecrawl/search/objects#redactpiioptions)                                       | Redact personally identifiable information from returned markdown. Pass true for defaults, or an object to tune it.                                         |
  | `profile`                                                    | [BrowserProfile](/charter/charter/packs/firecrawl/search/objects#browserprofile)                                                        | Persistent browser storage across scrape and interact sessions.                                                                                             |
  | `threatProtection`                                           | [ThreatProtectionOverride](/charter/charter/packs/firecrawl/search/objects#threatprotectionoverride)                                    | Per-request threat protection override. Enterprise feature.                                                                                                 |
  | `auditMetadata`                                              | [AuditMetadata](/charter/charter/packs/firecrawl/search/objects#auditmetadata)                                                          | User attribution included with SIEM logging events when SIEM is enabled.                                                                                    |
  | `urls` <span className="required" title="required">\*</span> | `string`\[]                                                                                                                     | The URLs to scrape                                                                                                                                          |
  | `webhook`                                                    | [Webhook](/charter/charter/packs/firecrawl/batch/objects#webhook)                                                                       | Webhook specification for batch scrape lifecycle events.                                                                                                    |
  | `maxConcurrency`                                             | `integer`                                                                                                                       | Maximum number of concurrent scrapes for this batch.                                                                                                        |
  | `ignoreInvalidURLs`                                          | `boolean`                                                                                                                       | If invalid URLs are specified, they are ignored and returned in invalidURLs instead of failing the request.                                                 |
  | `zeroDataRetention`                                          | `boolean`                                                                                                                       | If true, this will enable zero data retention for this batch scrape. To enable this feature, please contact [help@firecrawl.dev](mailto:help@firecrawl.dev) |
</div>
