> ## Documentation Index
> Fetch the complete documentation index at: https://docs.hydrafetch.com/llms.txt
> Use this file to discover all available pages before exploring further.
# Map
> Fast, synchronous URL discovery for a site — without scraping content.
Map enumerates a site's URLs quickly, without scraping any of them. It returns synchronously and costs one credit — the fastest way to see what pages a site has before committing to a crawl.
## When to use
* You want to preview a [Crawl](/endpoints/crawl)'s scope before running it.
* You need a list of a site's URLs to filter down and feed into a [Batch](/endpoints/batch).
* You want to find pages matching a term (e.g. every URL containing `pricing`).
Map returns URLs only — no page content. To get content, pass the URLs to Scrape, Batch, or Crawl.
## Example request
Send a `POST` to `/v1/web/map`. Narrow the results with `search`, `limit`, and discovery options.
```bash cURL theme={null}
curl -X POST https://api.hydrafetch.com/v1/web/map \
-H "X-API-Key: hf_your_key_here" \
-H "Content-Type: application/json" \
-d '{
"url": "https://example.com",
"search": "pricing",
"limit": 1000
}'
```
```javascript Node theme={null}
const res = await fetch("https://api.hydrafetch.com/v1/web/map", {
method: "POST",
headers: {
"X-API-Key": "hf_your_key_here",
"Content-Type": "application/json",
},
body: JSON.stringify({
url: "https://example.com",
search: "pricing",
limit: 1000,
}),
});
const { data } = await res.json();
console.log(data.links);
```
```python Python theme={null}
import requests
res = requests.post(
"https://api.hydrafetch.com/v1/web/map",
headers={"X-API-Key": "hf_your_key_here"},
json={"url": "https://example.com", "search": "pricing", "limit": 1000},
)
print(res.json()["data"]["links"])
```
## Example response
```json theme={null}
{
"data": {
"url": "https://example.com",
"links": [
"https://example.com/",
"https://example.com/pricing"
],
"count": 2
}
}
```
## Request options
The site whose URLs you want to enumerate. Must be `http(s)`.
Also include same-site links found on the starting page, not just the site's page list.
Maximum number of URLs to return. 1–5000. Results are ordered by how recently each page changed, so a limit gives you the **most recently updated** URLs rather than an even sample of the site. On a site where one kind of page changes constantly, such as a shop's product pages, a small limit can return that kind and nothing else. `sitemapInclude` is how you ask for the rest.
Keep only discovered URLs containing this term (e.g. `"pricing"`). Up to 200 characters.
Whether to use the site's published page list: `skip` it, `include` it alongside discovered links, or use it `only`.
On sites that publish several page lists, only read the ones whose address contains one of these comma-separated terms. For example `"pages"` on a shop to reach its policy and information pages instead of its products.
Skip page lists whose address contains any of these comma-separated terms. Compose it with `sitemapInclude`, for example include `"post"` and exclude `"tag,category,author"` to avoid tag and category archives.
Sort by how recently each page changed: `newest` first, or `oldest`. URLs with no recorded date sort last either way.
Also include URLs on subdomains of the site.
Treat URLs that differ only by query string as one.
## Response fields
The site you requested.
The site's discovered URLs.
How many URLs were returned.
Map is one credit regardless of how many URLs come back, and it returns synchronously. It is the cheapest way to size up a site before a crawl or batch.
## Next steps
Full request and response schema with a live playground.
Turn a mapped scope into scraped pages.
Feed mapped URLs into a batch job.
Scrape any single discovered URL.
This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.