curl -X POST 'https://api.firecrawl.dev/v1/llmstxt' \
  -H "Authorization: Bearer $FIRECRAWL_API_KEY" \
  -H 'Content-Type: application/json' \
  -d '{
  "url": "https://example.com",
  "maxUrls": 2,
  "showFullText": false
}'

# POST /llmstxt (Firecrawl API)
Base URL: https://api.firecrawl.dev/v1
Auth: Authorization: Bearer <FIRECRAWL_API_KEY>
Last verified: 2026-10-20

> Generate LLMs.txt for a website

## Critical Gotchas
* The `formats` field controls the output shape and defaults to `["markdown"]`. Omitting it does not return HTML — request `["markdown","html"]` explicitly.
* `/crawl` is asynchronous: it returns a job `id`, and results are collected by polling `/crawl/{id}` until `status` is `completed`.

## cURL
curl -X POST 'https://api.firecrawl.dev/v1/llmstxt' \
  -H "Authorization: Bearer $FIRECRAWL_API_KEY" \
  -H 'Content-Type: application/json' \
  -d '{"url":"https://example.com","maxUrls":2,"showFullText":false}'

## Parameters
| Name | In | Type | Required | Description |
| :--- | :--- | :--- | :--- | :--- |
| url | body | string | Yes | The URL to generate LLMs.txt from |
| maxUrls | body | integer | No | Maximum number of URLs to analyze |
| showFullText | body | boolean | No | Include full text content in the response |

## Response (200 OK)
{"success":true,"id":"00000000-0000-4000-8000-000000000000"}

---
Need an API key? Get one at https://firecrawl.link/ligabazi

POST

POST /llmstxt — Firecrawl API

Firecrawl API

Generate LLMs.txt for a website

Base URL: https://api.firecrawl.dev/v1
Auth: Authorization: Bearer <FIRECRAWL_API_KEY>
Last verified: 2026-10-20 · upstream hash matched

Actions Try in browser→

Agents: curl -H "Accept: text/markdown" this URL
→ 223 tokens · Vary: Accept

Critical gotchas

The formats field controls the output shape and defaults to ["markdown"]. Omitting it does not return HTML — request ["markdown","html"] explicitly.

/crawl is asynchronous: it returns a job id, and results are collected by polling /crawl/{id} until status is completed.

cURL

curl -X POST 'https://api.firecrawl.dev/v1/llmstxt' \  -H "Authorization: Bearer $FIRECRAWL_API_KEY" \  -H 'Content-Type: application/json' \  -d '{  "url": "https://example.com",  "maxUrls": 2,  "showFullText": false}'

Parameters

Name	In	Type	Required	Description
url	body	string	Yes	The URL to generate LLMs.txt from
maxUrls	body	integer	No	Maximum number of URLs to analyze
showFullText	body	boolean	No	Include full text content in the response

Response 200 OK

{
  "success": true,
  "id": "00000000-0000-4000-8000-000000000000"
}

Get a free Firecrawl API key → sponsored

Affiliate link - we may earn a commission, at no extra cost to you.