Crawl
Start Crawl Task
- Documentation
- Community
- Blog
- Langchain
- Llamaindex
- Authentication
- POSTEmbed Text
- DELDelete
- POSTChat
API Documentation
Embedding
Documents
Chat
Crawl
Start Crawl Task
POST
/
v1
/
datastores
/
website
CrawlTaskRequest · object
*
link
Link · string
*
link
Required
string
one_page
One Page · boolean
one_page
boolean
curl --location 'https://api.llmrails.com/v1/datastores/website' \
--header 'Content-Type: application/json' \
--header 'X-API-TOKEN: {token}' \
--data '{
"link": "https://www.llmrails.com/"
}'
{
"id": "00000000-0000-0000-0000-000000000000"
}
curl --location 'https://api.llmrails.com/v1/datastores/website' \
--header 'Content-Type: application/json' \
--header 'X-API-TOKEN: {token}' \
--data '{
"link": "https://www.llmrails.com/"
}'
{
"id": "00000000-0000-0000-0000-000000000000"
}
Body
application/json
link
string
requiredone_page
boolean
default: falseResponse
200 - application/json
id
string
requiredcurl --location 'https://api.llmrails.com/v1/datastores/website' \
--header 'Content-Type: application/json' \
--header 'X-API-TOKEN: {token}' \
--data '{
"link": "https://www.llmrails.com/"
}'
{
"id": "00000000-0000-0000-0000-000000000000"
}