xpay hub logo
hub
  • Tools
  • Explore
  • Docs
  • xpay.sh
Tavily Search
Tavily Search
Tool

tavily_crawl

Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth.


Pricing

Per call

$0.02

Model

flat


Pay only for what you use. No subscriptions.
Inputs

instructions

string

select_domains

array

include_favicon

boolean

select_paths

array

max_depth

integer

limit

integer

format

string

extract_depth

string

allow_external

boolean

url *

string

max_breadth

integer
Try It
API
MCP Config
Input Parameters
instructions
Natural language instructions for the crawler. Instructions specify which types of pages the crawler should return.
select_domains
Regex patterns to restrict crawling to specific domains or subdomains (e.g., ^docs\.example\.com$)
select_paths
Regex patterns to select only URLs with specific path patterns (e.g., /docs/.*, /api/v1.*)
max_depth
Max depth of the crawl. Defines how far from the base URL the crawler can explore.
limit
Total number of links the crawler will process before stopping
markdown
format
The format of the extracted web page content. markdown returns content in markdown format. text returns plain text and may increase latency.
basic
extract_depth
Advanced extraction retrieves more data, including tables and embedded content, with higher success but may increase latency
url *
The root URL to begin the crawl
max_breadth
Max number of links to follow per level of the tree (i.e., per page)
Cost per run
Execution cost
$0.02
Deducted from your xPay allowance
xpay hub logo
hub

Marketplace for AI Capabilities. Run agents, tools & prompts with pay-per-use micropayments.

Product
ExploreCollectionsBundles
Resources
Documentationxpay.shGitHub

© 2026 Agentically Inc. All rights reserved.Microtransactions happen via Stablecoins