Turn any webpage into clean Markdown.
Input a URL and receive core content in Markdown. Skip the boilerplate and focus on semantic data for your AI models.
Live demo
Try it live.
Change the parameters and run a real request against the endpoint. No account, no key.
Free to try, no account. Costs 1 credit on your own key.
Run the request to see a live response.
curl -X POST https://automatio.ai/api/v1/query \
-H "Authorization: Bearer $AUTOMATIO_API_KEY" \
-H "Content-Type: application/json" \
-d '{"tool":"web_read_url","params":{"url":"https://news.ycombinator.com"}}'How it works
One request, one response.
- 1
Submit target URL
Send a POST request with the URL of the public webpage you need to process.
- 2
Extract core content
The system renders the page and identifies the main article body while filtering out boilerplate elements.
- 3
Receive structured Markdown
Get back a JSON object containing the semantic Markdown text ready for immediate ingestion.
Capabilities
What you get.
Everything this endpoint does, without running the infrastructure yourself.
Boilerplate Removal
Identifies and strips navigation, footers, and sidebars to isolate the main body text automatically.
JavaScript Rendering
Executes client-side scripts to ensure content hidden behind loaders or SPAs is captured correctly.
Semantic Tag Preservation
Maintains the hierarchy of headings, tables, and lists in standard Markdown syntax for readability.
Token Efficient Output
Produces clean text designed to minimize token usage in LLM prompts and vector databases.
Cost of ownership
Build it yourself, or call this.
Both are real options. Here is what each one actually costs you.
Build it yourself
- Manage browser clusters and proxy rotation
- Write custom parsing logic for every different site
- Handle anti-bot challenges and retries
- Manually clean HTML to text.
Automatio API
- One call returns clean Markdown for any site
- Maintenance-free content extraction logic
- Built-in JavaScript rendering and proxying
- Predictable credit-based billing per success.
Integrate
Built for the language you use.
One HTTP endpoint. Copy the call in your language and go.
curl -X POST https://automatio.ai/api/v1/query \
-H "Authorization: Bearer $AUTOMATIO_API_KEY" \
-H "Content-Type: application/json" \
-d '{ "tool": "web_read_url", "params": { "url": "https://example.com" } }'In production
What people build with it.
RAG Pipeline Ingestion
Automatically fetch and convert documentation or industry blogs into Markdown to populate vector stores for context-aware agents.
News & Blog Monitoring
Build automated feeds that extract the full text of new articles for sentiment analysis or internal reporting tools.
LLM Dataset Preparation
Cleanly scrape large volumes of web content into a consistent format for fine-tuning language models without raw HTML noise.
Choosing parameters
Which options matter.
The table below lists what exists. These are the calls worth making deliberately.
- url
Alternatives
When to use something else.
A page that pretends it has no alternatives reads as an advert. These are the other real options.
Puppeteer / Playwright
Better if you need to perform complex user interactions like clicking or filling forms before reading content.
HTML Parsers (Cheerio)
Faster and cheaper if you already have the static HTML and do not need browser rendering or proxy management.
Before you integrate
What it does not do.
The boundaries are as useful as the features. These are the ones worth knowing up front.
Login-Protected Pages
Cannot access data behind a login screen, mandatory session cookie, or private firewall.
Subscription Paywalls
Extraction is limited to publicly accessible text and will not bypass paid subscription barriers.
Complex Visual Layouts
Content in multi-column dashboards or highly interactive maps may be fragmented in the final text.
Scroll-to-Load Content
Only captures content available on initial page load; does not support triggering "load more" buttons.
Reference
1 credit per call- Endpoint
- POST https://automatio.ai/api/v1/query
- Tool ID
- web_read_url
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| url | string | The URL to read and extract content from (e.g., "https://example.com") |
The same endpoints are available over MCP, and the full machine-readable catalogue lives in the API documentation.
Frequently Asked Questions
Find answers to common questions about URL to Markdown API
Same data source
Every Web endpoint.
One key, one endpoint shape. These all bill per successful call the same way.
Web Search API
Retrieve structured organic search results and metadata from global web indices. Build AI agents and research tools without managing proxies or complex parsing.
1 creditScreenshot API
Capture any website as a visual image using the Screenshot API. Customize viewports, full-page renders, and dark mode via a single JSON POST request.
2 creditsOther endpoints
Browse all APIs →Supercharge your workflow with AI Automation
Automatio combines the power of AI agents, web automation, and smart integrations to help you accomplish more in less time.