Web Scraper API
Fetch raw HTML from any website with full JavaScript rendering and advanced proxy support. Bypass bot detection and scrape dynamic content reliably.
Endpoint
HTTP
GET https://opengraph.io/api/1.1/scrape/{encoded_url}?app_id=YOUR_APP_IDParameters
Path Parameters
| Parameter | Type | Description |
|---|---|---|
| encoded_url | string | Required. URL-encoded target URL |
Query Parameters
| Parameter | Type | Default | Description |
|---|---|---|---|
| app_id | string | - | Required. Your API key |
| full_render | boolean | false | Enable JavaScript rendering (required for SPAs) |
| cache_ok | boolean | true | Allow cached results |
| use_proxy | boolean | false | Use standard datacenter proxy |
| use_premium | boolean | false | Use residential proxy (better for protected sites) |
| use_superior | boolean | false | Use mobile proxy (best for heavily protected sites) |
| accept_lang | string | en-US | Language header for localized content |
Example Request
curl "https://opengraph.io/api/1.1/scrape/https%3A%2F%2Fexample.com?app_id=YOUR_APP_ID"Example Response
Response
{
"htmlContent": "<!DOCTYPE html><html>...</html>",
"requestInfo": {
"redirects": 0,
"host": "example.com",
"responseCode": 200,
"responseContentType": "text/html"
}
}Proxy Options
For sites with bot protection, use our proxy options to bypass blocks. See the Proxy Options guide for details on proxy types and credit costs.
Use Cases
- Content aggregation and monitoring
- Market research and competitive analysis
- Data validation and verification
- SEO auditing
- Price monitoring
MCP Tool
This endpoint is available as the Scrape tool in the OpenGraph MCP Server. Your AI assistant can scrape pages directly without writing any code.