Overview
Key Features
- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and etc.
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Example Queries
- Could you scrape
https://www.google.com/search?q=aipage?
- Scrape
https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651Vwith parse enabled
- Scrape
https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0with parse and render enabled
- Use web unblocker with render to scrape
https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c
Prerequisites
- Oxylabs Account: Obtain your username and password from Oxylabs (1-week free trial available)
Basic Usage
- Node.js (v16+)
npxcommand-line tool
uvpackage manager install it using this guide
Local/Dev Setup
- Python 3.12+
uvpackage manager install it using this guide
API Parameters
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
Basic Setup Instructions
Install via Smithery
- claude
- cursor
Manual MCP configuration options
- Config with
uvx. Will install the CLI client and Oxylabs MCP server that performs calls directly to the Oxylabs API. Recommended and the most stable option at the moment.
- Config with
npx. Will install the Smithery CLI client that performs calls to the Oxylabs MCP server hosted in Smithery.
- Config with
uv. Will install CLI client and Oxylabs MCP server that references the local code. For the local development.
[!NOTE] If you don't haveuvxutility you need to install it first withbrew install uv
[!TIP] If you run into errors withuvx, try using the full path touvxin thecommandfield. For example,/Users/my-user/.local/bin/uvx. If you are using Windows and experiencing issues with Cursor, refer to the guidelines described here.
Manual Setup with Claude Desktop
claude_desktop_config.json file.Manual Setup with Cursor AI
Local/Dev Setup Instructions
Clone repository
Install dependencies
Debugging
http://localhost:5173. You may need to add your username and password as environment variables in the inspector under OXYLABS_USERNAME and OXYLABS_PASSWORD.Technical Details
- oxylabs_scraper: Uses Oxylabs Web Scraper API for general website scraping
- oxylabs_web_unblocker: Uses Oxylabs Web Unblocker for hard-to-access websites
License
About Oxylabs
Overview
Key Features
- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and etc.
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Example Queries
- Could you scrape
https://www.google.com/search?q=aipage?
- Scrape
https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651Vwith parse enabled
- Scrape
https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0with parse and render enabled
- Use web unblocker with render to scrape
https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c
Prerequisites
- Oxylabs Account: Obtain your username and password from Oxylabs (1-week free trial available)
Basic Usage
- Node.js (v16+)
npxcommand-line tool
uvpackage manager install it using this guide
Local/Dev Setup
- Python 3.12+
uvpackage manager install it using this guide
API Parameters
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
Basic Setup Instructions
Install via Smithery
- claude
- cursor
Manual MCP configuration options
- Config with
uvx. Will install the CLI client and Oxylabs MCP server that performs calls directly to the Oxylabs API. Recommended and the most stable option at the moment.
- Config with
npx. Will install the Smithery CLI client that performs calls to the Oxylabs MCP server hosted in Smithery.
- Config with
uv. Will install CLI client and Oxylabs MCP server that references the local code. For the local development.
[!NOTE] If you don't haveuvxutility you need to install it first withbrew install uv
[!TIP] If you run into errors withuvx, try using the full path touvxin thecommandfield. For example,/Users/my-user/.local/bin/uvx. If you are using Windows and experiencing issues with Cursor, refer to the guidelines described here.
Manual Setup with Claude Desktop
claude_desktop_config.json file.Manual Setup with Cursor AI
Local/Dev Setup Instructions
Clone repository
Install dependencies
Debugging
http://localhost:5173. You may need to add your username and password as environment variables in the inspector under OXYLABS_USERNAME and OXYLABS_PASSWORD.Technical Details
- oxylabs_scraper: Uses Oxylabs Web Scraper API for general website scraping
- oxylabs_web_unblocker: Uses Oxylabs Web Unblocker for hard-to-access websites