Overview
Key Features
- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and etc.
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Example Queries
- Could you scrape
https://www.google.com/search?q=ai
page?
- Scrape
https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651V
with parse enabled
- Scrape
https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0
with parse and render enabled
- Use web unblocker with render to scrape
https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c
Prerequisites
- Oxylabs Account: Obtain your username and password from Oxylabs (1-week free trial available)
Basic Usage
- Node.js (v16+)
npx
command-line tool
uv
package manager install it using this guide
Local/Dev Setup
- Python 3.12+
uv
package manager install it using this guide
API Parameters
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
Basic Setup Instructions
Install via Smithery
- claude
- cursor
Manual MCP configuration options
- Config with
uvx
. Will install the CLI client and Oxylabs MCP server that performs calls directly to the Oxylabs API. Recommended and the most stable option at the moment.
- Config with
npx
. Will install the Smithery CLI client that performs calls to the Oxylabs MCP server hosted in Smithery.
- Config with
uv
. Will install CLI client and Oxylabs MCP server that references the local code. For the local development.
[!NOTE] If you don't haveuvx
utility you need to install it first withbrew install uv
[!TIP] If you run into errors withuvx
, try using the full path touvx
in thecommand
field. For example,/Users/my-user/.local/bin/uvx
. If you are using Windows and experiencing issues with Cursor, refer to the guidelines described here.
Manual Setup with Claude Desktop
claude_desktop_config.json
file.Manual Setup with Cursor AI
Local/Dev Setup Instructions
Clone repository
Install dependencies
Debugging
http://localhost:5173
. You may need to add your username and password as environment variables in the inspector under OXYLABS_USERNAME
and OXYLABS_PASSWORD
.Technical Details
- oxylabs_scraper: Uses Oxylabs Web Scraper API for general website scraping
- oxylabs_web_unblocker: Uses Oxylabs Web Unblocker for hard-to-access websites
License
About Oxylabs
Overview
Key Features
- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and etc.
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Example Queries
- Could you scrape
https://www.google.com/search?q=ai
page?
- Scrape
https://www.amazon.de/-/en/Smartphone-Contract-Function-Manufacturer-Exclusive/dp/B0CNKD651V
with parse enabled
- Scrape
https://www.amazon.de/-/en/gp/bestsellers/beauty/ref=zg_bs_nav_beauty_0
with parse and render enabled
- Use web unblocker with render to scrape
https://www.bestbuy.com/site/top-deals/all-electronics-on-sale/pcmcat1674241939957.c
Prerequisites
- Oxylabs Account: Obtain your username and password from Oxylabs (1-week free trial available)
Basic Usage
- Node.js (v16+)
npx
command-line tool
uv
package manager install it using this guide
Local/Dev Setup
- Python 3.12+
uv
package manager install it using this guide
API Parameters
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
[object Object] | [object Object] | [object Object] |
Basic Setup Instructions
Install via Smithery
- claude
- cursor
Manual MCP configuration options
- Config with
uvx
. Will install the CLI client and Oxylabs MCP server that performs calls directly to the Oxylabs API. Recommended and the most stable option at the moment.
- Config with
npx
. Will install the Smithery CLI client that performs calls to the Oxylabs MCP server hosted in Smithery.
- Config with
uv
. Will install CLI client and Oxylabs MCP server that references the local code. For the local development.
[!NOTE] If you don't haveuvx
utility you need to install it first withbrew install uv
[!TIP] If you run into errors withuvx
, try using the full path touvx
in thecommand
field. For example,/Users/my-user/.local/bin/uvx
. If you are using Windows and experiencing issues with Cursor, refer to the guidelines described here.
Manual Setup with Claude Desktop
claude_desktop_config.json
file.Manual Setup with Cursor AI
Local/Dev Setup Instructions
Clone repository
Install dependencies
Debugging
http://localhost:5173
. You may need to add your username and password as environment variables in the inspector under OXYLABS_USERNAME
and OXYLABS_PASSWORD
.Technical Details
- oxylabs_scraper: Uses Oxylabs Web Scraper API for general website scraping
- oxylabs_web_unblocker: Uses Oxylabs Web Unblocker for hard-to-access websites