Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that provides tools for scraping, searching, and extracting structured data from the web at scale without getting blocked. This Arcade toolkit exposes Bright Data's proxy and dataset infrastructure through three tools covering markdown scraping, multi-engine search, and structured data feeds.
Capabilities
- Web scraping: Fetch any public webpage and receive clean Markdown output, suitable for LLM ingestion or content analysis.
- Multi-engine search: Query Google, Bing, or Yandex with configurable result count, search type (web, images, etc.), and country targeting.
- Structured data extraction: Pull normalized JSON records from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, Zillow, Booking.com, YouTube, and ZoomInfo — no custom parsing required.
- Anti-block infrastructure: All requests route through Bright Data's proxy network, handling CAPTCHAs, rate limits, and bot detection automatically.
Secrets
BRIGHTDATA_API_KEY — Your Bright Data account API key, used to authenticate all requests to Bright Data's APIs. Obtain it from the Bright Data dashboard under Account Settings → API Key (requires a registered Bright Data account; free trial available). See Bright Data API documentation for details.
BRIGHTDATA_ZONE — The name of a Bright Data zone (proxy zone or dataset zone) that the toolkit routes requests through. Zones are created in the Bright Data dashboard under Proxies & Scraping Infrastructure; the zone name is the string identifier you assign when creating a zone (e.g., residential_1 or scraping_browser). The required zone type depends on your use case (residential, datacenter, or scraping browser). See Bright Data zone setup for guidance.
Store secrets in Arcade at https://api.arcade.dev/dashboard/auth/secrets. For general guidance on using secrets in Arcade tools, see https://docs.arcade.dev/en/guides/create-tools/tool-basics/create-tool-secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |