Single City
Country-Wide PRO
Number of website URLs to find
Start the job and leave. Come back later to download results.

πŸ“Š Scraping Results

0
URLs Found
0
Businesses Checked

πŸ“‹ Scraping Jobs PRO

Loading jobs...

πŸ“₯ Import Emails Step 1

(0 emails)

πŸ“‹ Background Jobs PRO

Loading jobs...

Enter the homepage URL of the website you want to scrape

πŸ“‹ Website Scraping Jobs

Loading jobs...

πŸ”— API Access

Access your scraped data via API:

GET /api/website-data/{job_id}

Returns JSON with all pages, content, headings, images, and links from the scraped website.

🌐 Website URLs
πŸ“§ All Email Files
βœ… Validated Emails

πŸ“Š API Usage Analytics

Monthly API Calls FREE
0 / 10
-
Total API Calls
-
Completed
-
Pages Scraped
-
Unique Domains
-
Webhooks Sent

πŸ• Recent API Jobs

Loading...

🌐 Top Scraped Domains

Loading...

πŸ”‘ Your API Keys

Loading API keys...

πŸ“– API Documentation

Base URL

https://scrape.iraady.com/api/external

Authentication

Include your API key in the request headers:

X-API-Key: sk_your_api_key_here
POST /scrape

Submit a website scraping job with optional webhook callback

Request Body:
{
  "url": "https://example.com",
  "callbackUrl": "https://your-site.com/webhook",
  "maxPages": 50,
  "maxDepth": 3
}
Response:
{
  "success": true,
  "jobId": "uuid-here",
  "status": "running",
  "statusUrl": "/api/external/jobs/uuid-here",
  "callbackUrl": "https://your-site.com/webhook"
}
GET /jobs/:jobId

Check the status of a scraping job

Response:
{
  "job": {
    "id": "uuid",
    "url": "https://example.com",
    "domain": "example.com",
    "status": "completed",
    "pages_scraped": 42,
    "webhook_sent": true
  }
}
GET /jobs/:jobId/results

Get the full scraped data for a completed job

Response (Full Website Data):
{
  "website": {
    "url": "https://example.com",
    "domain": "example.com",
    "scrapedAt": "2024-01-15T10:30:00Z",
    "totalPages": 42
  },
  "pages": [
    {
      "url": "https://example.com",
      "title": "Example Company",
      "description": "Meta description...",
      "headings": {
        "h1": ["Main Heading"],
        "h2": ["About Us", "Services"],
        "h3": ["Team", "Contact"]
      },
      "paragraphs": ["Content text..."],
      "images": [
        {"src": "https://...", "alt": "Logo"}
      ],
      "links": [
        {"href": "https://...", "text": "Learn More"}
      ],
      "mainContent": "Extracted main content...",
      "structuredData": {...}
    }
  ]
}
GET /jobs

List all your scraping jobs (most recent 50)

POST /jobs/:jobId/cancel

Cancel a running scraping job

πŸ“€ Webhook Callback

When a job completes, we'll POST the full results to your callbackUrl:

{
  "jobId": "uuid-here",
  "status": "completed",
  "url": "https://example.com",
  "domain": "example.com",
  "pagesScraped": 42,
  "data": {
    "website": {
      "url": "https://example.com",
      "domain": "example.com",
      "scrapedAt": "2024-01-15T10:30:00Z",
      "totalPages": 42
    },
    "pages": [
      {
        "url": "https://example.com",
        "title": "Example Company",
        "description": "Meta description...",
        "headings": {...},
        "paragraphs": [...],
        "images": [...],
        "links": [...],
        "mainContent": "...",
        "structuredData": {...}
      }
    ]
  }
}

Headers sent with webhook:
β€’ Content-Type: application/json
β€’ X-Webhook-Source: scrape.iraady.com
β€’ X-Job-Id: {jobId}

πŸ’» Code Example (JavaScript)

// Submit a scraping job
const response = await fetch('https://scrape.iraady.com/api/external/scrape', {
  method: 'POST',
  headers: {
    'Content-Type': 'application/json',
    'X-API-Key': 'sk_your_api_key_here'
  },
  body: JSON.stringify({
    url: 'https://example.com',
    callbackUrl: 'https://marketingai.iraady.com/api/brands/import',
    maxPages: 50,
    maxDepth: 3
  })
});

const { jobId } = await response.json();
console.log('Job started:', jobId);

// The results will be POSTed to your callbackUrl when complete!

Account Information

Import from your previous GMB scrapes
Accepts .csv, .xlsx, .xls files with URLs
Free: up to 50 URLs | Professional: up to 100,000 URLs
How many levels of links to follow
How many websites to scrape simultaneously. Higher = faster but uses more resources.
Process large URL lists in the background. You can leave and check progress later.

πŸ“Š Extraction Results

0
Emails Found
0
Sites Scraped

πŸ“‹ Email Extraction Jobs PRO

Loading jobs...

Preview