Map a Website with the Clay Chrome Extension

Get data from websites with the Clay Chrome Extension that may not have been picked up by the auto-scrape option.

Clay Team
2 min
Overview

Overview

Our Clay Chrome extension can scrape essentially any website on the internet and export the scraped data back to a clay table. However, sometimes a site may not be picked up by our auto-scraper, which means mapping it yourself may be your best option. Here's how to do it:

First, determine whether the page that your scraping contains a list or not. If you want to scrape a list of

  1. ´╗┐´╗┐´╗┐Open up the Clay Chrome Extension.
  2. ´╗┐´╗┐´╗┐Click on the "Select Data" tab on the upper right portion of the tab.
  3. ´╗┐´╗┐´╗┐Click "Create Recipe and Select Data"
  4. ´╗┐´╗┐´╗┐Click "Select Data to Add From Page" and then "Select a List"
  5. ´╗┐´╗┐´╗┐Select two different items on the list for Clay to detect
  6. ´╗┐´╗┐´╗┐Then, click "Select a list item attribute to add"
  7. ´╗┐´╗┐´╗┐From there, click on an attribute you want to add, name it, make sure you select the right type (text, image, link, etc.)
  8. ´╗┐´╗┐´╗┐Do this with every attribute you want mapped.
  9. ´╗┐´╗┐´╗┐Save your recipe and name it.

If you want to scrape an individual page, follow these steps:

  1. ´╗┐´╗┐´╗┐Open up the Clay Chrome Extension.
  2. ´╗┐´╗┐´╗┐Click on the "Select Data" tab on the upper right portion of the tab.
  3. ´╗┐´╗┐´╗┐Click "Create Recipe and Select Data"
  4. ´╗┐´╗┐´╗┐Click "Select Data to Add From Page" and then "Select an Single Attribute"
  5. ´╗┐´╗┐´╗┐From there, click on an attribute you want to add, name it, make sure you select the right type (text, image, link, etc.)
  6. ´╗┐´╗┐´╗┐Do this with every attribute you want mapped.
  7. ´╗┐´╗┐´╗┐Make sure that in the "Match recipes to all URLs like" section is formatted to fit every individual page you want to scrape. For example, to detect every Y Combinator Company in the directory, make sure it's set to scrape every page that fits the URL ycombinator.com/companies/:companyname.
  8. ´╗┐´╗┐´╗┐Save your recipe and name it.

    We hope this helps, and happy prospecting!

ÔÇŹ

Tools Used
More like this
Explore More