Automate data extraction from public directories and build ready-to-go lists without ever leaving Clay.
Clay (Free): to scrape paginated databases online and enrich results
Say goodbye to copy-pasting listings by hand. Now Clay automates it for you.
This Claybook shows you how to scrape data from public databases like Psychology Today, automatically generate profile URLs for each record using Clay’s integration with Google Search, and enrich those records with emails, phone numbers, or other data.
Whether you’re building prospect lists or researching a niche segment, you can handle the entire workflow without leaving Clay.
How it works:
First, copy this template in Clay.
If you’re already a user, you’ll be directed to your workspace. If not, you’ll be prompted to create a free Clay account.
The interactive demos on the right will walk you through each step of this Claybook.
Next, we need to identify the URLs of the public database you want Clay to scrape into your table. In this example, we’re targeting New York–based therapists listed in Psychology Today’s online directory.
First, locate the URL for the New York therapist listings on Psychology Today. Then, use a Clay formula to generate URLs for each page of that directory. Clay’s scraper will use these URLs to automatically pull in the data.
Next, after the table automatically writes each individual therapist listing to a new table, using Clay’s native integration with Google Search, find the user profile URL of every therapist. Or in your case, the direct profile URL of every result in the database.
From here, you can further enrich results with work emails, phone numbers, and more.
Start scraping listings from public databases, directly in Clay.
Simply copy this template, follow the steps above, and let Clay work its magic.
Check out Clay University, read our GTM blog, or try out our top templates to transform your growth ideas into outreach in minutes.