0:00 / 0:00

Add Firecrawl As A Custom Connector

From the course: Agentic AI For Founders & Senior Operators

Firecrawl is a web scraper that can do much more than Claude's own web search and fetch. Go to Customize, click Add custom connector and name it, for example Firecrawl Web Scraper. It works the same way in Claude Code and Claude chat, and once it's connected you can ask Claude to scrape pages such as the latest Bloomberg articles on a story.

Transcript

Okay, so what we are now going to do, and don't execute this prompt just yet, is we're actually going to scrape the web with Claude. So obviously there's a lot that's been happening with NVIDIA and so we are actually going to use a service called Firecrawl, which is the best web scraper I know of at the moment. And we're going to use that to search the latest Bloomberg articles on the NVIDIA story. Now again, these are just generic examples. You can use Firecrawl to practically scrape any page on the internet. It's a little creative with paywalls, I've seen. Sometimes it's able to bypass them, sometimes not. Now Claude also has something called Web Search and Web Fetch that I showed you in the previous slide, but that is significantly limited vis-a-vis what Firecrawl can do. So first we're going to set up Firecrawl and then we're going to execute this prompt on it. The way to set this up, and I'll do this with you, same for both Code and Chat, so no difference, is you want to... so just follow along with me on this. Let me bring up my regular Claude now. So what you'll do is you'll go to the Customize section here, and then you will click on Add custom connector here. Okay. And then what I want you to call it is you can call it Firecrawl Web Scraper. Like that.