Skip to content
Nick Saraev
1:13:10
4 004
176
48
Last update : 23/08/2024

Make.com Web Scraping: From Zero to Hero 🤖

What is Web Scraping? 🤔

It’s like copying and pasting on autopilot! Instead of manually grabbing info from websites, we use code to automatically extract specific data.

Example: Imagine grabbing contact details from hundreds of websites in minutes. That’s web scraping in action! 🤯

Static vs. Dynamic Websites 🧱

Static Websites:

  • Think of them like brochures. The content is pre-built and doesn’t change unless someone edits the website’s code.
  • Easy to scrape! Just grab the website’s HTML code, and you have all the data.

Dynamic Websites:

  • More like apps. Content changes based on user interaction or real-time updates.
  • Trickier to scrape. Requires tools that can render the website like a real user would.

Scraping with Make.com 🛠️

1. The HTTP Module: Your Trusty Sidekick 🤝

  • Use it to “make a request” to a website and grab its HTML code.
  • Think of it like sending a digital envelope to a website asking politely for its content. ✉️

2. Parsing: Making Sense of the Chaos 🧩

  • Raw HTML is messy. Parsing helps us extract specific data points like email addresses or product prices.
  • Tools like the “HTML to Text” module and Regex (Regular Expressions) are your parsing pals.

3. AI to the Rescue! 🧠

  • AI can analyze website content and extract structured data like product descriptions or reviews.
  • Services like Anthropic Cloud and DataForSEO are your secret weapons for AI-powered scraping.

Unlocking Dynamic Websites 🔓

  • Use specialized tools like Apify or DataForSEO that act as a middleman, loading the website fully and giving us the parsed data.
  • Imagine them as your personal assistants, browsing the web and handing you the good stuff on a silver platter! 🍽️

The Power of Hidden APIs 🤫

  • Some websites have “secret” APIs that give us direct access to their databases.
  • It’s like finding a backdoor to a website’s vault, where all the valuable data is stored. 💰

Level Up Your Scraping Game 🚀

  • Start small: Practice scraping simple static websites before tackling dynamic ones.
  • Respect website rules: Don’t overload websites with requests. Be mindful of their terms of service.
  • Stay curious: The world of web scraping is vast and constantly evolving. Keep experimenting and learning new tricks!

Resources:

Other videos of

Nick Saraev
0:21:23
294
38
7
Last update : 02/05/2025
Nick Saraev
0:33:06
536
76
8
Last update : 01/05/2025
Nick Saraev
0:38:19
343
39
7
Last update : 22/04/2025
Nick Saraev
0:23:19
29
4
2
Last update : 21/04/2025
Nick Saraev
0:40:40
132
12
1
Last update : 20/04/2025
Nick Saraev
0:40:29
366
62
7
Last update : 19/04/2025
Nick Saraev
0:49:51
1 599
136
14
Last update : 18/04/2025
Nick Saraev
0:51:08
32
4
4
Last update : 17/04/2025
Nick Saraev
0:17:29
929
98
19
Last update : 17/04/2025