Scrape & Summarize Webpages with AI

Description

This smart n8n automation flow scrapes the most recent essays from PaulGraham.com, extracts the clean text, and runs powerful GPT-based summarization — turning long reads into digestible insights. Ideal for auto-curated newsletters, learning dashboards, or keeping your personal knowledge stack updated.

Whether you’re an AI newsletter creator, a curious reader, or a content curator — this workflow handles everything from fetching raw web content to generating clean summaries using OpenAI’s GPT models.

🔍 Workflow Breakdown:

🟢 Manual Trigger – Launch the process manually or embed it into broader workflows.

🌐 Scrape PaulGraham.com – Automatically pull links to the most recent essays.

🔗 Extract Essay URLs – Parse raw HTML and isolate valid essay links.

🚦 Limit to Top 3 – Select the latest three essays for summarization (customizable).

📥 Fetch HTML Content – Download the full page content for each essay.

🧽 Clean Up HTML – Strip away scripts, tags, and noise to retain meaningful text.

🧠 Send to OpenAI – Generate insightful summaries using GPT’s TL;DR abilities or custom prompts.

🧾 Merge Summaries – Combine outputs into a formatted summary set for display or delivery.

🧠 Automates the Following:

✅ Curated scraping from top thinkers’ blogs

✅ Full-text cleanup for high-quality input

✅ OpenAI-powered summarization of essays

✅ Clean multi-summary formatting in one shot

✅ Plug-and-play with Notion, newsletters, or Google Sheets

💡 Why Use This Automation:

✅ No coding needed to generate intelligent summaries

✅ Always stay updated with thought leadership essays

✅ Extract high-signal content and skip the fluff

✅ Scalable for more sources, writers, or RSS feeds

✅ Instantly adaptable for content curation, PKM, or research

👤 Ideal For:

✅ AI newsletter authors and content creators

✅ Developers monitoring essays from tech leaders

✅ Self-learners and students summarizing long-form content

✅ Teams centralizing insights from external thought leaders

✅ Productivity and PKM enthusiasts

🔗 Optional Integrations:

• Notion, Obsidian, Markdown – Auto-log summaries into your knowledge base

• Slack, Telegram, Email – Push daily insights to your inbox or chat

• Google Sheets, Airtable – Archive or analyze summaries with metadata

• APIs or Bots – Use in your custom AI reading assistants

🛠 Setup Instructions:

1. 🟢 Use the Manual Trigger to start on-demand

2. 🌍 Adjust the scraping logic if needed for other blogs

3. 🧹 Ensure HTML-to-text cleaning for clean GPT input

4. 🔑 Plug in your OpenAI key and edit the prompt logic

5. 📦 Store, share, or sync the summaries anywhere you like

✨ From Web to Wisdom — Fully Automated

This n8n workflow turns fresh essays into intelligent summaries in minutes. Build AI-powered digests, run personal knowledge workflows, or monitor thought leaders at scale — all without writing a single line of code.