Description
Automate job post extraction from Hacker News — no more manual combing.
Say goodbye to endless scrolling and copy-pasting. This workflow automatically scrapes and structures job listings from Hacker News’ monthly “Who is Hiring” thread into clean, analysis-ready data — with zero manual effort.
Who Is This For 🎯 Job SeekersTo instantly discover and filter through the latest remote and tech job openings
🕵️ Recruiters
To automate job market research, competitor tracking, and talent sourcing
📊 Analysts & Researchers
To study hiring trends, demand by location or stack, and startup activity
🛠️ Builders & Automation Pros
To feed structured job data into dashboards, CRMs, or job alert systems
❗️What Problem Does It Solve
⏳ Manually checking Hacker News job threads each month
🧵 Unstructured comment format makes parsing difficult
📋 Copy-paste and spreadsheet wrangling waste time
📉 No visibility into trends without heavy data cleaning
💡 The Solution
This automation extracts and structures the monthly Hacker News “Who is Hiring” thread into clean, usable data — ready for analysis or integration:
🔗 Automatically fetches the latest “Who is Hiring” post using the HN API
🧹 Extracts job listings from comments and cleans raw text
🧠 Parses key job info like company, role, tech stack, and location
📤 Outputs structured data (JSON, CSV) or sends it to any system
⚙️ How It Works – The Process
📨 Thread Detection
Fetches the latest “Who is Hiring” post from Hacker News
🧵 Comment Scraping
Pulls and processes all comment-level job listings
🔍 Data Parsing
Extracts key fields: company, title, tech stack, location, remote/on-site
📦 Structured Output
Cleans and formats the data into structured formats (JSON, CSV, Sheets)
🔁 Ongoing Automation
Schedules recurring runs to update with new job posts