Intro:

The Substack Author Scraper from Apify.com is a powerful web scraping tool designed to retrieve all posts from specific Substack authors. It organizes scraped content into a structured format, making it easy for users to analyze and utilize the data for research or content aggregation.

🔍 What Is Substack Author Scraper?

The Substack Author Scraper is an API tool that extracts articles from a specified Substack author. It is particularly useful for content creators, researchers, and marketers who want to analyze writing trends or collect data for various authors all in one go. The tool not only gathers the titles and publication dates but can also include the full content of each post for deeper insights.

✨ Features

• 🔍 Scrapes all posts from a specified Substack author.
• 📝 Retrieves each article's content.
• 📋 Results are provided in a structured format (list of dictionaries).
• ⚙️ Customizable options to limit the number of posts and include or exclude article content in the results.

🛠️ How to Use It

Step-by-step tutorial:

1. Go to the tool’s page: Substack Author Scraper
2. Click “Try for free” or “Run actor”.
3. Fill in the required input fields:
   • Author name: The name of the Substack author (e.g., "heathercoxrichardson").
   • Limit number of posts: Specify how many recent posts to scrape (e.g., 25).
   • Article content: Boolean flag to include or exclude the full article content (default is false).
4. Click “Run” and wait for results.
5. Download results or send to a webhook for further processing.

🧪 Sample Input (JSON)

json { "author_name": "heathercoxrichardson", "limit": 25, "include_content": true }

📤 Output Data (Fields)

• title: The title of the post.
• url: The URL of the post.
• author: The author's name.
• author_url: The URL of the author's Substack profile.
• published_at: The publication date and time of the post.

If "Article content" is set to true, the output will also include:

• body: A list of content objects representing the structure of the article.

💰 Pricing

This actor is priced at $0.0025 per request. Apify also offers a free tier, allowing users limited access to run the actor before committing to a paid plan.

👨‍💻 Built By

Quentin Payre — from Apify.com

✅ Final Thoughts

The Substack Author Scraper is an invaluable tool for anyone looking to analyze Substack content efficiently. Whether you're a content marketer, a researcher gathering data, or a fan wanting to aggregate your favorite author’s articles, this is a must-try tool.

🔗 Try the Actor Now 👉 Substack Author Scraper