📊 Social Media Insights Scraper

🚀 Overview

The Social Media Insights Scraper is an Apify Actor that collects and processes data from the most popular social media platforms: • 🎥 YouTube – Extracts metadata, likes, comments, and engagement from video posts. • 📸 Instagram – Gathers insights from posts, reels, and stories, including user information and engagement data. • 🎵 TikTok – Extract title, description and engagement data

This Actor helps marketers, researchers, and data analysts extract actionable insights to track social media performance and analyze trends at scale.

⸻

📥 Input Configuration

To configure the Actor, provide a JSON object in the INPUT field with the following structure:

{ "url": "https://www.instagram.com/p/C4ixfyPOwvP/", "publishedDate": "2025-03-28T14:49:45.182Z" }

🎛️ Input Parameters

Parameter	Type	Description	Required
url	string	URL of the post or video to scrape (Instagram, YouTube, or TikTok).	✅ Yes
publishedDate	string	(Optional) ISO date-time string to filter posts published after a certain date.	❗ No

⸻

📤 Output Format

The results are stored in the Apify Dataset in a structured format. Below is mock data to demonstrate the output:

1[
2    {
3        "url": "https://www.instagram.com/p/C4ixfyPOwvP/",
4        "data": {
5            "url": "https://www.instagram.com/p/C4ixfyPOwvP/",
6            "type": "post",
7            "referenceId": "C4ixfyPOwvP",
8            "platform": "instagram",
9            "result": {
10                "type": "engagement",
11                "likes": 2500,
12                "comments": 180,
13                "engagements": 2680,
14                "screenName": "Samsung Middle East",
15                "username": "@samsung_me",
16                "title": "Samsung Galaxy S24 Launch",
17                "description": "Experience the future of smartphones with the Samsung Galaxy S24, now available with special offers.",
18                "publishedDate": "2025-03-28T14:49:45.182Z"
19            }
20        }
21    },
22    {
23        "url": "https://www.youtube.com/watch?v=dQw4w9WgXcQ",
24        "data": {
25            "url": "https://www.youtube.com/watch?v=dQw4w9WgXcQ",
26            "type": "video",
27            "referenceId": "dQw4w9WgXcQ",
28            "platform": "youtube",
29            "result": {
30                "type": "engagement",
31                "likes": 3400000,
32                "comments": 215000,
33                "engagements": 3615000,
34                "screenName": "Rick Astley",
35                "username": "@rickastleyofficial",
36                "title": "Never Gonna Give You Up",
37                "description": "The official video for Never Gonna Give You Up by Rick Astley.",
38                "publishedDate": "2009-10-25T18:30:00.000Z"
39            }
40        }
41    },
42    {
43        "url": "https://www.tiktok.com/@charlidamelio/video/1234567890",
44        "data": {
45            "url": "https://www.tiktok.com/@charlidamelio/video/1234567890",
46            "type": "video",
47            "referenceId": "1234567890",
48            "platform": "tiktok",
49            "result": {
50                "type": "engagement",
51                "likes": 1200000,
52                "comments": 89000,
53                "engagements": 1289000,
54                "screenName": "Charli D'Amelio",
55                "username": "@charlidamelio",
56                "title": "Dance Challenge",
57                "description": "Charli D'Amelio takes part in the latest TikTok dance challenge.",
58                "publishedDate": "2025-03-20T10:30:00.000Z"
59            }
60        }
61    }
62]

⸻

📊 Output Fields

Field	Type	Description
url	string	The URL of the post or video being scraped.
data.url	string	URL of the post or video.
data.type	string	Type of content (post, reel, video).
data.referenceId	string	Unique ID of the post or video.
data.platform	string	Platform name (instagram, youtube, tiktok).
data.result.type	string	Type of result (engagement).
data.result.likes	integer	Number of likes.
data.result.comments	integer	Number of comments.
data.result.engagements	integer	Total number of engagements.
data.result.screenName	string	Screen name of the account.
data.result.username	string	Username of the account.
data.result.title	string	Title of the post or video.
data.result.description	string	Full description or caption.
data.result.publishedDate	string	ISO date-time string when the post was published.

⸻

📝 How to Run

1. Run in Apify Console • Go to Apify Console. • Create a new task for the Social Media Insights Scraper. • Provide the required input JSON. • Run the task and monitor progress.

⸻

📚 Use Cases

📊 Competitor Analysis

Track how your competitors are performing across multiple platforms by analyzing their engagement metrics.

📈 Trend Analysis

Identify trends by monitoring high-engagement content and popular hashtags.

🔎 Influencer Marketing

Evaluate the performance of influencer partnerships by assessing audience interaction and post reach.

📝 Content Strategy

Refine your content strategy by understanding what types of content generate the most engagement.

⸻

⚙️ Technical Details • Written in Node.js using the Apify SDK. • Supports CheerioCrawler and PuppeteerCrawler for scraping. • Handles rate limiting and retries to avoid platform bans. • Automatically switches between API scraping and HTML parsing based on availability.

⸻

🛠️ Limitations & Rate Limits • Scraping Instagram and TikTok may be subject to IP bans or request limits. • Ensure compliance with each platform’s Terms of Service. • For high-scale scraping, consider using Proxies and rotating IPs.

⸻

📝 Changelog

v1.0.0 (Initial Release) • Added support for scraping YouTube, Instagram, and TikTok. • Included engagement metrics and metadata.

⸻

🧩 Support and Feedback

If you encounter any issues, or have feature requests, please: • 🐛 Report an issue