Top Twitch User Scrape logo

Top Twitch User Scrape

Get top subscribed twitch user list from twitchtracker

lime_incline
$0
Try Now →

Twitch User Scraper

This project is an Apify actor that scrapes user data from Twitch Tracker's channel rankings. It uses the Apify SDK and Crawlee to efficiently crawl and extract information from multiple pages of Twitch channel rankings.

Features

  • Scrapes Twitch channel rankings from TwitchTracker.com
  • Supports pagination to scrape multiple pages
  • Configurable start and end page numbers
  • Option to filter by language
  • Uses Apify Proxy for IP rotation
  • Stores results in Apify Dataset

How it works

  1. The actor reads input parameters (start page, end page, language).
  2. It constructs URLs for each page to be scraped.
  3. Using CheerioCrawler, it visits each page and extracts channel data.
  4. The extracted data is pushed to an Apify Dataset.

Input

The actor accepts the following input parameters:

  • startPage: The page number to start scraping from (default: 1)
  • endPage: The page number to end scraping at (default: 150)
  • language: The language of channels to scrape (default: "english", leave empty for all languages)
  • proxyConfiguration: Proxy settings for the scraper

Output

The actor outputs a dataset with the following structure for each channel:

  • rank: Channel rank
  • name: Channel name
  • channellink: Link to the channel
  • avgViewers: Average number of viewers
  • hoursStreamed: Hours streamed
  • peakViewers: Peak number of viewers
  • hoursWatched: Total hours watched
  • activeRank: Active rank
  • followersGained: Number of followers gained
  • followers: Total number of followers
  • viewsGained: Number of views gained

Usage

  1. Clone this repository
  2. Install dependencies with npm install
  3. Run the actor locally with apify run

To deploy to the Apify platform:

  1. Log in to Apify: apify login
  2. Deploy the actor: apify push

Customization

You can modify the src/main.js file to change the scraping logic or add new features. The input schema can be adjusted in the .actor/input_schema.json file.

Resources

License

This project is licensed under the ISC License.

Frequently Asked Questions

Is it legal to scrape job listings or public data?

Yes, if you're scraping publicly available data for personal or internal use. Always review Websute's Terms of Service before large-scale use or redistribution.

Do I need to code to use this scraper?

No. This is a no-code tool — just enter a job title, location, and run the scraper directly from your dashboard or Apify actor page.

What data does it extract?

It extracts job titles, companies, salaries (if available), descriptions, locations, and post dates. You can export all of it to Excel or JSON.

Can I scrape multiple pages or filter by location?

Yes, you can scrape multiple pages and refine by job title, location, keyword, or more depending on the input settings you use.

How do I get started?

You can use the Try Now button on this page to go to the scraper. You’ll be guided to input a search term and get structured results. No setup needed!