Github List Scraper

Github List Scraper

This Actor scrapes repositories from GitHub **Awesome Lists**, **topic listings**, and **individual repositories**, collecting useful metadata for each project.

OPEN_SOURCESOCIAL_MEDIADEVELOPER_TOOLSApify

GitHub Awesome List and topic scraper

What this Actor does

This Actor scrapes repositories from GitHub Awesome Lists, topic listings, and individual repositories, collecting useful metadata for each project.

Input parameters

You can customize the scraping by providing on or more of these fields:

1{
2  "awesomeLists": ["owner/repository"],
3  "topics": ["example-topic"],
4  "repositories": ["owner/repository"]
5}
  • awesomeLists (array, optional) – List of GitHub Awesome Lists to scrape.
  • topics (array, optional) – Fetch all repositories with these topics.
  • repositories (array, optional) – Scrape specific repositories.

Output format

The Actor outputs a dataset with the following fields:

1[
2  {
3    "repository": "octocat/Hello-World",
4    "description": "An example repo",
5    "homepageUrl": "https://example.com",
6    "tocPath": ["Awesome examples", "Repository examples"],
7    "topics": ["opensource", "example"],
8    "latestCommit": "2024-03-01T12:34:56Z",
9    "stars": 1234,
10    "readmeContent": "This is the README content..."
11  }
12]

Frequently Asked Questions

Is it legal to scrape job listings or public data?

Yes, if you're scraping publicly available data for personal or internal use. Always review Websute's Terms of Service before large-scale use or redistribution.

Do I need to code to use this scraper?

No. This is a no-code tool — just enter a job title, location, and run the scraper directly from your dashboard or Apify actor page.

What data does it extract?

It extracts job titles, companies, salaries (if available), descriptions, locations, and post dates. You can export all of it to Excel or JSON.

Can I scrape multiple pages or filter by location?

Yes, you can scrape multiple pages and refine by job title, location, keyword, or more depending on the input settings you use.

How do I get started?

You can use the Try Now button on this page to go to the scraper. You’ll be guided to input a search term and get structured results. No setup needed!