Cloudflare Web Scraper
Prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems
The Actor loads web pages in the Puppeteer browser and renders dynamic content. The page content will be loaded by Cheerio. This Actor prevents Puppeteer from being detected as a bot in services like Cloudflare and allows you to pass captchas without any problems. It behaves like a real browser.
Input Parameters
- startUrls (required): List of Request objects, specifying the URL you want to scrape.
- waitForUrl (optional): Wait for url which includes the text to consider as bypass bot protection successfully.
- waitForTitle (optional): Wait for page title which doesn't include the text to consider as bypass bot protection successfully.
- pageFunction (required): Query page elements in the web page using Cheerio.
- proxyConfig (required): Specifies the proxy settings used while running the actor. When running this actor on the platform, the proxy setting must always be set on. The default value is
{ "useApifyProxy": true }
Output example
You will receive the such result in the dataset.
1[{ 2 "title": "Assistenzarzt Chirurgie: > 1.000 Jobs, Arbeit, 19. September 2024| Indeed.com", 3 "count": "> 1.000 Jobs" 4}]
Epilogue
Thank you for trying my actor. I will be very glad for a feedback that you can send to my email dtrungtin@gmail.com.
Frequently Asked Questions
Is it legal to scrape job listings or public data?
Yes, if you're scraping publicly available data for personal or internal use. Always review Websute's Terms of Service before large-scale use or redistribution.
Do I need to code to use this scraper?
No. This is a no-code tool — just enter a job title, location, and run the scraper directly from your dashboard or Apify actor page.
What data does it extract?
It extracts job titles, companies, salaries (if available), descriptions, locations, and post dates. You can export all of it to Excel or JSON.
Can I scrape multiple pages or filter by location?
Yes, you can scrape multiple pages and refine by job title, location, keyword, or more depending on the input settings you use.
How do I get started?
You can use the Try Now button on this page to go to the scraper. You’ll be guided to input a search term and get structured results. No setup needed!