AI Website Content Checker

AI Content Checker

Smart website monitoring with AI-powered content change detection and analysis

Monitor any web page for content changes and receive intelligent notifications with AI-powered analysis of what changed. Perfect for tracking competitors, monitoring critical information, or staying informed about updates to important web pages.

---

🔍 Key Features

• AI-Powered Change Analysis: Receive detailed summaries of how content has changed, not just that it changed.
• Visual Comparison: Before/after screenshots of changes for visual confirmation.
• Smart Notifications: Get email alerts with AI-summarized changes and screenshots.
• Robust Web Handling: Works on complex sites with dynamic content and anti-bot measures.
• Selective Monitoring: Monitor specific elements on a page rather than the entire page.
• Reliable Execution: Multiple retry strategies to ensure successful data extraction.

---

📋 Use Cases

• Competitor Monitoring: Track price changes, product features, or marketing messages.
• News & Publication Tracking: Be the first to know when important content is published.
• Documentation Monitoring: Stay informed about API or documentation updates.
• E-commerce Tracking: Monitor product availability, pricing, or specifications.
• Legal & Compliance: Track terms of service, privacy policies, or regulatory changes.
• Crisis Management: Keep tabs on news articles or public statements during sensitive situations.

---

🧠 AI-Powered Analysis

The AI Content Checker doesn't just tell you that something changed—it tells you what changed and how. Our AI integration:

• Summarizes Changes: Analyzes differences and provides a concise, human-readable summary.
• Identifies Important Updates: Focuses on meaningful changes while ignoring trivial ones.
• Contextualizes Changes: Understands the significance of changes in their context.
• Cleans Content: Automatically filters out navigation elements, ads, and other noise.

Example AI Analysis:

The company has changed its pricing structure. The basic plan increased from $9.99 to $12.99 per month. A new "Enterprise" tier was added at $49.99 with additional features including dedicated support and custom integrations. The free tier remains unchanged.

---

⚙️ Configuration Options

Parameter	Description
url	URL of the page to monitor
contentSelector	CSS selector targeting the content to monitor
screenshotSelector	CSS selector for screenshot area (defaults to contentSelector)
sendNotificationTo	Email address for notifications
sendNotificationText	Custom message included in notifications
aiMode	Enable AI analysis (true/false)
loaderSelector	Page load strategy (networkidle, domcontentloaded, load)
navigationTimeout	Maximum time to wait for page load (milliseconds)
informOnError	Send email on errors (true/false)
maxRetries	Number of retry attempts
retryStrategy	When to retry (on-block, on-all-errors, never-retry)

---

🚀 Getting Started

Best Practice: Create Dedicated Tasks

We recommend creating separate tasks for each website you want to monitor. This approach offers several advantages:

• Optimized Configuration: Each task can be configured specifically for its target website.
• Independent Scheduling: Run different monitors on different schedules as needed.
• Isolated Error Handling: If one monitor encounters issues, others continue to function.
• Better Organization: Keep your monitoring efforts neatly organized.
• Easier Maintenance: Update or modify individual monitors without affecting others.

Example Configuration

Monitoring a Product Page:

1{
2    "url": "https://example.com/product-page",
3    "contentSelector": "#product-description",
4    "sendNotificationTo": "user@example.com",
5    "aiMode": "true",
6    "loaderSelector": "networkidle",
7    "retryStrategy": "on-all-errors"
8}

---

📊 Understanding the Results

After each run, the system provides:

• Dataset Records: Detailed information about any changes detected.
• Key-Value Store: Current and previous content and screenshots.
• Email Notifications: Summaries of changes with screenshots (if configured).

Each output includes:

• The original URL monitored.
• Previous content.
• Current content.
• AI-powered analysis of changes (when enabled).
• Links to before/after screenshots.

---

🛠️ Advanced Configuration

Handling Complex Websites

For websites with complex loading behavior:

1{
2    "url": "https://complex-site.com/dynamic-page",
3    "contentSelector": ".dynamic-content",
4    "loaderSelector": "networkidle",
5    "navigationTimeout": 60000,
6    "retryStrategy": "on-all-errors",
7    "maxRetries": 5
8}

Monitoring Multiple Elements

You can create separate tasks to monitor different elements on the same page:

Task 1: Monitor Pricing

1{
2    "url": "https://example.com/product",
3    "contentSelector": ".price-container",
4    "sendNotificationTo": "pricing@example.com"
5}

Task 2: Monitor Features

1{
2    "url": "https://example.com/product",
3    "contentSelector": ".feature-list",
4    "sendNotificationTo": "product@example.com"
5}

---

📈 Scheduling

For optimal monitoring, schedule your tasks to run at appropriate intervals:

• Critical updates: Every few hours or daily.
• Competitor monitoring: Daily or weekly.
• Documentation changes: Weekly.

Remember that more frequent checks may require additional proxy rotation to avoid being blocked by websites.

---

🔧 Troubleshooting

Common Issues

• No content detected: Check your CSS selector and ensure it targets the right element.
• Page blocking: Adjust the retry strategy or decrease check frequency.
• Timeout errors: Increase the navigation timeout for slow-loading pages.

Improving Detection Accuracy

• Use specific CSS selectors to target only the content you care about.
• Enable aiMode for smarter change detection and filtering.
• Test your selectors in browser developer tools before configuring.

---

📞 Support

Need help setting up your monitoring tasks? Submit an issue through the Issues tab.

Start monitoring important content changes with AI-powered analysis today!