Advanced Tokopedia Scraper

Welcome to the Advanced Tokopedia Scraper, an advanced tool designed to extract data from Tokopedia efficiently. This scraper is built for developers, businesses, and data analysts who need to collect product details, shop information, and transaction data from Tokopedia at scale.

---

Key Features

• Efficient Data Extraction: Extract product data including prices, stock levels, product descriptions, and images.
• Search-Based Scraping: Customize search queries to scrape products from specific categories, keywords, or brand names.
• Dynamic Pagination: The scraper handles paginated search results, ensuring all relevant data is collected.
• Comprehensive Data: Collect key details such as shop name, shop ID, transaction success/reject data, and product performance.
• Fast and Scalable: Efficient scraping for both small and large-scale data collection, optimized for performance.
• Real-Time Updates: Get the latest product data as it changes on Tokopedia, ensuring your data is always up to date.
• Customizable Output Formats: Choose your preferred output format, whether it's JSON, CSV, or others.

---

Pricing Structure

The scraper follows a two-tier pricing model to accommodate a wide range of users:

Promotional Pricing (Until Early December 2024)

• $10 per month: Ideal for short-term use, testing, and smaller-scale scraping.
• Why this pricing?: This pricing allows users to experience the power of the tool at an affordable cost while we continue to enhance the scraper’s capabilities.

Standard Pricing (Starting December 2024)

• $10 per 1,000 results: This change reflects the scraper's growing capabilities and scalability for businesses needing large-scale data extraction.
• Why the change?: As the tool evolves to support larger data volumes and increased server usage, this pricing model ensures fairness and sustainability for all users.

---

How It Works

1. Setup and Configuration:
   • After signing up and installing the scraper, configure your search parameters based on product categories, keywords, or specific product IDs.
2. Launch the Scraper:
   • Start the scraper, which will automatically collect data from Tokopedia based on your specified filters.
3. Data Collection:
   • The scraper processes multiple pages of search results, ensuring that all products matching your criteria are included in the output.
4. Retrieve Data:
   • After the scraper finishes running, download your results in a structured format (JSON, CSV, etc.) for analysis.

---

Getting Started

1. Visit the Apify Page: Go to Faz on Apify to access the scraper and start using it.
2. Sign Up and Configure: Follow the setup instructions to configure the scraper for your use case, adjusting filters as needed.
3. Run and Collect Data: After configuring, run the scraper to collect data from Tokopedia, ready to be exported for analysis.
4. Analyze the Results: Review and use the structured data in your preferred tools or business processes.

---

Installation

To start using the scraper, follow these steps:

1. Sign up for an Apify account: Create Apify Account.
2. Go to Faz’s Apify page and choose the Advanced Tokopedia Scraper tool.
3. Configure the scraper with your search queries and parameters.
4. Click Run to start scraping Tokopedia data.

---

Example Output

The scraper provides detailed data in a structured format, including:

• Product Name: Full name of the product.
• Price: Current price of the product.
• Stock: Availability of the product.
• Shop Name: The shop from which the product is listed.
• Transaction Stats: Metrics such as transaction success, rejection rates, and product sold counts.
• Images: URLs to the product’s main image and other related images.
• Product URL: A link directly to the product’s Tokopedia page for further details.

Example of a JSON output:

Product Info

1[
2  {
3  "category": {
4    "breadcrumb": "komputer-laptop/laptop/laptop-consumer",
5    "id": 297,
6    "name": "Komputer & Laptop"
7  },
8  "id": 13876543210,
9  "image": {
10    "image": "https://images.tokopedia.net/img/cache/200-square/AbcdEf/2024/10/12/8f4b26b1-0a42-4875-bb25-c47f89bfe671.jpg",
11    "image300": "https://images.tokopedia.net/img/cache/300-square/AbcdEf/2024/10/12/8f4b26b1-0a42-4875-bb25-c47f89bfe671.jpg"
12  },
13  "meta": {
14    "warehouseID": 4982305
15  },
16  "name": "Dell XPS 13 9310 OLED i7 1165G7 16GB 512GB 3.9K 13\" Ultra HD",
17  "price": {
18    "number": 24999000,
19    "text": "Rp24.999.000"
20  },
21  "shop": {
22    "city": "Jakarta Selatan",
23    "id": 7123456,
24    "name": "TechWorld",
25    "tier": 2,
26    "url": "https://www.tokopedia.com/techworld"
27  },
28  "stock": {
29    "maxOrder": 1,
30    "minOrder": 1,
31    "number": 5
32  },
33  "url": "https://www.tokopedia.com/techworld/dell-xps-13-9310-oled-i7-1165g7-16gb-512gb-3-9k-13-ultra-hd-standard-16gb-512gb-ssd-98901?extParam=ivf%3Dfalse%26keyword%3Di7%26src%3Dsearch"
34}
35
36]

Product Details

1[
2  {
3  "alias": "hp-xyz-envy-13-ab122tx-i7-1165g7-8gb-512gb-windows11",
4  "product_url": "https://www.tokopedia.com/gadgetstore/hp-xyz-envy-13-ab122tx-i7-1165g7-8gb-512gb-windows11",
5  "product_id": "12345678901",
6  "created_at": "2024-10-15T12:30:45+07:00",
7  "shop_name": "GadgetStore",
8  "shop_id": "456123",
9  "categories": [
10    {
11      "id": "297",
12      "name": "Komputer & Laptop",
13      "parentId": null
14    },
15    {
16      "id": "3844",
17      "name": "Laptop",
18      "parentId": "297"
19    },
20    {
21      "id": "3982",
22      "name": "Laptop Consumer",
23      "parentId": "3844"
24    }
25  ],
26  "transaction_success": "34",
27  "transaction_reject": "2",
28  "count_sold": "42",
29  "product_name": "HP Envy 13 AB122TX i7 1165G7 8GB 512GB Windows 11",
30  "price": "Rp15.199.000",
31  "stock": "40",
32  "main_thumbnail_url": "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/6f7c2b3d-f2d5-4694-9435-2345abcfd1234.png",
33  "images": [
34    "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/6f7c2b3d-f2d5-4694-9435-2345abcfd1234.png",
35    "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/7c81a6fd-4e6b-48a4-bb1f-03c1c67f34e6.jpg",
36    "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/d7f9be9c-82c7-4f5d-9bcb-24691b676c02.jpg",
37    "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/5fa8fa84-beb5-4531-b7b2-6b123ab569c7.jpg",
38    "https://images.tokopedia.net/img/cache/700/AbcdEf/2024/10/5/93fcb79d-1283-4523-9a55-1cd8ffb540a7.jpg"
39  ],
40  "description": "Spesifikasi:\n- Model: HP Envy 13\n- Processor: Intel® Core™ i7-1165G7 (Cache 12 MB, hingga 4,70 GHz)\n- Memori: 8GB DDR4 (mendukung 2 slot memori)\n- Penyimpanan: 512GB SSD M.2 NVMe\n- Layar: 13.3” Full HD 1920 x 1080 dengan aspek rasio 16:9\n- Grafis: Intel Iris Xe Graphics\n- Penggerak Optis: tidak tersedia\n- Konektivitas: WiFi, Bluetooth, LAN\n- Kamera Web: Kamera HD dengan resolusi 1280 x 720, penutup rana kamera\n- Sistem Operasi: Windows 11 Home 64-bit\n- Daya: 45W AC Adapter\n- Warna Casis: Perak\n- Berat: 1.3 kg\n- Dimensi: 308 (W) x 217 (D) x 15.5 (H)\n\nKelengkapan:\n*Unit Laptop\n*Adaptor \n*Kartu Garansi\n*Dus Laptop\n*Tas\n\nGaransi 2 Tahun HP Indonesia",
41  "details": {
42    "Kondisi": "Baru",
43    "Berat Satuan": "2.5 kg",
44    "Min. Pemesanan": "1 Buah",
45    "Kategori": "Laptop Consumer",
46    "Etalase": "XYZ",
47    "Katalog": "HP Envy 13 AB122TX",
48    "Fungsionalitas": "Kerja",
49    "Merek": "HP",
50    "Tahun Rilis": "2024",
51    "Tipe Garansi": "Garansi Merek (Resmi)",
52    "Tipe Processor": "Intel"
53  }
54}
55]