Google Ads & Insight Scraper

Google Ads & Insight Scraper

Extract ADS or INSIGHTS from a search url on google ads transparency website. From adstransparency.google.com get data about advertisers, regions, ADS, spend per advertisers / regions and more.

Features

• Extract ADS from a search URL on website https://adstransparency.google.com/
• Extract INSIGHTS from a search URL on website https://adstransparency.google.com/

INPUT

Batch ads : contains specific ad url; one per line Start url : contains 1 search url

If "batch ads" is provided, it takes priority on start url (start url is ignored)

What data can i get

input type: ADS

• Advertiser ID

• Advertiser name

• Ad ID

• Ad type

• Ad start date

• Ad end date

• Ad number of days running

• List of visible countries

• Image link

• Ad spend range

• Ad impressions range

• Ad spend currency

• Ad url

• ad impressions availability date (when no impressions numbers available yet)

  input type: INSIGHTS

• Total ads

• Total ads spend

• Currency

• Advertisers

  • Name
  • ID
  • Ad spend
  • Ad spend percentage ratio from total ad spend
  • Country
  • Country name
  • Country id

• Regions

  • ID
  • Name
  • Country id
  • Ad spend percentage ratio from total ad spend
  • Ad spend
  • Ad number percentage ratio from total ad
  • Total ads

• TEXT ad spend number percentage ratio of total ad spend

• TEXT ad spend number

• TEXT ad number percentage ratio of total ads

• TEXT ads number

• IMAGE ad spend number percentage ratio of total ad spend

• IMAGE ad spend number

• IMAGE ad number percentage ratio of total ads

• IMAGE ads number

• VIDEO ad spend number percentage ratio of total ad spend

• VIDEO ad spend number

• VIDEO ad number percentage ratio of total ads

• VIDEO ads number

Storage Objects

Ads object

• contains ouput from input "Crawl type" ADS

All Insights object

• contains output from input "Crawl type" INSIGHTS

Advertisers Insights object

• contains only advertisers from the output when running "Crawl type" INSIGHTS

Regions Insights object

• contains only regions from the output when running "Crawl type" INSIGHTS

Output Storage objects exemple

Ads object

1[{
2  "ad_advertiser_id": "AR12051724274625413121",
3  "ad_advertiser_name": "Mary Peltola for Alaska",
4  "ad_id": "CR18438859991222845441",
5  "ad_type": "image",
6  "ad_start_date": "1722473998",
7  "ad_end_date": "1723548413",
8  "ad_number_days_running": 14,
9  "ad_visible_countries": [
10    "US"
11  ],
12  "ad_image_link": "https://tpc.googlesyndication.com/archive/simgad/13664241309647767647",
13  "ad_spend_range": "0-100",
14  "ad_impressions_range": "2000-3000",
15  "ad_spend_currency": "USD",
16  "ad_url": "https://adstransparency.google.com/advertiser/AR12051724274625413121/creative/CR18438859991222845441/"
17},
18{
19  "ad_advertiser_id": "AR07109796124864544769",
20  "ad_advertiser_name": "WinSenate",
21  "ad_id": "CR18434134290246664193",
22  "ad_type": "video",
23  "ad_start_date": "1722644263",
24  "ad_end_date": "1723543208",
25  "ad_number_days_running": 12,
26  "ad_visible_countries": [
27    "US"
28  ],
29  "ad_image_link": "",
30  "ad_spend_range": "2500-3000",
31  "ad_impressions_range": "70000-80000",
32  "ad_spend_currency": "USD",
33  "ad_url": "https://adstransparency.google.com/advertiser/AR07109796124864544769/creative/CR18434134290246664193/"
34},
35{
36  "ad_advertiser_id": "AR09169555100203483137",
37  "ad_advertiser_name": "Friends of Janelle Stelson",
38  "ad_id": "CR18433459533704593409",
39  "ad_type": "text",
40  "ad_start_date": "1696981941",
41  "ad_end_date": "1723553578",
42  "ad_number_days_running": 69,
43  "ad_visible_countries": [
44    "US"
45  ],
46  "ad_image_link": "https://tpc.googlesyndication.com/archive/simgad/12573165053427247794",
47  "ad_spend_range": "1000-1500",
48  "ad_impressions_range": "4000-5000",
49  "ad_spend_currency": "USD",
50  "ad_url": "https://adstransparency.google.com/advertiser/AR09169555100203483137/creative/CR18433459533704593409/"
51},
52...]

All Insights object

1[{
2  "insights_total_ads": "842213",
3  "insights_total_ads_spend": "1474676100",
4  "insights_total_ads_spend_currency": "USD",
5  "insights_advertisers":[{
6        "advertiser_name": "BIDEN FOR PRESIDENT",
7        "advertiser_id": "AR12365610929977556993",
8        "advertiser_adspend": 101352691,
9        "advertiser_adspend_percent_of_total": 0.06872878151119038,
10        "advertiser_country": "US",
11        "advertiser_country_name": "United States",
12        "advertiser_country_id": 2840
13        },
14        {
15        "advertiser_name": "DONALD J. TRUMP FOR PRESIDENT, INC.",
16        "advertiser_id": "AR11825178974693097473",
17        "advertiser_adspend": 83425191,
18        "advertiser_adspend_percent_of_total": 0.05657187455579022,
19        "advertiser_country": "US",
20        "advertiser_country_name": "United States",
21        "advertiser_country_id": 2840
22        },
23    ...],
24  "insights_regions": [{
25        "region_id": 2016,
26        "region_name": "American Samoa",
27        "region_country_id": 2840,
28        "region_adspend_percent_of_total": 0.0000017328824101275986,
29        "region_adspend": 2555,
30        "region_ads_percent_of_total": 0.0026097911098498837,
31        "region_ads": 2198
32        },
33        {
34        "region_id": 2316,
35        "region_name": "Guam",
36        "region_country_id": 2840,
37        "region_adspend_percent_of_total": 0.000001186292696657206,
38        "region_adspend": 1749,
39        "region_ads_percent_of_total": 0.0055425409011734565,
40        "region_ads": 4668
41        },
42    ...],
43  "insights_text_adspend_percent_of_total": 0.2602584875736296,
44  "insights_text_adspend": 383796971,
45  "insights_image_adspend_percent_of_total": 0.0792972948807239,
46  "insights_image_adspend": 116937825,
47  "insights_video_adspend_percent_of_total": 0.6604442175456464,
48  "insights_video_adspend": 973941302,
49  "insights_text_ads_percent_of_total": 0.23062218227455525,
50  "insights_text_ads": 194233,
51  "insights_image_ads_percent_of_total": 0.3274397331791364,
52  "insights_image_ads": 275774,
53  "insights_video_ads_percent_of_total": 0.44193808454630834,
54  "insights_video_ads": 372206
55}]

Advertisers Insights object

1[{
2  "advertiser_name": "BIDEN FOR PRESIDENT",
3  "advertiser_id": "AR12365610929977556993",
4  "advertiser_adspend": 101352691,
5  "advertiser_adspend_percent_of_total": 0.06872878151119038,
6  "advertiser_country": "US",
7  "advertiser_country_name": "United States",
8  "advertiser_country_id": 2840
9},
10{
11  "advertiser_name": "DONALD J. TRUMP FOR PRESIDENT, INC.",
12  "advertiser_id": "AR11825178974693097473",
13  "advertiser_adspend": 83425191,
14  "advertiser_adspend_percent_of_total": 0.05657187455579022,
15  "advertiser_country": "US",
16  "advertiser_country_name": "United States",
17  "advertiser_country_id": 2840
18},
19...]

Regions Insights object

1[{
2  "region_id": 2016,
3  "region_name": "American Samoa",
4  "region_country_id": 2840,
5  "region_adspend_percent_of_total": 0.0000017328824101275986,
6  "region_adspend": 2555,
7  "region_ads_percent_of_total": 0.0026097911098498837,
8  "region_ads": 2198
9},
10{
11  "region_id": 2316,
12  "region_name": "Guam",
13  "region_country_id": 2840,
14  "region_adspend_percent_of_total": 0.000001186292696657206,
15  "region_adspend": 1749,
16  "region_ads_percent_of_total": 0.0055425409011734565,
17  "region_ads": 4668
18},
19...]