Dun & Bradstreet Scraper

Features

The official Dun and Bradstreet API enables you to get data, but it also enforces quotas and rate limiting. If you need to do more, this unofficial Dun and Bradstreet API will enable you to:

• Scrape companies: extract data on companies listed in the DnB Business Directory by search term
• Scrape articles: extract article content on the DnB website by search term
• Scrape industries: extract industry insights by search term
• Scrape URLs: scrape data from one or more specific URLs

Why scrape Dun & Bradstreet?

Dun & Bradstreet has been helping its clients and partners grow through the smart use of data and analytics for over 200 years. The company offers a wealth of valuable data and insights.

The Dun & Bradstreet website has a great section of use cases to explain the benefits of using DnB data, covering areas such as:

• Business due diligence
• Buyer activity notifications
• Buyer and influencer mapping
• Portfolio monitoring
• Segmentation and prospect identification

Tutorial

The developer of DnB Scraper has created a detailed step-by-step guide to help you scrape Dun & Bradstreet.

If you're new to the world of web scraping, you should check out our Beginner's Guide to Web Scraping.

To learn more about using Apify, read our quick start guide to using any Apify actor.

Tip

DnB has a geo-location-based protection system. That's why you should always use US-based proxies.

Cost of usage

The DnB Scraper actor is optimized to run very quickly and scrape items efficiently. Depending on various factors, it should scrape 100 companies in 2 minutes!

Input parameters

The input for the scraper should be in JSON. Possible fields are:

• search: (Optional) (String) The keyword that you want to search on Dun & Bradstreet with the selected mode.

• mode: (Optional) (String) Mode for the actor. Can be either COMPANIES, ARTICLES or INDUSTRIES. Will work in combination with the search parameter.

• startUrls: (Optional) (Array) List of DnB URLs. You should provide only company, article, or industry detail URLs.

• maxItems: (Optional) (Number) You can limit scraped items. This should be useful when you search through the big lists or search results.

• country: (Optional) (String) You can limit the companies by the country filter if that has been provided. Only works on the search mode.

• proxy: (Required) (Proxy Object) Proxy configuration.

• extendOutputFunction: (Optional) (String) Function that takes a JQuery handle ($) as an argument and returns an object with data.

This scraper requires the use of proxy servers, either your own proxy servers or Apify Proxy.

DnB Scraper input example

1{
2  "search": "apple",
3  "maxItems": 21,
4  "endPage": 21,
5  "mode": "COMPANIES",
6  "country": "ca",
7  "proxy":{
8    "useApifyProxy":true,
9    "apifyProxyGroups":["RESIDENTIAL"]
10  }
11}

During the run

During the run, the actor will output messages letting you know what's going on and which page it's currently scraping.

When items are loaded from the page, you should see a message about this event with a loaded item count.

If you provide incorrect input to the actor, it will immediately stop with a failure state and output an explanation of what went wrong.

DnB Scraper export

During the run, the actor stores results into an Apify dataset. Each item is a separate item in the dataset.

You can manage the results in any language (Python, PHP, Node.js/NPM). See the FAQ or our API reference to learn more about getting results from this Dun & Bradstreet actor.

Output examples

Scraped company result

The structure of each company scraped from DnB looks like this:

1{
2    "Company Name": "NEXT BYTE PTY LTD",
3    "Company Summary": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.

D&B Hoovers provides sales leads and sales intelligence data on over 120 million companies like NEXT BYTE PTY LTD around the world, including contacts, financials, and competitor information. To witness the full depth and breadth of our data and for industry leading sales intelligence tools, take D&B Hoovers for a test drive. Try D&B Hoovers FreeNEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
4    "Company Type": "Proprietorship",
5    "Company Role": "Subsidiary",
6    "Website": "http://www.vitagroup.com.au",
7    "Location": {
8        "Street Address": "Vita Place 77 Hudson Rd",
9        "City": "Albion",
10        "Region": "QUEENSLAND",
11        "Postal Code": "4010",
12        "Country": "Australia"
13    },
14    "Phone": "+61-736246666
                        
                                        Call Us
                                            
                                            (866) 258-3217",
15    "Description": "NEXT BYTE PTY LTD is located in Albion, QUEENSLAND, Australia and is part of the Retail Sector Industry. NEXT BYTE PTY LTD has 1,440 total employees across all of its locations and generates $505.96 million in sales (USD). There are 54 companies in the NEXT BYTE PTY LTD corporate family.",
16    "Key Principal": "MAXINE JOAN HORNE",
17    "Industry": [
18        "Retail Sector",
19        "Miscellaneous retail stores, nec",
20        "Computer and software stores",
21        "Computer related services, nec",
22        "Services, nec"
23    ],
24    "Company Snapshot": {
25        "Employees (This Site)": "",
26        "Employees (All Sites)": "1,440",
27        "Revenue": "505.96",
28        "Year Started": "1997",
29        "Incorporated": "1997",
30        "Fiscal Year End": "JUN",
31        "Assets": "",
32        "Ticker Symbol": "",
33        "Net Income Growth": "",
34        "Sales Growth": ""
35    },
36    "Financial Statements": {
37        "Cost Of Revenue": "",
38        "Gross Profit": "",
39        "Operating Income": "",
40        "Income Before Tax": "",
41        "Net income": "",
42        "Diluted EPS": ""
43    },
44    "Competitors": [],
45    "Principals": [
46        {
47            "Name": "MAXINE JOAN HORNE",
48            "Position": "Director"
49        },
50        {
51            "Name": "GEORGE EDWARD JAMES SOUTHGATE",
52            "Position": "Director"
53        }
54    ],
55    "Breadcrumbs": [
56        "HOME",
57        "BUSINESS DIRECTORY",
58        "RETAIL",
59        "AUSTRALIA",
60        "QUEENSLAND",
61        "ALBION"
62    ]
63}

Scraped DnB article

The structure of each article scraped from DnB looks like this:

1{
2    "Url": "https://www.dnb.com/en-us/blog/financial-risk/monthly-us-economic-health-report.html",
3    "Title": "Achieve Greater FATCA and CRS Compliance More Efficiently",
4    "Date": "May 30, 2017",
5    "Related Articles": [
6        {
7            "Name": "Six Degrees of Separation: Why You Need to Be Smarter with Data",
8            "Link": "/perspectives/corporate-compliance/data-connectivity-relationships.html"
9        },
10        {
11            "Name": "A Record Year for FCPA Fines",
12            "Link": "/perspectives/corporate-compliance/2020-record-year-fcpa-settlement-amounts.html"
13        },
14        {
15            "Name": "Beneficial Ownership",
16            "Link": "/products/corporate-compliance/beneficial-ownership.html"
17        },
18        {
19            "Name": "Direct for Compliance",
20            "Link": "/products/corporate-compliance/direct-for-compliance.html"
21        },
22        {
23            "Name": "D&B Compass",
24            "Link": "/products/corporate-compliance/dnb-compass.html"
25        },
26        {
27            "Name": "D&B Onboard",
28            "Link": "/products/corporate-compliance/dnb-onboard.html"
29        },
30        {
31            "Name": "",
32            "Link": "/products.html"
33        }
34    ],
35    "Cover Image": "https://www.dnb.com/content/dam/english/image-library/Modernization/workspaces/FACTA-and-crs-compliance.jpg",
36    "Body": "

                            <p>Foreign Account Tax Compliance Act (FATCA) 2016 deadlines may have passed, but financial institutions (FIs) can achieve Common Reporting Standards (CRS) and FATCA compliance more easily in 2017 using data and technology, as well as lessons learned from 2016.<b></b></p>
<h2>Pre-existing Account Review Process Is People-Intensive</h2>
<p>FIs were expected to review their pre-existing accounts (a financial account opened prior to July 1, 2014) to document their account holders' FATCA status during 2016. Once the accounts' FATCA statuses are established, FIs would monitor the accounts for any change in circumstances. Many organizations went to great expense and effort to meet this goal with varying results.&nbsp;</p>
<p></p>"
37}

Scraped DnB industry result

The structure of each industry scraped from DnB looks like this:

1{
2    "url": "https://www.dnb.com/business-directory/industry-analysis.commercial_and_industrial_machinery_and_equipment_rental_and_leasing.html",
3    "type": "Industry",
4    "title": "Commercial and Industrial Machinery and Equipment Rental and Leasing IndustryInsights from D&B Hoovers
                        Industry Analysis
                                            Geographic Segmentation",
5    "Description": "This industry group comprises establishments primarily engaged in renting or leasing commercial-type and industrial-type machinery and equipment.  Establishments included in this industry group are generally involved in providing capital or investment-type equipment that clients use in their business operations.  These establishments typically cater to a business clientele and do not generally operate a retail-like or storefront facility.",
6    "Industry Activities": "Aircraft rental or leasing without operator
                                
                                            Airplane rental or leasing without operator
                                
                                            Barge rental or leasing without crew
                                
                                            Boat rental (except pleasure) without crew
                                
                                            Boat rental or leasing, commercial
                                
                                            Railroad car rental or leasing
                                
                                            Ship rental or leasing without crew
                                
                                            Steamship rental or leasing without crew
                                
                                            Tanker (boat) rental or leasing without crew
                                
                                            Towboat rental or leasing without crew
                                
                                            Tugboat rental or leasing without crew
                                
                                            Bulldozer rental or leasing without operator
                                
                                            Construction form rental
                                
                                            Construction machinery and equipment rental or leasing without operator
                                
                                            Crane rental or leasing without operator
                                
                                            Earthmoving equipment rental or leasing without operator
                                
                                            Forestry machinery and equipment rental or leasing
                                
                                            Heavy construction equipment rental without operator
                                
                                            Logging equipment rental or leasing without operator
                                
                                            Mining machinery and equipment rental or leasing
                                
                                            Oil field machinery and equipment rental or leasing
                                
                                            Oil well drilling machinery and equipment rental or leasing
                                
                                            Welding equipment rental or leasing
                                
                                            Well drilling machinery and equipment rental or leasing
                                
                                            Cash register rental or leasing
                                
                                            Computer peripheral equipment rental or leasing
                                
                                            Computer rental or leasing
                                
                                            Copier rental or leasing
                                
                                            Duplicating machine (e.g., copier) rental or leasing
                                
                                            Facsimile machine rental or leasing
                                
                                            Fax machine rental or leasing
                                
                                            Furniture, office, rental or leasing
                                
                                            Mailing equipment rental or leasing
                                
                                            Office furniture rental or leasing
                                
                                            Office machinery and equipment rental or leasing
                                
                                            Agricultural machinery and equipment rental or leasing
                                
                                            Audio visual equipment rental or leasing
                                
                                            Carpentry equipment rental or leasing
                                
                                            Carpet and rug cleaning equipment rental or leasing
                                
                                            Compressor, air and gas, rental or leasing
                                
                                            Farm equipment rental or leasing
                                
                                            Farm tractor rental or leasing
                                
                                            Floor sanding machine rental or leasing
                                
                                            Floor waxing equipment rental or leasing
                                
                                            Furniture, institutional (i.e. public building), rental or leasing
                                
                                            Garden tractor rental or leasing
                                
                                            Generator rental or leasing
                                
                                            Industrial truck rental or leasing
                                
                                            Lawnmower rental or leasing
                                
                                            Manufacturing machinery and equipment rental or leasing
                                
                                            Material handling machinery and equipment rental or leasing
                                
                                            Medical equipment (except home health furniture and equipment) rental or leasing
                                
                                            Metalworking machinery and equipment rental or leasing
                                
                                            Mobile office building rental or leasing, off-site
                                
                                            Modular building rental or leasing, off-site
                                
                                            Motion picture equipment rental or leasing
                                
                                            Pallet rental or leasing
                                
                                            Plumbing equipment rental or leasing
                                
                                            Power washer rental or leasing
                                
                                            Public address system rental or leasing
                                
                                            Renting coin- or card-operated amusement devices (except concession operators)
                                
                                            Sawmill machinery rental or leasing
                                
                                            Scaffolding rental or leasing
                                
                                            Scenery, theatrical, rental or leasing
                                
                                            Skid rental or leasing
                                
                                            Sound and lighting equipment rental or leasing
                                
                                            Telecommunications equipment rental or leasing
                                
                                            Textile machinery rental or leasing
                                
                                            Theatrical equipment (except costumes) rental or leasing
                                
                                            Tractor, farm, rental or leasing
                                
                                            Tractor, garden, rental or leasing
                                
                                            Traffic control equipment (e.g., barricades, cones, traffic signs) rental or leasing
                                
                                            Truck, industrial, rental or leasing
                                
                                            TV broadcasting and studio equipment rental or leasing
                                
                                            Vending machine rental
                                
                                            Woodworking machinery and equipment rental or leasing
                                
                                            View 76 industry activities"
7}

Bugs, fixes, updates, and changelog

This scraper is under active development. If you have any feature requests you can create an issue from here.

Contact

Please visit us through epctex.com to see all the products that are available for you. If you are looking for any custom integration or so, please reach out to us through the chat box in epctex.com. In need of support? business@epctex.com is at your service.