Sephora Scraper

Sephora Scraper provide a way to crawl product details of site Sephora.

Features

1. Support fetch products of category;
2. Support fetch product detail with prices,descriptions,images and sku info;

The price values are multiplied by 100 to avoiding floating point calculations.

TODO

1. Support fetch product video detail.
2. Support fetch product reviews.

Input Parameters

The input of this scraper shoule be JSON formated. Fields are:

Field	Type	Description
startUrls	Array	Start URLs of Sephora site to start the scraper. Category page, product page urls are all supported.
proxy	Object	Select proxies to be used by your crawler.
maxConcurrency	Object	Actor running max concurrency, which helps you to not getting blocked.

Here is the example:

1{
2  "startUrls": [
3    { "url": "https://www.sephora.com/shop/eyeshadow-palettes" }
4  ],
5  "proxy": { "useApifyProxy": true },
6  "maxConcurrency": 5
7}

Input Examples

• fetch products of category

1{
2  "startUrls": [
3    { "url": "https://www.sephora.com/shop/mascara" }
4  ],
5  "proxy": { "useApifyProxy": true }
6}

• fetch product detail

1{
2  "startUrls": [
3    { "url": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440?skuId=1887520&icid2=products%20grid:p420440" }
4  ],
5  "proxy": { "useApifyProxy": true }
6}

Data storage

Sephora scraper stores the product data to default data set in JSON format.

1{
2  "source": {
3    "id": "P420440",
4    "crawlUrl": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440?skuId=1887520&icid2=products%20grid:p420440",
5    "canonicalUrl": "https://www.sephora.com/product/make-no-mistake-foundation-concealer-stick-P420440",
6    "retailer": "SEPHORA",
7    "currency": "USD"
8  },
9  "brand": "SEPHORA COLLECTION",
10  "title": "Make No Mistake Foundation & Concealer Stick",
11  "description": "<b>Coverage:</b><br>&#10004; Medium<br><br><b>Skin type:</b><br>&#10004; Combination<br>&#10004; Oily<br><br><b>Finish:</b><br>&#10004; Matte<br><br><b>What it is:</b><br> A medium- to full-coverage foundation and concealer stick with a natural matte finish.<br><br><b>What it does:</b><br> This two-in-one multitasker can be used as both foundation and concealer. The creamy formula does not settle into fine lines and wrinkles, and the stick format is perfect for easy on-the-go application.<br><br><b>What else you need to know:</b><br>This product is noncomedogenic and is not tested on animals.<br><br><b>Ingredient Note: </b>\n<br>All Sephora Collection products comply with the most rigorous international laws on product safety&#151;going beyond satisfying European and US Cosmetics regulations. They also satisfy the strictest internal requirements of development, quality, traceability, and safety, and lead by example with a Restricted Substance List that excludes more than 1,400 substances.",
12  "categories": [
13    "Makeup",
14    "Face",
15    "Foundation"
16  ],
17  "options": [
18    {
19      "type": "Color",
20      "values": [
21        {
22          "id": "3 Beechwood",
23          "name": "3 Beechwood",
24          "icon": "https://www.sephora.com/productimages/sku/s1887405+sw.jpg"
25        },
26        {
27          "id": "15 Mahogany",
28          "name": "15 Mahogany",
29          "icon": "https://www.sephora.com/productimages/sku/s1887520+sw.jpg"
30        },
31        {
32          "id": "16 Ebony",
33          "name": "16 Ebony",
34          "icon": "https://www.sephora.com/productimages/sku/s1887538+sw.jpg"
35        }
36      ]
37    },
38    {
39      "type": "Size",
40      "values": [
41        {
42          "id": "0.41 oz/ 11.6 g",
43          "name": "0.41 oz/ 11.6 g"
44        }
45      ]
46    }
47  ],
48  "variants": [
49    {
50      "id": "1887405",
51      "sku": "1887405",
52      "price": {
53        "current": 800,
54        "original": 2000,
55        "stockStatus": "OutOfStock"
56      },
57      "options": [
58        "3 Beechwood",
59        "0.41 oz/ 11.6 g"
60      ]
61    },
62    {
63      "id": "1887520",
64      "sku": "1887520",
65      "price": {
66        "current": 800,
67        "original": 2000,
68        "stockStatus": "InStock"
69      },
70      "options": [
71        "15 Mahogany",
72        "0.41 oz/ 11.6 g"
73      ]
74    },
75    {
76      "id": "1887538",
77      "sku": "1887538",
78      "price": {
79        "current": 800,
80        "original": 2000,
81        "stockStatus": "InStock"
82      },
83      "options": [
84        "16 Ebony",
85        "0.41 oz/ 11.6 g"
86      ]
87    }
88  ],
89  "medias": [
90    {
91      "type": "Image",
92      "url": "https://www.sephora.com/productimages/sku/s1887405-main-zoom.jpg?pb=2020-03-sephora-value-2020",
93      "variantIds": [
94        "1887405"
95      ]
96    },
97    {
98      "type": "Image",
99      "url": "https://www.sephora.com/productimages/product/p420440-av-01-zoom.jpg",
100      "alt": "SEPHORA COLLECTION Make No Mistake Foundation & Concealer Stick Image 2",
101      "variantIds": [
102        "1887405",
103        "1887520",
104        "1887538"
105      ]
106    },
107    {
108      "type": "Image",
109      "url": "https://www.sephora.com/productimages/sku/s1887520-main-zoom.jpg?pb=2020-03-sephora-value-2020",
110      "variantIds": [
111        "1887520"
112      ]
113    },
114    {
115      "type": "Image",
116      "url": "https://www.sephora.com/productimages/product/p420440-av-01-zoom.jpg",
117      "alt": "SEPHORA COLLECTION Make No Mistake Foundation & Concealer Stick Image 2",
118      "variantIds": [
119        "1887405",
120        "1887520",
121        "1887538"
122      ]
123    },
124    {
125      "type": "Image",
126      "url": "https://www.sephora.com/productimages/sku/s1887538-main-zoom.jpg?pb=2020-03-sephora-value-2020",
127      "variantIds": [
128        "1887538"
129      ]
130    },
131    {
132      "type": "Image",
133      "url": "https://www.sephora.com/productimages/product/p420440-av-01-zoom.jpg",
134      "alt": "SEPHORA COLLECTION Make No Mistake Foundation & Concealer Stick Image 2",
135      "variantIds": [
136        "1887405",
137        "1887520",
138        "1887538"
139      ]
140    }
141  ],
142  "stats": {
143    "reviewCount": 749,
144    "rating": 3.9306,
145    "lovesCount": 61136
146  }
147}