2017 Spreadsheet of all the Black Friday deals

All Site Suggestions or General Black Friday Tips

Moderators: Tony, Huy, cematra173, killasnake

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Wed Oct 25, 2017 10:56 am

This is a spreadsheet that contains all the 2017 Black Friday deals listed on BFAds.net. It is available for you to view and download.

November 20, 2017, 4.0 MB, 102 ads, 25,689 items

November 19, 2017, 3.9 MB, 97 ads, 25,236 items
November 18, 2017, 3.8 MB, 96 ads, 24,774 items
November 17, 2017, 3.8 MB, 94 ads, 24,470 items
November 16, 2017, 3.4 MB, 85 ads, 21,673 items
November 15, 2017, 3.4 MB, 80 ads, 20,543 items
November 14, 2017, 3.1 MB, 72 ads, 19,072 items
November 12, 2017, 2.6 MB, 53 ads, 15,652 items
November 11, 2017, 2.3 MB, 48 ads, 13,847 items
November10, 2017, 1.9 MB, 37 ads, 11,431 items
November 9, 2017, 1.6 MB, 34 ads, 9,805 items
November 8, 2017, 1.1 MB, 22 ads, 6,747 items
November 6, 2017, 950.1 KB, 19 ads, 5,989 items
November 3, 2017, 716.7 KB, 15 ads, 4,370 items
November 2, 2017, 537.0 KB, 12 ads, 3,250 items
November 1, 2017, 455.3 KB, 10 ads, 2,788 items
October 31, 2017, 245.8 KB, 6 ads, 1,582 items
October 30, 2017, 212.1 KB, 6 ads, 1,342 items
October 28, 2017, 151.5 KB, 5 ads, 958 items
October 27, 2017, 149.2 KB, 4 ads, 942 items
October 26, 2017, 57.3 KB, 3 ads, 351 items
October 25, 2017, 55.8 KB, 3 ads, 351 items

The spreadsheet is a plain text file in CSV format that can be imported into Excel or other spreadsheet programs. The information is pulled from the BFAds.net web site, so any errors in the web site listings will also show up in the spreadsheet. Please let me know if you have any questions or suggestions or if there are any problems. The spreadsheet columns are: "Store,Category,Item,Sale Price,Original or Current Price,URL". For historic research purposes, the 2016, 2015, 2014, 2013, 2012, and 2011 spreadsheets are also available.

(BFAds.net, as always if you want me to stop making this spreadsheet (since I'm basically taking/stealing all the data from your web site), please just let me know.)

(I'll keep updating this top post as updated versions of the spreadsheet become available.)
Last edited by Shopper X on Mon Nov 20, 2017 7:05 am, edited 23 times in total.

brent1976
Black Friday Newbie
Posts: 1
Joined: Wed Oct 25, 2017 11:01 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby brent1976 » Wed Oct 25, 2017 11:09 pm

I love this list and used it last year! I know this may not be possible, but any chance you can add the retail price (if given for a particular deal) for each deal. Myself and a few of my friends will be using your file this year and we always love seeing how much we are saving when scanning it.

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Thu Oct 26, 2017 3:00 pm

I added a new column for original price. So, there are now two price columns: Sale Price and Original Price.

Price information is taken directly from the bfads.net site. So, if bfads.net doesn't list a sale price or an original price for a given item, then those fields will be empty in the spreadsheet.

The script now pulls sale and original price information from a different part of the web page. I think that I got it right, but I am not certain. Please let me know if anything looks wrong in the spreadsheet.

User avatar
guitarist19862005
Black Friday Pro
Posts: 2091
Joined: Tue Oct 02, 2007 2:44 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby guitarist19862005 » Sun Oct 29, 2017 6:15 am

You speak my language with a spreadsheet.

beakerimf
Black Friday Newbie
Posts: 1
Joined: Fri Nov 11, 2016 10:30 am

Re: 2017 Spreadsheet of all the Black Friday deals

Postby beakerimf » Sun Oct 29, 2017 1:03 pm

You're still my favorite person on the internet! :) Thanks again for posting this year after year.

saride16
Black Friday Newbie
Posts: 1
Joined: Mon Nov 14, 2016 11:53 am

Re: 2017 Spreadsheet of all the Black Friday deals

Postby saride16 » Wed Nov 01, 2017 2:51 pm

Have used it last year and its the best thing .... thank you for putting this together !!!

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Sat Nov 04, 2017 1:21 pm

The spreadsheet is on hold for now. The BFAds.net web site broke last night such that the "View More Deals" button no longer works. It just repeatedly loads page 2 instead of going on to page 3, 4, etc.

Also, the BFAds.net web site broke such that category no longer appears in the item listings, so I am no longer able to get that information.

I'm waiting to see if the problems will be fixed. If they don't, I have an idea about how to work around the "View More Deals" problem. The category problem will be harder to work around.

nynamyna
Black Friday Newbie
Posts: 7
Joined: Wed Nov 23, 2016 10:54 am

Re: 2017 Spreadsheet of all the Black Friday deals

Postby nynamyna » Sun Nov 05, 2017 11:08 pm

Hello,

Thanks for posting this again this year. I usually build a dashboard based on this and lot of people used it last year Andy the year before. I want to do it this year too. Is it possible to make this to a google spreadsheet? So, any changes you make to sheet, will automatically reflected in the dashboard. Let me know.

Here is my dashboard last year
https://public.tableau.com/profile/bhar ... ridayDeals

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Mon Nov 06, 2017 9:09 pm

Sorry, I am not inclined to upload the spreadsheet to Google spreadsheets.

I found a way to work around both problems. The "View More Deals" button is still broken but I figured out how it worked. I can get all the deals by just browsing individual web pages instead of using the button.

For the missing categories, I'm still hoping the BFAds fixes the problem. It would make things much easier. But, I found that I can still get get category information by viewing each store's deals, category by category. However, doing so takes three times as long to download all the deals, so it is more inconvenient. Also, there is a chance that doing it this way might miss some deals. (If any deal doesn't have a category assigned to them, I will miss it. In the past there were a few deals that fell into this situation.)

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Sat Nov 11, 2017 12:11 am

Welcome Reddit r/blackfriday folk! For the past 6 years I've created the BFAds.net spreadsheets of all the Black Friday deals and made them freely available to all.

I would like to re-iterate that all the deals are pulled directly from the BFAds.net web site. Their web server is wonky at times, and sometimes BFAds makes typos or other mistakes when entering deals into their database. So, it is possible that the same errors will be pulled into the spreadsheet. I recommend doing your due diligence and follow-up research, actually looking at the adscans for specific deals you are interested in to verify the details.

Additionally, some deals have details not included in the spreadsheet. For example, some deals list prices after mail-in rebates. Again, you are advised to verify the details by looking at the adscans.

Also, the BFAds back-end web servers are unfortunately out of sync. So, if you retrieve page 1 of a store multiple times, you might get different deals each time because different back-end servers are used by the web load balancer. If a store has a total of 2 pages of deals and you retrieve both pages, you might miss a deal if the deal appears on page 1 on one server but page 2 of a different server. (You retrieve page 1 from a server where the deal is on page 2, and then you retrieve page 2 from a different server where the deal was on page 1.) And, for the same reasons you might see duplicate deals.

To handle the problem of missing deals, I download all the deals multiple times each day over multiple days and collate them. Eventually (after a couple of days) all the deals get picked up by the spreadsheet, even if they were missed the first time around. This also fixes the problem with duplicate deals.

(If you have any questions and sign up on this BFAds.net forum, please feel free to AMA Ask Me Anything here in this topic.)

Good luck and happy shopping, everybody!

srrao81
Black Friday Newbie
Posts: 1
Joined: Fri Nov 11, 2016 1:19 am

Re: 2017 Spreadsheet of all the Black Friday deals

Postby srrao81 » Mon Nov 13, 2017 11:44 pm

Great job. Thank you so much. This makes the life very easy. Greatly appreciate your efforts.

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Thu Nov 16, 2017 2:08 pm

The issue of missing/duplicate deals is now fixed. The solution is to retrieve web pages with deals sorted "Date Added: Old to New". ("New to Old" also works, I believe.) This method reliably produces an accurate list of all the deals in the same order on all backend web servers. This is actually the same solution that I used back in 2014 to fix the same problem, before BFAds.net changed how the web site worked in 2015 and 2016.

FYI, all the deals on page 8 of the True Value ad were somehow deleted from the BFAds.net database overnight. They were there yesterday morning but gone this morning. I've already let BFAds know about the issue, so hopefully they'll get it fixed soon.

User avatar
Shopper X
Suspected Line Jumper
Posts: 2434
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2017 Spreadsheet of all the Black Friday deals

Postby Shopper X » Sun Nov 19, 2017 8:05 pm

On Reddit r/blackfriday someone asked:

When I look at "deals" and then search the products online I am finding that the deals are often more expensive than the original prices.... what am I doing wrong?

for example, from the spreadsheet:

KitchenAid - 24-in. Built-In Stainless Steel Dishwasher w/ Stainless Steel Tub

The "deal" is $599.99 but the original price is $549.99???

This is the deal in question:
https://www.bfads.net/Item/Best-Buy-Bla ... Tub/406486

You are not doing anything wrong. What you see is correct. Best Buy advertised this product in their Black Friday ad for $599.99. However, the spreadsheet lists the original price as $549.99. That is because Best Buy is currently selling the product for $549.99. Normally, the Original Price is the regular price for the item. But, when the item is available online it becomes the "buy now" price and can vary depending on what the store does.

Why is Best Buy selling the item now for less than the Black Friday sale price? I don't know. I have no idea why they would do that.

I think that I will change the "Original Price" label to "Original or Current Price" to avoid confusion.

User avatar
jeanerz13
Black Friday Pro
Posts: 1590
Joined: Fri Oct 15, 2010 10:42 pm
Location: Missouri

Re: 2017 Spreadsheet of all the Black Friday deals

Postby jeanerz13 » Sun Nov 19, 2017 11:41 pm

Shopper X wrote:Why is Best Buy selling the item now for less than the Black Friday sale price? I don't know. I have no idea why they would do that.


To make more money of course :) Put it on sale in the days ahead of Black Friday when no one is shopping and raise the price later so they can make more money when people are actually shopping.


Return to “Suggestions and Tips”

Who is online

Users browsing this forum: No registered users and 9 guests