2018 Spreadsheet of all the Black Friday deals

All Site Suggestions or General Black Friday Tips

Moderators: Tony, cematra173, killasnake, Huy

User avatar
Shopper X
Suspected Line Jumper
Posts: 2637
Joined: Wed Nov 16, 2005 6:05 pm

2018 Spreadsheet of all the Black Friday deals

Postby Shopper X » Mon Oct 29, 2018 4:05 pm

This is a spreadsheet that contains all the 2018 Black Friday deals listed on BFAds.net. It is available for you to view and download.

November 22, 2018 (Excel, CSV) (1.2 MB, 3.6 MB), 125 ads, 22,773 items

November 20, 2018 (1.1 MB, 3.4 MB), 120 ads, 21,772 items
November 19, 2018 (1.0 MB, 3.2 MB), 106 ads, 20,777 items
November 18, 2018 (0.99 MB, 3.1 MB), 101 ads, 19,682 items
November 16, 2018 (0.97 MB, 3.0 MB), 96 ads, 19,269 items
November 15, 2018 (0.88 MB, 2.8 MB), 84 ads, 17,612 items
November 14, 2018 (0.80 MB, 2.5 MB), 74 ads, 15,718 items
November 13, 2018 (0.75 MB, 2.3 MB), 69 ads, 14,658 items
November 12, 2018 (0.70 MB, 2.1 MB), 62 ads, 13,879 items
November 11, 2018 (0.65 MB, 2.0 MB), 55 ads, 12,817 items
November 10, 2018 (0.64 MB, 1.9 MB), 52 ads, 12,664 items
November 9, 2018 (0.64 MB, 1.9 MB), 50 ads, 12,621 items
November 8, 2018 (0.54 MB, 1.7 MB), 43 ads, 10,770 items
November 7, 2018 (0.4 MB, 1.3 MB), 35 ads, 8,298 items
November 6, 2018 (0.4 MB, 1.2 MB), 28 ads, 7,753 items
November 5, 2018 (0.33 MB, 1.00 MB), 26 ads, 6,584 items
November 4, 2018 (0.24 MB, 0.73 MB), 22 ads, 4,839 items
November 3, 2018 (0.21 MB, 0.64 MB), 20 ads, 4,206 items
November 2, 2018 (0.20 MB, 0.61 MB), 18 ads, 3,995 items
November 1, 2018 (0.12 MB, 0.34 MB), 13 ads, 2,232 items
October 29, 2018 (30.3 KB, 66.2 KB), 6 ads, 396 items

The spreadsheet comes in two formats: a Microsoft Excel file and also a plain text file in CSV format that can be imported into other spreadsheet programs. The information is pulled from the BFAds.net web site, so any errors in the web site listings will also show up in the spreadsheet. Please let me know if you have any questions or suggestions or if there are any problems. The spreadsheet columns are:
Store,Category,Item,Sale Price,Original or Current Price,URL

For historic research purposes, the 2017, 2016, 2015, 2014, 2013, 2012, and 2011 spreadsheets are also available.

(BFAds.net, as always if you want me to stop making this spreadsheet (since I'm basically taking/stealing all the data from your web site), please just let me know.)

(I'll keep updating this top post as updated versions of the spreadsheet become available.)
Last edited by Shopper X on Thu Nov 22, 2018 8:40 am, edited 24 times in total.

User avatar
teknoge3k
Forum geek
Posts: 10697
Joined: Tue Oct 07, 2008 9:57 am
Location: Virginia
Contact:

Re: 2018 Spreadsheet of all the Black Friday deals

Postby teknoge3k » Mon Oct 29, 2018 4:20 pm

Awesome as always. Thank you for doing this.
That moment you realize that Bruce Jenner is Kanye Wests' mother in-law

facebook.com/teknoge3k
twitter.com/teknoge3k

User avatar
lwmjr
Evil, demented & twisted
Posts: 12994
Joined: Wed Jul 31, 2013 2:46 pm
Location: Virginia, Norfolk area

Re: 2018 Spreadsheet of all the Black Friday deals

Postby lwmjr » Mon Oct 29, 2018 5:53 pm

Thank you for your time and effort
Just here to have fun, keep the bad guys out, and give the stray dogs a place to stay

User avatar
guitarist19862005
Black Friday Pro
Posts: 2128
Joined: Tue Oct 02, 2007 2:44 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby guitarist19862005 » Tue Oct 30, 2018 11:56 am

It's back!

Seriously, as the others have stated, thanks for taking the time to do this.

User avatar
Shopper X
Suspected Line Jumper
Posts: 2637
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby Shopper X » Wed Oct 31, 2018 4:19 pm

I am experimenting with providing the spreadsheet as a Microsoft Excel/Office .xlsx file, in addition to the original CSV version. I am using a new-to-me process to generate the Excel file automatically from the CSV file. So, please let me know if you see any problems with the Excel versions of the spreadsheet.

saride16
Black Friday Newbie
Posts: 2
Joined: Mon Nov 14, 2016 11:53 am

Re: 2018 Spreadsheet of all the Black Friday deals

Postby saride16 » Thu Nov 01, 2018 5:22 pm

As always thanks a lot for doing this !

thnok
Black Friday Newbie
Posts: 1
Joined: Sat Nov 03, 2018 9:12 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby thnok » Sat Nov 03, 2018 9:17 pm

Thanks :) I'm bit curious, why didn't you turn this into a Google sheet? You could update it easily :D

User avatar
Shopper X
Suspected Line Jumper
Posts: 2637
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby Shopper X » Sun Nov 04, 2018 12:52 am

thnok wrote:Thanks :) I'm bit curious, why didn't you turn this into a Google sheet? You could update it easily :D

Good question. Currently, I don't have a Google user account, and I do not use any Google services that require an account (Gmail, Google Docs, etc.). I actually try to avoid using Google as much as possible, except for their free services that don't require an account. So, I don't have ready access to Google Docs, and I am not familiar with how Google Docs works.

Also, I am not convinced that using Google Docs would make it easier for me, personally, to update the spreadsheet. Right now, to update the spreadsheet files, I just run one command to upload them to the file host. Pretty simple, and I am not sure how much easier it could be for me. I suspect that the main advantages of using Google Docs might be for others who access Google Docs files, to be able to access those files via permanent URLs.

User avatar
teknoge3k
Forum geek
Posts: 10697
Joined: Tue Oct 07, 2008 9:57 am
Location: Virginia
Contact:

Re: 2018 Spreadsheet of all the Black Friday deals

Postby teknoge3k » Sun Nov 04, 2018 9:08 am

I don't use hardly any of the Google products either so you're not alone. I use Google to search and of course my phone/car uses Google but that's about it. (Except webmaster tools but that's for business)
That moment you realize that Bruce Jenner is Kanye Wests' mother in-law

facebook.com/teknoge3k
twitter.com/teknoge3k

racerwill18
Black Friday Newbie
Posts: 2
Joined: Fri Nov 13, 2015 11:59 am

Re: 2018 Spreadsheet of all the Black Friday deals

Postby racerwill18 » Mon Nov 05, 2018 9:07 am

I echo what everyone else has stated already. thanks so much for all your work. I've used this for years now.

User avatar
teknoge3k
Forum geek
Posts: 10697
Joined: Tue Oct 07, 2008 9:57 am
Location: Virginia
Contact:

Re: 2018 Spreadsheet of all the Black Friday deals

Postby teknoge3k » Thu Nov 08, 2018 9:14 am

Did you have the Perl script for this public anywhere? I can't remember if you did.
That moment you realize that Bruce Jenner is Kanye Wests' mother in-law

facebook.com/teknoge3k
twitter.com/teknoge3k

User avatar
Shopper X
Suspected Line Jumper
Posts: 2637
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby Shopper X » Thu Nov 08, 2018 11:37 am

No, I had not made the spreadsheet scripts publicly available. If you would like, I could send you a copy of the scripts.

In other news, I've started adding "watermarks" to the spreadsheet to help check if it ever gets stolen and put on other sites.

User avatar
teknoge3k
Forum geek
Posts: 10697
Joined: Tue Oct 07, 2008 9:57 am
Location: Virginia
Contact:

Re: 2018 Spreadsheet of all the Black Friday deals

Postby teknoge3k » Thu Nov 08, 2018 11:50 am

Shopper X wrote:No, I had not made the spreadsheet scripts publicly available. If you would like, I could send you a copy of the scripts.

In other news, I've started adding "watermarks" to the spreadsheet to help check if it ever gets stolen and put on other sites.


It doesn't matter. If you send the script, great, if not that's great as well. I just wanted to have an updated version with the ads that have came out today. It was for personal gratification. :lol:
That moment you realize that Bruce Jenner is Kanye Wests' mother in-law

facebook.com/teknoge3k
twitter.com/teknoge3k

User avatar
Shopper X
Suspected Line Jumper
Posts: 2637
Joined: Wed Nov 16, 2005 6:05 pm

Re: 2018 Spreadsheet of all the Black Friday deals

Postby Shopper X » Thu Nov 08, 2018 12:01 pm

teknoge3k wrote:It doesn't matter. If you send the script, great, if not that's great as well. I just wanted to have an updated version with the ads that have came out today. It was for personal gratification. :lol:

I'm not sure if having the scripts would have helped you immediately, at this hour. This year BFAds has been slower to add deals to their online listings. For most ads, it has been taking a day for the deals listings to show up after the adscan was released. For some ads, it has taken 2-3 days for the listings to show up.

For today's ads, I see that Best Buy and Walmart are currently in the process of having their deal listings added. (263 listings for Best Buy and 554 for Walmart, so far.) The listings for Sears and Kmart have just begun to be added. I don't think that yesterday's Stein Mart and Meijer have been done yet.

The pattern I have seen this year is that deal listings seem to be added during the 9-to-5 work day, possibly in the Central US timezone. I've found the evening to be the best time to run the scripts to pick up additions from that day. I also wait a bit to let the database propagate completely to the BFAds backend servers. When new deal listings get added, the information gets propagated to the backend servers at different rates, and the backend servers get out of sync, each containing differing numbers of deals.
Last edited by Shopper X on Thu Nov 08, 2018 12:12 pm, edited 1 time in total.

User avatar
teknoge3k
Forum geek
Posts: 10697
Joined: Tue Oct 07, 2008 9:57 am
Location: Virginia
Contact:

Re: 2018 Spreadsheet of all the Black Friday deals

Postby teknoge3k » Thu Nov 08, 2018 12:03 pm

Shopper X wrote:
teknoge3k wrote:It doesn't matter. If you send the script, great, if not that's great as well. I just wanted to have an updated version with the ads that have came out today. It was for personal gratification. :lol:

I'm not sure if having the scripts would have helped you immediately, at this hour. This year BFAds has been slower to add deals to their online listings. For most ads, it has been taking a day for the deals listings to show up after the adscan was released. For some ads, it has taken 2-3 days for the listings to show up.

For today's ads, I see that Best Buy and Walmart are currently in the process of having their deal listings added. (263 listings for Best Buy and 554 for Walmart, so far.) The listings for Sears and Kmart have just begun to be added. I don't think that yesterday's SteinMart and Meijer have been done yet.

The pattern I have seen this year is that deal listings seem to be added during the 9-5 work day, possibly in the Central US timezone. I've found the evening to be the best time to run the scripts to pick up additions from that day. I also wait a bit to let the database propagate completely to the BFAds backend servers. When new deal listings get added, the information gets propagated to the backend servers at different rates, and the backend servers get out of sync, each containing differing numbers of deals.


Gotcha, I wasn't sure how it was pulling the data. I will patiently wait. haha
That moment you realize that Bruce Jenner is Kanye Wests' mother in-law

facebook.com/teknoge3k
twitter.com/teknoge3k


Return to “Suggestions and Tips”

Who is online

Users browsing this forum: No registered users and 1 guest