Black Friday '14: E-commerce Pages Far Slower Than They Were in 2013
An anonymous reader writes Black Friday news kicked off this weekend quite early when Best Buy was hit with a massive outage, but it turns out that was only half the story. The top 50 e-commerce websites were slower overall this year compared to last, suggesting customers were frustrated even if they could get to their favorite shopping site. Web performance monitoring company Catchpoint Systems looked at aggregate performance this weekend and compared it to the same timeframe in 2013. The results are notable: desktop web pages were 19.85 percent slower, while mobile web pages were a whopping 57.21 percent slower.
I don't think a big screen is worth dying for.
Is that due to more customers, or are this year version of the websites slower all the time (like a shift to an heavier web technology for the backends for example)?
/*raccoon powered*/
WordPress and Virtual Machines.
Perhaps if those webpages were not laden down with masses of Javascript, doing who knows what, the pages would be faster to load. All that Javascript has to be downloaded from a server somewhere and executed in the browser. It all takes resources.
Many website developers today seem to think that his/her web pages only need to load on the fastest computers as the sole page open in the browser. I think of them as "greedy" websites, because they are greedy with the end-users' compute resources.
The real "Libtards" are the Libertarians!
Is it increased demand (i.e. more customer-driven views) our decreased supply (e.g. shitty JavaScript implementations)?
The big performance problem for modern websites is the relational database.
Even our favorite NoSQL databases are still relational. What is it that connects a document GUID and its data in a document database? A relation! What is it that connects a key with its value in a key-store database? A relation!
Let me say it clearly: DATABASE RELATIONS NEED TO GO!
We need to move to a database model where there are no relations at all. As we've seen, relations mean poor performance!
Relational databases need to become old hat. Document databases need to become old hat. Key-value stores need to become old hat.
Instead, we need database technology that is new hat. This database technology already exists, and they're called array databases.
There are no tables. There are no documents. There are no key-value stores. There are just arrays.
Each array element holds exactly one piece of information. That's what makes it fast! There aren't any relations to deal with. It's just pure data, as fast as can be.
If you want to get your data, you just get it! There are no queries or mappings or any slow crap like that. Your website just gets the data it needs and displays it. It's fast because it's simple.
If you want to sort your data, you just use quicksort. It's the fastest sort that exists.
See, there's no SQL, there's no JavaScript, there's nothing that's slow! It's just arrays, and arrays are fast. That's what makes these databases so great. They're as fast as can be.
So many theories come to mind...
Flat out more volume than last year. Retailers are reporting around 10% year to year increase in general.
Retailers have moved much of the frenzy to Thursday (Friday actually saw a decline, but Thursday saw more than enough to make up the difference). Meaning some significant volume of consumers were home or otherwise ready to focus on online shopping than last year.
Overconfidence in 'cloud bursting' strategies. More and more places are trying to aggressively reduce cost by scaling back their steady state capacity with the expectation they got the setup right for scaling up in time. This weekend presents a common opportunity for people to figure out they don't have the magic right. Some capacity might have been moved off-premise to lower performing systems that were formerly on-premise and performing ok.
Of course on top of having data to substantiate or rule out these guesses, it'd be interesting to have data that would suggest whether the sluggishness had any business impact. It could be that this isn't even something that makes sense to worry about from a business perspective anyway.
More of the coding needs to be server side or not exist at all.
The worst is the ads. I turned on NoScript and so many pages just fly now because the stupid javascript isn't allowed to run.
I've decided to stop wasting my time responding to AC trolls/sockpuppets... so if you want a response from me... login.
A while ago, Amazon.com did a study that indicated when it took them more than four seconds to render a page on their server, that they'd lose customers. I've also seen an argument that more than eight seconds to the end user (including transit time) is problematic. How many of these sites are falling below these goals?
If last year, desktop sites were taking five seconds to load and this year they are taking six, I don't think that's a problem. If most sites are taking about the same time to load and a few are taking a ridiculously long time, then I don't think that's a general problem.
The issue is not whether the top fifty sites are taking longer on average. We should be looking at each site individually. Is Amazon.com taking longer? Etsy? Best Buy? And are they taking significantly longer (pushing them over the threshold where customers abandon them)? Or just normal variation?
In terms of mobile sites, have they considered the possibility that last year the sites were stripped down more than they needed to be and this year they may be rendering at a more appropriate speed? I don't know, as I have no idea what speed they consider problematic. There's no data here, even when I did RTFA. They only barely have a list of the sites, much less the results from each.
Virtualisation is the the problem. We have moved from ISP overbooking of bandwidth to hosting providers overbooking of cpu resources being the bottleneck.
Virtualisation is killing the internet.
FTFA:
Median webpage response times for desktop websites for the entire group (aggregate) was 3.991 seconds, compared to 3.330 seconds in 2013.
Do people even notice that? I mean, if I'm getting what I think is a great deal and it takes literally a fraction of a second more for the page to load I don't think I'm going to care.
Due to caching, downloading Javascript pays off with faster response if you hit the same site enough times. Neither the article nor the Catchpoint Systems website say how many times they hit the same site, let alone how many times a customer is expected to hit the same site so essentially this article is fluff piece.
Seastead this.
Pages now include resources from literally dozens of domains. There are megabytes of images to load, and hundreds of kilobytes worth of compressed Javascript code to run. A web site like we used to make them 5 to 10 years ago loads instantly. Browsers have improved a lot, computers are much faster, but a modern web site drags it all down and makes you feel like you're using dialup again. So install the RequestPolicy addon and look at the train wreck that is the modern web. The icing on the cake is that recently web sites have started to load most of their static parts from separate domains. Why? To improve caching, because cookies on the main domain interfere with the default configuration of popular reverse proxy cache software. These morons create web sites which wouldn't load quickly if they were coming straight from local RAM, and then they try to make them fast by pulling tricks with CDNs, caches and multiple domains. The web is fucked up.
All of the ISP's have NOT upgraded their backbone for years, they are now overselling it by never before seen levels making even 500Gb Cable Internet feel like DSL.
The problem is people are not screaming about it to their congress critter forcing ISP's to deliver what they sell. They need to pay a $1000 per user per month fine for not delivering what they promise or advertise.
That would get the lazy executives at Comcast moving.
Do not look at laser with remaining good eye.
I don't web development, but one thing I suspect is it's often not the JS code that executes slowly, though that is not uncommon. But instead
1. Any transaction over the network has round trip delay. And those are a lot longer than you think.
2. Packets get dropped and requests fail, each time that happen you need a timeout and another round trip
3. All those Javascripts are phoning home multiple times.
4. Sequentially and dependently on each other.
Be a shame if no one could get to it because you didn't pay us for a "fast lane."
I've noticed a number of sites are hosted on some kind of content management platform, presumably aloft in the Cloud. Sometimes there's a noticable delay in getting the page to load.
"Black Friday" has been happening and advertised since 1 Nov. Friday Nov 28 just happened to be one day in the stream of pseudo sales between 1 Nov and 15 Jan.
.... ...
Hark the herald tribune sings,
Advertising wondrous things.
God rest ye merry, merchants,
May you make the yuletide pay.
Angels we have heard on high
Tell us to go out and buy!
(Admittedly, no one actually reads a newspaper anymore....but, hey, work with me here...)
I gave up browsing at some point, it was so bad. Amazon was a bit slow but worked OK.
thegodmovie.com - watch it
The browsers themselves have really gotten bad in recent years. Safari on Yosemite is so bad now it is ridiculous. Also, browsers don't seem to cache content very well. I can load a page, then do a reload and all the content is downloaded a second time. In the old days if a page took too long you could hit escape and the page would load with whatever content it had collected, now if you hit escape you get a blank page. Also, the end user has almost no control over popups and crap windows that appear, especially windows asking for you to subscribe to a site. Lastly, there ought to be a law against modal dialog boxes.
hey there APK... :-)
I've decided to stop wasting my time responding to AC trolls/sockpuppets... so if you want a response from me... login.
Its really sad that retail has made a once religious Christian holiday into a free for all to buy stuff. So much so, people are willing to trample, wrestle and fight for those material things. All supposedly in the name of giving in this Christian holiday? Have human's really advanced, or are we going backwards in our advancement of our race? Not only do we act like barbarians on Black Friday but now even Thanksgiving has become the holiday that is not for family and friends.
But for working to save that bottom line for retail. The internet has certainly not helped this need for the best deal but I guess at least you cannot brawl on the internet for a big TV.
I have been a BestBuy Elite Plus member (spend $3,500.00 per year) 3 years in a row an elite member (spend $1,500.. per year) last year and this year and for all 5 years the following has happened
1. No announcement on special pre black Friday sale to reward members; email was supposed to go out and never went out, no announcement on their website. You are just supposed to get an email. Usually the sale happens one week to 4 days before black Friday. Time and date changes each year. The only place you can find out the details is in their reward member forums if you don't get the email but they don't tell you to check there.
2. All 5 years they were late starting the black Friday reward member sale
3. All 5 years the site has locked up crashed etc. You put an item in your cart go to checkout and it freezes and says we're sorry you then repeat the process multiple times to get the same message. You then either lose the item out of your cart or are stuck in a loop of not being able to checkout. Get to the checkout point go to put in your credit card or account info and again you are met with error messages. Now if you finally go to checkout put in your info and hit checkout to order and pay for the item you get a message informing you that the status of the item in your cart has changed and is no longer available. You will spend 30 minutes to an hour trying to get that Black Friday item online. It is completely frustrating and ridiculous calls to best buy about it or posting on their forums is met with a standard issue apology but no corrective action is taken. Even when they pull up your account and see that you have spent over $13,000.00 in the past 5 years in their store. They just don't care. I really wish the board of directors were aware of this, they wonder why BB is tanking this is why.
Dave420 the wannabe expert is being stupid again trying to play "expert" and he's far from it considering he's nothing but a trolling "ne'er-do-well" loser.
Stop talking? Each time he does I have to laugh at how stupid he is.
Dave420'S projecting his own issues again (insanity + stupidity) playing wannabe shrink!
(disclaimer: opinions expressed do not necessarily represent my own...)
This is Dave420 "LiVe" (absolutely live, lol): Explains it all http://www.softedconsult.com/i...
There's a whole new generation of JS devs who are complete slobs about dependencies. They will attach the entire Bootstrap library for one plug-in. I've seen libraries that embedded and minified it such that it wasn't even obvious they were using it and they weren't using it for much. 20 megabytes for a !@#$ing restful documentation widget whose own proprietary code was 20,000 lines long. It's just ridiculous. IMO, every client-side web dev should be forced to support IE6, then mobile, then write for the desktop browser. But people want the latest buzzwords, they want them fast and cheap and they want them now. This is what you get. A bunch of jr-level slobs writing e-commerce apps who knew what to say about how much they love these new frameworks at the interview.
I'd blame the Cloud
Casteism
CGI Bin or WinCGI were a safer design (server-side) http://entertainment.slashdot....
* The "infamous they" who designed javascript carrying pages obviously didn't know their history (Word docs, Excel spreadsheets & their autoexec macros were a precursor to what we're seeing today: Exploit in documents, albeit this time, online instead...).
Yes folks: THIS is what happens when you put webboys in charge of design vs. seasoned long time programmers.
APK
P.S.=> Which, *IF* you think about it, .NET designed pages are better since they do server-side work, submitting results BACK to users (not coding their documents client-side) + they do garbage cleanup too (they've always reminded me of ISAPI/NSAPI DLL work but with garbage cleanup, which was a big problem in in ISAPI)... apk
See #2 below: My FREE program adds speed, security, reliability & more, doing more, more efficiently vs. addons + fixes DNS' redirect security issues:
APK Hosts File Engine 9.0++ 32/64-bit:
http://start64.com/index.php?o...
---
A.) Hosts do more than:
1.) AdBlock ("souled-out" 2 Google/Crippled by default http://techcrunch.com/2013/07/... )
2.) Ghostery (Advertiser owned) - "Fox guards henhouse" http://en.wikipedia.org/wiki/G...
3.) Request Policy -> http://yro.slashdot.org/commen...
B.) Hosts add reliability vs. downed/redirected dns (& overcome site redirects e.g. /. beta).
C.) Hosts secure vs. malicious domains too -> http://tech.slashdot.org/comme... w/ less "moving parts" complexity
D.) Hosts files yield more:
1.) Speed (adblock & hardcodes fav sites - faster than remote dns)
2.) Security (vs. malicious domains serving malcontent + block spam/phish & trackers)
3.) Reliability (vs. downed or Kaminsky redirect vulnerable dns, 99% = unpatched vs. it & worst @ isp level + weak vs DGA, & Fastflux + dynDNS botnets)
4.) Anonymity (vs. dns request logs + dnsbl's).
---
* Hosts do more w/ less (1 file) @ faster levels (ring 0) vs redundant inefficient addons (slowing slower ring 3 browsers) via filtering 4 the IP stack (coded in C, loads w/ os, & 1st net resolver queried w\ 45++ yrs.of optimization).
* Addons = more complex + slow browsers in messagepassing (use a few concurrently & see) & are nullified by native browser methods - It's how Clarityray's destroying Adblock.
* Addons slowup slower usermode browsers layering on more - & bloat RAM consumption + excessive cpu use too (4++gb extra in FireFox https://blog.mozilla.org/nneth...)
Instead, work w/ a more capable native kernelmode part you already have - hosts (An integrated part of the ip stack)
APK
P.S.=> "The premise is quite simple: Take something designed by nature & reprogram it to make it work for the body rather than against it..." - Dr. Alice Krippen: "I am legend"
...apk
My FREE hosts program adds speed, security, reliability & more, doing more, more efficiently vs. addons + fixes DNS' redirect security issues:
APK Hosts File Engine 9.0++ 32/64-bit:
http://start64.com/index.php?o...
---
A.) Hosts do more than:
1.) AdBlock ("souled-out" 2 Google/Crippled by default http://techcrunch.com/2013/07/... )
2.) Ghostery (Advertiser owned) - "Fox guards henhouse" http://en.wikipedia.org/wiki/G...
3.) Request Policy -> http://yro.slashdot.org/commen...
B.) Hosts add reliability vs. downed/redirected dns (& overcome site redirects e.g. /. beta).
C.) Hosts secure vs. malicious domains too -> http://tech.slashdot.org/comme... w/ less "moving parts" complexity
D.) Hosts files yield more:
1.) Speed (adblock & hardcodes fav sites - faster than remote dns)
2.) Security (vs. malicious domains serving malcontent + block spam/phish & trackers)
3.) Reliability (vs. downed or Kaminsky redirect vulnerable dns, 99% = unpatched vs. it & worst @ isp level + weak vs DGA, & Fastflux + dynDNS botnets)
4.) Anonymity (vs. dns request logs + dnsbl's).
---
* Hosts do more w/ less (1 file) @ faster levels (ring 0) vs redundant inefficient addons (slowing slower ring 3 browsers) via filtering 4 the IP stack (coded in C, loads w/ os, & 1st net resolver queried w\ 45++ yrs.of optimization).
* Addons = more complex + slow browsers in messagepassing (use a few concurrently & see) & are nullified by native browser methods - It's how Clarityray's destroying Adblock.
* Addons slowup slower usermode browsers layering on more - & bloat RAM consumption + excessive cpu use too (4++gb extra in FireFox https://blog.mozilla.org/nneth...)
Instead, work w/ a more capable native kernelmode part you already have - hosts (An integrated part of the ip stack)
APK
P.S.=> "The premise is quite simple: Take something designed by nature & reprogram it to make it work for the body rather than against it..." - Dr. Alice Krippen: "I am legend"
...apk
Can adblock do 15 things hosts files can for more speed, security, reliability, & more:
1.) Secure you vs. known malicious sites/servers (beyond malicious adbanners - see 2 thru 6 below next)
2.) Secure you vs. downed DNS servers aiding reliability
3.) Secure you vs. DNS redirect poisoned dns servers
4.) Protect you vs. fastflux using botnet attacks and stop their communications back to their C&C servers
5.) Protect you vs. dynamic dns using botnet attacks and stop their communications back to their C&C servers
6.) Protect you vs. domain generation algorithm using botnet attacks and stop their communications back to their C&C servers
7.) Speed you up for websurfing not only by adblocking but also hardcoding favorite sites
8.) Get you past a dnsbl you may not agree with
9.) Keep you off dns request logs
10.) Do all of those things and block ads (better than adblock) more efficiently in cpu cycles and memory usage
11.) Work on ANY webbound application (think stand-alone email programs, for example).
12.) Give you direct, easily notepad/texteditor controlled data for all of the above
13.) Block out trackers
14.) Block spam mails sources
15.) Block phishing mails sources
"?"
* Simple YES or NO answers will do for repliers to this - that's all.
APK
P.S.=> The ANSWER ="NO" to each enumerated item above as far as "Almost ALL Ads Blocked" (crippled by default & 'souled-out' defeating it's very base purpose) is concerned -> http://techcrunch.com/2013/07/...
So, *IF* you feel like doing things LESS efficiently as well -> https://blog.mozilla.org/nneth... ontop of doing less than hosts do (by far) with more complexity + from a slower mode of operations (usermode with more messagepassing overheads vs. hosts in kernelmode, also starting up w/ the IP stack itself, before REDUNDANT inefficient addons even BEGIN to operate, & as the 1st resolver queried by the OS as well)?
That's illogical: I can lead a horse to water, but I can't make them drink!
... apk
W. Palant wrote me by email 1st saying "hosts are a shitty solution" to which I replied:
"Show us adblock can do more for added speed, security, reliability, & anonymity than hosts can, + that adblock does it more efficiently than hosts"
Which on my latter 'point-in-challenge' on efficiency AdBlock's proven by research to be MASSIVELY inefficient -> https://blog.mozilla.org/nneth... & adblock does FAR less than hosts (especially crippled by default).
I sent Wladimir Palant that challenge in response to his statement from 2 different email addresses I use!
Result = Still no answer from him in regard to my challenge put to him to this very day MONTHS later - that tell you anything? It did me!
He knows his addon is less efficient & features laden by FAR vs. hosts - Wladimir Palant RAN like a scared rabbit!
ClarityRay's also DESTROYING AdBlock - via native browser methods to DUMP what addons you use (it can't DO THAT to hosts files).
I only tell it how it is on hosts' superiority vs. AdBlock - Funny part is, Wladimir Palant running does too!
Especially considering "Almost ALL Ads Blocked" has 'souled-out' -> Google And Others Reportedly Pay Adblock Plus To Show You Ads Anyway: http://news.slashdot.org/comme...
APK
P.S.=> Bottom-Line: Hosts = a superior solution that also fixes DNS redirect security issues (vs. browser addons & their inefficiencies + messagepassing overheads as well as myriad lack of abilities hosts have from 1 file that's part of the IP stack itself - faster, more efficient, & less redundant as well, since TCP/IP has 45++ yrs. of refinement & optimization in it, & runs in a higher CPU serviced ring of privelege & operations in kernelmode vs. slower usermode layering over browsers slowing them more, & hosts = 1st resolver queried by the OS itself also)... apk
Can ghostery do 15 things hosts files can for more speed, security, reliability, & more:
1.) Secure you vs. known malicious sites/servers (beyond malicious adbanners - see 2 thru 6 below next)
2.) Secure you vs. downed DNS servers aiding reliability
3.) Secure you vs. DNS redirect poisoned dns servers
4.) Protect you vs. fastflux using botnet attacks and stop their communications back to their C&C servers
5.) Protect you vs. dynamic dns using botnet attacks and stop their communications back to their C&C servers
6.) Protect you vs. domain generation algorithm using botnet attacks and stop their communications back to their C&C servers
7.) Speed you up for websurfing not only by adblocking but also hardcoding favorite sites
8.) Get you past a dnsbl you may not agree with
9.) Keep you off dns request logs
10.) Do all of those things and block ads (better than ghostery) more efficiently in cpu cycles and memory usage
11.) Work on ANY webbound application (think stand-alone email programs, for example).
12.) Give you direct, easily notepad/texteditor controlled data for all of the above
13.) Block out trackers
14.) Block spam mails sources
15.) Block phishing mails sources
"?"
* Simple YES or NO answers will do for repliers to this - that's all.
APK
P.S.=> The ANSWER ="NO" to each enumerated item above as far as GHOSTERY (a 'souled-out' to advertisers fox guarding a henhouse -> http://techcrunch.com/2013/07/...
So, *IF* you feel like doing things LESS efficiently as well ontop of doing less than hosts do (by far) with more complexity + from a slower mode of operations (usermode with more messagepassing overheads vs. hosts in kernelmode, also starting up w/ the IP stack itself, before REDUNDANT inefficient addons even BEGIN to operate, & as the 1st resolver queried by the OS as well)?
That's illogical: I can lead a horse to water, but I can't make them drink!
... apk
If the network is hitting capacity, why would a network company want to invest in higher speeds, if the gov't is going to tell them how to run their network?
Those developers may very will need those fancy machines.
But whoever is doing usability testing should be testing on fast machines, slow machines, new machines, old machines, mobile devices, etc. If they're not, then they aren't doing the job properly.