Geeks With Blogs

News

Charles Young

IE9 Beta 1 arrived today, and it looks great.  The browser wars are back on and getting heated.  The IE guys have been getting very bullish about performance on their blog site.  See their post from a few days ago at http://blogs.msdn.com/b/ie/archive/2010/09/10/the-architecture-of-full-hardware-acceleration-of-all-web-page-content.aspx.  Mozilla got beta 5 of Firefox 4 out of the door a couple of days ago and have hit back hard with various counterclaims see http://www.theregister.co.uk/2010/09/13/mozilla_v_windows_on_hardware_acceleration/.   Who is right?   Well, as I see it, we have an unwinnable playground spat about who was 'first' in GPU acceleration and the undignified sight of both sides claiming to have the fastest browser.

It's easy to investigate the performance side of things, at least in a casual way.  One place to start is the IE9 test site at http://ie.microsoft.com/testdrive/Performance/01FlyingImages/Default.html.  Now, of course, this is a Microsoft site and is likely to favour their browser.  However, this site has been a work in progress for a long time now, and cannot, as a simple matter of chronology, have been explicitly doctored to show Firefox 4 beta 5 in a bad light.  Whatever the truth about why things are as they are, it is clearly the case that Firefox 4 can sometimes rival IE9 performance when running the GPU-orientated demonstration pages on that site.  Take 'Flying Images' for example.  It's fine if you view 'My Browser' or 'All Browsers'.   However, try 'Fix Photo' or 'Large IE Logo' and see the difference.  IE9 is much faster. Try playing Browser Hunt on both browsers (hey, it's Pac-Man).  IE9 wins hands-down.

OK, so these test could be biased.  Where else can we turn.  Ahha.  There is a single test page that Mozilla has been using to demonstrate the wonders of GPU acceleration in Firefox.  You will find it at http://demos.hacks.mozilla.org/openweb/HWACCEL/.    Let’s do a comparison.  Oh my!   Firefox 4 is the clear winner.  It reports performance 50% faster than IE9.   Turns out, though, that this page is no good for comparing hardware acceleration performance between different browsers (Mozilla, of course, never claimed it was).  The culprit is the line 'if (!stop) setTimeout(draw, TO)' where TO, which is initially 30, tends to a value of 0.  As the test speeds up, you just end up measuring the browser-specific resolution of the timer set by the zero-interval call to setTimeout(), rather than the speed of rendering.  Differences in rendering are so small that they are hidden by timer resolution characteristics.  At least we can say that when using setTimeout() in this way, FF4 is faster than IE9.  Maybe MS should change the timer resolution in IE9?  Just an idea.

[UPDATE - Feb 2011] ...and Microsoft did exactly that!  Their claim is that the timer resolution has a significant effect on power consumption and, therefore, battery life.   In IE9 RC, they now detect if your are running on battery power or mains.  On mains power, they reduce the resolution from 16 to 4ms. The test runs almost five time faster on mains than it does on battery, completely obliterating the performance results I originally got in Firefox 4 beta 5.  Meanwhile, for some reason, the test appears to run more slowly in the current Firefox 4 beta (11) than on beta 5.  Not sure why.   Maybe Firefox has increased the resolution time to reduce power consumption.   Anyway, IE9 RC runs this test over twenty times faster than FF4.11 on my laptop.  FP4.11 and Chrome 9 run the test in about the same time.

OK.  So we can see, as so often with micro benchmarks, that you can pick the test of your choice to 'prove' whatever you wish.

Let's try the SunSpider test.

IE9 Beta 1:  383.6 ms
Firefox 4 Beta 5:  
 504.2 ms

Today, IE9 has a faster JavaScript implementation than Firefox 4.  That surely is beyond contention.  But wait a moment.  The Mozilla crew are working an on a new JavaScript engine which they claim will propel them into poll position at some point in the future.   Watch this space!

[UPDATE - Feb 2011]  This battle has really heated up.   Currently, Chrome 9 runs SunSpider in 347.0 ms.  FF4 beta 11 has improved very significantly, and now beats Chrome convincingly in 288.8 ms.   What about IE 9 RC?   Well, it now completes the test in 246.7 ms and takes poll position.  I suspect the rivalry will continue for some time, so expect further jostling.  Incidently, the ranking is exactly reversed for Google's V8 benchmark tests which have consistently suggested that Chrome provides the fastest JavaScript performance for a long time now.  People get very heated about these things, but I suggest that, as I stated earlier, it is a common characteristic of microbenchmarks that you can 'prove' whatever you wish be careful selection of tests.  The important thing is that, over the last couple of years, and very much driven by Google's achievments in Chrome, all the mainstream browsers, including IE, are now providing excellent performance.

One thing that surprised me going through the Microsoft tests is the number of technologies that the Firefox beta does not seem to support.   I ran into issues with SVG, MP3, etc.  I was also surprised that, going through Microsoft's tests, I couldn't immediately locate any obvious improvement in FF4 over FF3.6 in terms of standards compliance.  That surely can't be right.  I haven't the time to investigate this further, but it was a weird experience to see IE9 happily doing a whole bunch of things Firefox 4 can't, and doing them in a more standards-compliant fashion.   I'm sure, though, that someone could come up with stuff that Firefox handles and which IE9 does not.

I'm going to largely steer clear of commenting further on standards compliance for the simple reason that this is such a fraught area, it needs proper independent assessment.  I will say this, though.  IE8 made significant improvements, but still fell short in several areas. IE9 is clearly in a different league to previous versions.  I'm sure we will see a huge effort to try to trash what Microsoft has achieved and the advent of new web sites dedicated to trying to convince you that IE9 is a failure.  However, I expect that IE9 will do rather well when tested independently using official compliance test suites for various specifications, and may even emerge as best-of-breed in a number of areas.

Microsoft has been playing catch-up with the other browser suppliers for a very long time.  There are many people in the web development community for whom the notion that IE is a perpetual poor relation to other browsers forms a core part of their belief system.  The trouble is that, as often tends to happen over time, the laggards catch up.  They may even become the leaders.  Some people find this unnerving.  Expect an avalanche of claims and counter-claims in the days to come, and lots of red-hot anger and bile.  WebGL support seems to be one area of contention currently, so why not use that to have a go at MS, if you are so inclined.

We are seeing the dawn of the end of an era.  Of course, older versions of IE (especially IE6) are still widely used and will haunt Microsoft for years to come.  The IE6 phenomenon is due to the fact that many corporates have far slower cycles than Microsoft when it comes to technology refresh and remain locked down on this dinosaur of a browser.  Anyway, the point is this. IE has now climbed its way fully out of the hole it was in and is back in contention, at least on the Windows platform (multi-platform support is one thing that IE certainly can't touch).  This is a good thing.  It results in greater competition and better browsers.  IE9 would not exist if it were not for Firefox, Chrome and Safari.  Firefox, Chrome and Safari will end up as better, faster, more standards-compliant browsers because of the new 'threat' from IE9.  We all win.   Thanks, Microsoft, and thanks Mozilla, Google and Apple.

Posted on Wednesday, September 15, 2010 3:52 PM | Back to top


Comments on this post: I'm a PC, and I love IE.

# re: I'm a PC, and I love IE.
Requesting Gravatar...
i'm a PC too BUT i love FF ;)
Left by forfaits on Sep 15, 2010 7:10 PM

# re: I'm a PC, and I love IE.
Requesting Gravatar...
I am totally speechless about performance on IE9.
Its much better than FF3.6. Html5 & CSS3 support is far more beetr than ff.
Left by Pranav Singh on Sep 16, 2010 7:55 AM

# re: I'm a PC, and I love IE.
Requesting Gravatar...
Charles, like you I'm mostly loving IE 9!
As always I'm a MAC running Widows 7 and IE9!!!
Out of intrest ran Sunspider test on Safari 5 under Windows 7 - scored even better still at 338.6ms and I wouldn't really have Safari as my default!!
Left by Andy James on Sep 16, 2010 9:09 AM

# re: I'm a PC, and I love IE.
Requesting Gravatar...
@andy: The current JavaScript ranking I belive is Opera at no. 1 place, then Safari, Chrome, IE9 and Firefox. The difference , though, is very small. Firefox is languishing a bit, but Mozilla are working on it. There has only been a tiny improvement (if any at all) between Preview 4 and Beta 1 of IE, but we may see some further improvement before RTM. In most cases, you could not perceieve any difference in JavaScript performance now between the main browsers.

@Pranav yes, me too! I've been running FF, Chrome and IE9 side by side all day, and I am amazed. I knew IE9 was fast when handling intensive graphics, but I didn't really expect it to be noticably faster than the other browsers when simply browsing general pages. Today has been an eye opener for me. The IE faithful appear to have the fastest browser. What a turn-around!
Left by Charles Young on Sep 16, 2010 1:16 PM

# re: I'm a PC, and I love IE.
Requesting Gravatar...
I am totally speechless about all of this. IE is fail defined. Even with it's JS engine performance gains it is a dog with JS/AJAX intensive apps. I have not worked on a single UI related project in the last 3-4 years where IE did not cause a show stopper bug, required significant "performance tuning" (AKA Hacks) or added 40-120% more time to complete a project.
Left by Duke E. Love on Dec 07, 2011 10:24 PM

# re: I'm a PC, and I love IE.
Requesting Gravatar...
I like it so. But i prefer Chromium it's more faster.
Left by création site web perpignan on Jan 24, 2012 11:45 PM

Your comment:
 (will show your gravatar)


Copyright © Charles Young | Powered by: GeeksWithBlogs.net