Acid3 Test Released. I Took Some Screen Captures. Lots of Fail.
Screen Shots
[update! 3-27-2008] As everyone now knows, we’ve had a winner in the race to pass Acid3. Congrats to the WebKit team
These were done with browsercam, so the test may or may not have fully run its course by the time the 15 second delay was up. Still, it’s not like any of these browsers were close, so a few seconds isn’t going to save them if, in fact, they were cut off before the rendering was over.
As a note, I tried to do the Capture in Konqueror and it pretty much made Browsercam cry and/or vomit (”Do NOT Try The Capture Again!”) I’m going to log in shortly to see what the actual damage is.
[update]It’s a known bug[/update]
Reference Rendering:
And now the Fail parade:
Camino 1.51 Mac OS 10.5
Firefox 2 Mac OS 10.5
Firefox 3 Mac OS 10.5
Internet Explorer 6 Windows XP
Internet Explorer 7 Windows Vista
Internet Explorer 7 Windows XP
Firefox 2 Windows XP
Firefox 3 Windows XP
Safari 3 Mac OS 10.5
[update]as seen in the comments the latest build is now scoring 87/100[/update]
[update]Sorry Opera! I had the capture, but forgot to post it in my rush to get out the door today[/update]
Opera 9.24 Windows Vista
Here’s Konqueror built from SVN 2008.03.06 (thanks to Ronald Hummelink and everyone else that sent in Konqueror captures)
And here’s IE8 Beta:
Opera 9.5:
Firefox 3 Beta 4 on Windows XP
Now, the press release:
Acid3: Putting Browser Makers on Notice, Again. - The Web Standards Project
Acid3: Putting Browser Makers on Notice, Again.
Released: 3 March 2008 | Author: The Web Standards Project
The Web Standards Project (WaSP) today announced the release of Acid3, the latest in a line of tests designed to expose flaws in the implementation of mature Web standards in Web browsers. By making sure their software adheres to the test, the creators of these products can be more confident that their software will display and function with Web pages correctly both now and with Web pages of the future.
The Acid3 Test is designed to test specifications for Web 2.0, and exposes potential flaws in implementations of the public ECMAScript 262 and W3C Document Object Model 2 standards. Collectively known as DOM Scripting, it is these technologies that enable advanced page interactivity and power many advanced web applications such as web-based email and online office applications.
As a series of 100 mini-tests, Acid3 has already been found to expose flaws in all tested browsers, including Internet Explorer, Firefox, Opera, and Safari. WaSP hopes that Acid3 will prove useful to browser makers during the development of future versions of their products.
WaSP has a history of such initiatives. In 1997, emeritus member Todd Fahrner, together with a group of crack Web developers dubbed the “CSS Samurai,” created an “Acid Test” that highlighted shortcomings in browser support for CSS. The Acid Test was instrumental in moving the industry much closer to the goal of consistent rendering of Web pages in different browsers. This was followed by Acid2 in 2005, designed to expose flaws in the implementation of mature Web standards such as HTML, CSS, and PNG. Acid3 builds on and extends this legacy to web applications in 2008.
Acid3 can be found online at http://www.webstandards.org/acid3/
BJ Clark Says:
Thanks for posting these. That is some massive fail.
Posted: March 4th, 2008 at 1:41 pm
rob Says:
No problem. I’m glad to share this kind of thing.
As an update, Hixie mentioned that Safari 3 is now scoring 87/100 on its nightly builds.
Posted: March 4th, 2008 at 1:50 pm
codist Says:
The latest webkit nightly gets 87/100. I tried it this morning.
Posted: March 4th, 2008 at 4:00 pm
rob Says:
Yeah, as I mentioned in #2 Hixie wrote about that when unleashing acid3 on the world. I need to source a screen shot and update the post…
Posted: March 4th, 2008 at 4:04 pm
anonymous Says:
Which FF3 beta did you use?
Posted: March 4th, 2008 at 4:48 pm
rob Says:
Browsercam reports it as 3.0b3 (you can see it in the full size screen shot)
Posted: March 4th, 2008 at 5:12 pm
Opera Fan Says:
Where’s opera?
Posted: March 4th, 2008 at 6:20 pm
rob Says:
“Where’s opera?”
Runs off to edit the post…
Right there at the bottom
Sorry about missing it the first time around!
Posted: March 4th, 2008 at 6:57 pm
Web 2.0 Announcer Says:
Acid3 Test Released. I Took Some Screen Captures….
[...]I took some screen captures of the major browsers rendering the Acid3 test- Opera 9, Safari 3, Firefox 2,3, and Internet Explorer 6 and 7. With the exception of the latest nightly build of Safari 3, they all score below 59. Not a surprise, of cour…
Posted: March 5th, 2008 at 6:15 am
legoman666 Says:
I just ran it on FF3 beta 3 and got a 58/100.
?
Posted: March 5th, 2008 at 10:22 am
David Gates Says:
The latest Opera beta (9.50) gets 60/100 on my XP installation.
Posted: March 5th, 2008 at 10:59 am
Chris Pine Says:
Maybe try Opera 9.5? It fares better.
Posted: March 5th, 2008 at 11:24 am
rob Says:
I’m swamped today, but I’ll check out Opera 9.5 today if I get the chance. right now I’m working off of browsercam, but I’m more than happy to expand this beyond the walls of browsercam’s test suite if it’s possible for me to do so.
Posted: March 5th, 2008 at 11:35 am
Wes Kroesbergen Says:
The latest WebKit gets 90/100 here.
Posted: March 5th, 2008 at 12:48 pm
Kroz Says:
Where’s Konqueror?
Posted: March 5th, 2008 at 2:21 pm
rob Says:
As I mentioned (right before the screen shots start), unpatched, Acid3 kills Konqueror.
It’s a known bug ( http://bugs.kde.org/show_bug.cgi?id=155451 )
I don’t have access to a Linux machine running KDE ( outside of the one at Browsercam) at present, so I can’t do the test myself with a patched version. If anyone wants to contribute a screen shot of a patched version of Konqueror I’ll gladly post it.
Posted: March 5th, 2008 at 2:33 pm
chip Says:
not mentioned yet, but Internet Explorer 8 beta 1 (released today) for Vista fails at 17/100.
screenshot:
http://www.convivea.com/acid3-ie8-vista.jpg
Posted: March 5th, 2008 at 6:09 pm
mayor Says:
Newest Opera 9.50 beta build 9755
http://student.agh.edu.pl/~mayor/acid3opera950.jpg
Posted: March 7th, 2008 at 9:06 am
Jimmy Says:
17/100 for IE8 Beta. That’s just pathetic.
Posted: March 7th, 2008 at 9:19 am
Felipe Fidelix Says:
Opera 9.50 Gets a better score.
Please Screen it.
Posted: March 7th, 2008 at 9:23 am
kebrus Says:
“legoman666 Says:
I just ran it on FF3 beta 3 and got a 58/100.
?”
deactivate adblock and run it again, at least it worked for me
Posted: March 7th, 2008 at 9:31 am
rob Says:
Opera 9.5 added. Thanks guys!
Posted: March 7th, 2008 at 9:40 am
Khurt Says:
WebKit on OS X 10.5
http://flickr.com/photos/khurt/2296462451/
Posted: March 7th, 2008 at 9:48 am
Fizzycakes Says:
Wow, just more proof IE is the worst main stream web browser out there. I still don’t get why it’s still the most popular.
Posted: March 7th, 2008 at 10:36 am
Henry 'Pi' James Says:
Does anyone else find it problematic that the official “reference rendering” is not an image, but itself a HTML page? What if a browser fails the reference rendering — but in the same way it fails the Acid3 test?
Theoretically a new web browser can be created in five minutes which passes the test: It renders any given web page to a blank white canvas. The Acid3 will “look exactly, pixel for pixel, like the reference rendering”, as the requirement reads.
Posted: March 7th, 2008 at 11:41 am
LOL Says:
one thing i can say - these tests are bullsh*t
Posted: March 7th, 2008 at 12:33 pm
Evan Says:
Gee, a very early beta (IE8) gets a low score… what a mark against it.
Fizzycakes:
It’s most popular because it’s the default browser for windows.
Posted: March 7th, 2008 at 1:31 pm
Ben Dover Says:
What, no Netscape?
Posted: March 7th, 2008 at 3:08 pm
skrzat Says:
Firefox 3b5pre build 2008030607 has 68/100
Posted: March 8th, 2008 at 4:12 am
Stephan Says:
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9b4) Gecko/2008030510 Firefox/3.0b4
gets 67/100
Look ‘a here: http://img378.imageshack.us/img378/4306/screenshotie4.png
Posted: March 8th, 2008 at 6:32 am
Stephan Says:
acutally, Nightly Tester Tools screwed with the output.
it looks more like this:
http://img394.imageshack.us/img394/2017/screenshottheacid3testmxy2.png
Posted: March 8th, 2008 at 6:34 am
John Lockwood Says:
For what its worth I got a score of 39/100 running Safari on an iPhone with 1.1.4 firmware. While very impressive, this is not terribly surprising since it is after all running pretty much the same Mac OS X and Safari (and webkit) code as on a Mac.
Safari 3.0 under Mac OS X 10.4.11 also gets the same 39/100 score (as previously reported for Mac OS X 10.5).
I also tried a Nokia N95 mobile phone but it completely failed to run the test. This was a surprise since it is supposed to use webkit (like Safari), it failed due to a lack of Javascript support.
A Palm TX running the Blazer browser seemed to get a bit further than the Nokia but also failed to score anything.
Finally, just for laughs I tried Internet Explorer 5.2.3 under Mac OS X 10.4.11 (the last ever version of IE for the Mac) and it also failed to run the test and scored nothing.
I would guess Safari 3 beta for Windows would be scoring the same as the Mac version, anyone tried it?
Posted: March 11th, 2008 at 8:11 am
rob Says:
I just tested it. Safari 3 Beta for Windows scores the same.
Posted: March 11th, 2008 at 8:50 am
John Lockwood Says:
Thanks for the response rob regarding Safari on Windows.
It just goes to show that Apple deliver equally good software for all the platforms they develop for, while Microsoft insist on pushing deliberately inferior versions on anything other than Windows (e.g. MS Messenger, Office, RDC Client, etc. etc. etc. for Mac).
Posted: March 12th, 2008 at 12:49 pm
Greg Haines Says:
The just released Safari 3.1 scores a solid 74/100 (and says ‘LINKTEST FAILED’). I believe Safari now has the highest score of the Big 3!
Posted: March 18th, 2008 at 2:07 pm
Adie Says:
I get 77/100 on Opera 9.50 9841
Posted: March 18th, 2008 at 3:51 pm
J Says:
WebKit build from 25.03.2008 gets…
95/100
http://img178.imageshack.us/img178/7018/picture1zk8.png
Posted: March 25th, 2008 at 11:14 am
rob Says:
Wow. They’re closing in rapidly.
Posted: March 25th, 2008 at 12:54 pm
Scotepi Says:
i get 99/100 on Safari 5525.13
Posted: March 27th, 2008 at 8:44 pm
rob Says:
Yeah, actually I do too. I’ll have to check the version I tested on at work. They have been adjusting the test over the past few days so maybe we’re seeing a byproduct of that.
Posted: March 27th, 2008 at 9:15 pm
stelt Says:
acid3 is a step up towards better SVG testing.
Posted: March 31st, 2008 at 4:25 am
John Davis Says:
Webkit has been hitting 100/100 consistently for the last few weeks:
http://nightly.webkit.org/start/trunk/35113
John Davis
Posted: July 11th, 2008 at 1:11 am