Linked by Brooss on Wed 23rd Mar 2011 23:14 UTC
Benchmarks A new set of x264 and vpxenc encoder benchmarks have been published. The new benchmarks address many of the concerns raised in the comments about the methodology used in the previous article, such as using SSIM for quality measurement. Theora is also included in these tests.
Thread beginning with comment 467670
To read all comments associated with this story, please click here.
Where are the pictures?
by Gusar on Thu 24th Mar 2011 11:52 UTC
Member since:

When I'm watching a video, I'm watching, you know, the video. Not pretty graphs.
It's good that at least ssim was used and not psnr, but fact remains that not even ssim accurately represents visual quality. Using '--tune ssim' with x264 deactivates some psy-opts. And so while this test shows how well the encoders do optimizing for ssim, pretty graphs tell me nothing about how the actual videos look like.

Reply Score: 1

RE: Where are the pictures?
by renox on Thu 24th Mar 2011 18:49 in reply to "Where are the pictures?"
renox Member since:

The thing is: even humans evaluations are biased!

Several examples:
* audiophile prefers 'warm' (distorted) sounds because that's what they are used to from their vinyl disks.
* young prefer sounds distorted like MP3 because that's what they are used to..
* consumer cameras by default do not try to have good color reproduction because users prefers 'hot' colors..

Reply Parent Score: 2