Remember the whole H.264 thing? Cisco just solved it for us – more or less.
The industry has been divided on the choice of a common video codec for some time, namely because the industry standard – H.264 – requires royalty payments to MPEG LA. Today, I am pleased to announce Cisco is making a bold move to take concerns about these payments off the table.
We plan to open-source our H.264 codec, and to provide it as a binary module that can be downloaded for free from the Internet. Cisco will not pass on our MPEG LA licensing costs for this module, and based on the current licensing environment, this will effectively make H.264 free for use in WebRTC.
Cisco will release the code of its H.264 codec under the BSD license, and will also make binaries available for just about every possible platform. Cisco will pay all the licensing costs – over the coming decade, this will cost them a whopping $65 million, illustrating just how expensive H.264 is, and how unrealistic it was to expect it to become a standard without a free implementation being available for everyone to use. It has to be noted that both end users and developers can make use of this.
Mozilla has already announced it will implement this codec into Firefox. All this is great, but it doesn’t really address the issue in the long term – the next generation of codecs is coming, and once they arrive, this whole process starts all over again. Will another sugar daddy step up by that time?
I have to say this came as a surprise. It actually sounds workable too, as long as they are able and willing to shell out the 5 million a year this will cost them. Its their dime, so if they want to spend it to defang the h.264 patent pool so be it – who am I to argue with it?
I’m actually less surprised about Cisco being willing to deal with the expense than I am about MPEGLA going along with this – but I’m not sure they could really do anything about it legally either. It does sound like it adheres to the letter of their patent licensing model.
It is not all roses though… You will have to use their binary implementation in order to get umbrella licensing. Binary blobs and open source don’t have a good track record. On the other hand, if they are really serious about this and take changes from the community seriously it may led to a huge library of h.264 codecs for many platforms/OS combinations.
I still want to see a royalty free codec one day – one without all the bickering and bullshit attached, but I am having trouble finding too much fault with this – I guess it will just depend on how complicated the process of downloading and linking to their binaries is and the quality of the implementation.
It could work.
This could be a bit of a trojan horse on Cisco’s part.
According to one of the commenters on the LWN announcement, the vote on what video codec(s) should be Mandatory To Implement for WebRTC is a week from now and, apparently, Cisco is a member of the MPEG-LA.
https://lwn.net/Articles/572205/
Edited 2013-10-31 00:50 UTC
Well I’m just going by what they say they are going to do, I’m not saying they don’t have a selfish motive. Still, it is what it is… This has broader implications than just WebRTC.
The world dealt with the MP3 codec in much the same way … Its certainly not an ideal solution, but it is better than nothing for those it matters to and it solves the problem from a practical point of view. I’ll still encode my videos with webm, thank you very much, but I honestly can’t fault them pushing for h.264 in WebRTC when the players who will benefit the most from this standard are either already paying MPEGLA royalties or are in fact patent holders themselves.
If it makes all the webm haters shut up and leave me alone I’ll be happy
Just say another tidbit I hadn’t though much about until now… With all the video conferencing gear/software Cisco already sells, they are probably not far off from the $5 million annual cap anyway. This may in fact not really cost them much (if any) money at all…
I wonder how the other patent holders in the MPEGLA patent pool really feel about this? Its too early to say, but if this is structured as liberally as they are implying this could drastically cut the patent pools licensing revenue going forward. Why would anyone pay for patent licensing if they can harness this instead? Maybe h.265 is close enough that they don’t care, but still…
The licensing is so complex for h264, I wouldn’t be surprised if they legally couldn’t make use of it. IE, it might be licensed for consumption/decoding only.
Because licensing is actually negligible for for-profit businesses and having encoding/decoding built-in and tuned to your product and customers’s needs rather than require a separate download and user interaction to the Cisco implementation and then being dependent on whatever Cisco has come up with for whatever hardware is preferable for these businesses and their users.
Ha. tell that to the guys in Asia making unlicensed player hardware that they can’t sell in the states because of the patents… Ill bet they figure out a way to leverage this. Negligible is not the same as non-existent, and in some lines of business things like this have a way of bubbling over.
The question was: why would current licensees continue licensing if this is provided free by Cisco?
People who aren’t paying licenses currently do not qualify as people who are paying licenses currently.
And the answer is: If this “loophole” creates an opportunity for such non-licensees to start undercutting your products and you start losing sales, why would you continue paying for the licensing? Licensing only works at the OEM level when your competition has to do it too…
You really have a logic and/or reading comprehension problem. You’ve said these OEMs aren’t licensing it. So if they aren’t licensing it, by your own words, they aren’t competing with those who are licensing it? Or rather, you are wrong that licensing only works when your competition is doing so? Take your pick, your own logic doesn’t work with your own statements.
The notion that Apple, Microsoft, and hundreds of others are going to be threatened by OSS projects forced to use this or shady Asian OEMs willing to use unlicensed codecs in cheap products and thus they will switch to it as well is a laughable claim.
Edited 2013-10-31 21:05 UTC
They aren’t.
They can’t – there are import restrictions. They can only release the products in Asia because of the patents. Remove the patent problem and the import restriction goes away, i.e. they can sell in the states where most of the licensees are selling.
Im pretty sure Apple and Microsoft don’t make cheap set top boxes… They are also h.264 patent holders, so yeah, Im pretty sure they are fine with the status quo. Somone like Roku isn’t though, and if Cisco offers a version of the codec they can pull in over the internet to avoid paying MPEGLA licensing then yeah, why wouldn’t they if all of a sudden they see cheap knockoffs popping up at Walmart doing that exact thing?
There are over 1200 MPEGLA licensees, the vast majority of them are small technology companies, not Microsofts or Apples…
Okay, so you’re claim is they aren’t competing yet but will. Fine. (There are in fact many cheap Asian devices that are getting unlicensed products through customs by the way… That still doesn’t mean they are “competing” but nonetheless…)
I think this is a ludicrous theory that free software supporters need to perpetuate in order to delude themselves into believing that mpeg patent licensing is onerous. It is not.
Roku would be fools to give up usability for the sake of pennies saved. We can treat them as our test case of your theory if you’d like?
Edited 2013-10-31 22:13 UTC
Copy/paste of an official answer in the comments on the Cisco website anouncement:
“Yes. We plan to open source the build scripts as well, so that third parties can replicate it and do their own verification on signatures at the time of installation of the module. This will allow them to be certain that the binary modules is exactly the compiled version of the source code in the repository. – Nadee Gunasena, Cisco PR”
I’d rather see a truely free codec without stupid patents attached get popular.
Edited 2013-10-31 01:13 UTC
There is still Daala, but it isn’t quite there yet. And there is still webm. Maybe with this all the h.264 proponents will quite feeling like these other options are trying to take something away from them (something that most of them never had to begin with, but whatever)…
It’s also interesting that Cisco participates in Daala development (at least they claim they do). I hope it won’t introduce any potential hidden patent problems.
Whilst h.265 HEVC and VP9/Opus (whatever that is called) are evolutionary advancements respectively on h.264 and VP8/Vorbis (Webm), Daala is apparently a whole new thing.
http://en.wikipedia.org/wiki/High_Efficiency_Video_Coding
High Efficiency Video Coding (HEVC) is a video compression format, a successor to H.264/MPEG-4 AVC (Advanced Video Coding) that was jointly developed by the ISO/IEC Moving Picture Experts Group (MPEG) and ITU-T Video Coding Experts Group (VCEG) as ISO/IEC 23008-2 MPEG-H Part 2 and ITU-T H.265.
http://en.wikipedia.org/wiki/VP9
VP9 is an open and royalty free video compression standard being developed by Google. VP9 had earlier development names of Next Gen Open Video (NGOV) and VP-Next. VP9 is a successor to VP8.
http://en.wikipedia.org/wiki/Daala_(video_codec)
Daala is the current working name of a video codec under development by the Xiph.Org Foundation. Daala is intended to be a high-efficiency codec for use cases similar to those of High Efficiency Video Coding (HEVC or H.265) and VP9. Daala will use a lapped transform to reduce the blocking artefacts characteristic of other video codecs that use the discrete cosine transform directly.
Daala is a fundamentally whole new approach.
In June 2013 Chris Montgomery (founder of Xiph.org) stated that the performance goal for Daala is to be a generation beyond HEVC and VP9.
http://people.xiph.org/~xiphmont/demo/daala/demo1.shtml
Daala is a new general-purpose video codec currently under development at Xiph.Org. Our performance target is roughly a generation beyond current ‘next-generation’ codecs like VP9 and HEVC, making Daala a next-next-generation effort. As with other Xiph codecs, the Daala format is and will always be royalty-free with a permissive FOSS license.
…
The next-generation VP9 and HEVC codecs are the latest incremental refinements of a basic codec design that dates back 25 years to h.261. This conservative, linear development strategy evolving a proven design has yielded reliable improvement with relatively low risk, but the law of diminishing returns is setting in. Recent performance increases are coming at exponentially increasing computational cost.
Daala tries for a larger leap forward— by first leaping sideways— to a new codec design and numerous novel coding techniques. In addition to the technical freedom of starting fresh, this new design consciously avoids most of the patent thicket surrounding mainstream block-DCT-based codecs. At its very core, for example, Daala is based on lapped transforms, not the traditional DCT.
Edited 2013-10-31 07:22 UTC
Vorbis and Opus don’t share much at all, all your comments are just about the video codecs.
It’s very likely that Opus will get paired with Daala.
In theory any of these video codecs can be paired with any of the audio codecs mentioned. As far as I know there is nothing to prevent h.265 to be paired with, say Opus, within, say, a mkv container. It is simply that no-one is pushing such a combination.
I only mention VP8 in combination with Vorbis because that combination (within a mkv-like container) defines Webm. As far as I know the combination of VP9 and Opus does not yet have an official name, but that combination is currently shipping as an experimental feature within the Chrome browser.
To preserve freedom from patent encumbrances, it makes sense to combine Daala with a free/open audio codec, within a free/open container format, and as far as I know Daala + Opus within a mkv container would be the best candidate at this time.
Edited 2013-10-31 13:00 UTC
As would I, but let’s face it none of the available patent-free options come even close to what H.264 can achieve, let alone H.265.
So what does it mean? Do they plan to push H.264 to become a mandatory part of WebRTC, or this is just a convenience for interoperability and the standard will remain without mandatory video codec until better open codecs are ready (Daala)?
I wonder why hasn’t any other company dont this already.
There are many companies Already paying at the cap of 5 Million. Releasing something similar wouldn’t cost them a penny more. And Cisco, as other have mentioned are propberly already paying 5 million or close to 5 million per year anyway.
Cisco has a reason to bother – widespread adoption of WebRTC means money for them down the road, and they are already heavily committed to h.264 internally.
Who else is there in a similar position?
Proprietary codecs? Especially for Web? Into the trash it goes.
For a moment, let’s not think that the NSA (and others) like the idea of putting binary blobs in people’s systems. Like the poster named “XorEaxEax” wrote:
Edited 2013-10-31 08:17 UTC
The only reason nobody’s going after the so-called patent-free codecs right now is they’re not a force to be bothered with. If Daala, VP( or any other codec really becomes a threat to the MPEG-LA and its licensing income, you can bet they’ll find patents they can use against it. I wouldn’t be surprised if they hold a patent along the lines of “a method for encoding and compressing video for distribution via digital devices.” Vague patents are all they’d need to cause some real trouble and, as we all know, the head of the MPEG-LA is a known patent troll already.
Edited 2013-10-31 12:06 UTC
In order to get a patent, one has to show that it is a new invention, that there is no prior art, and that this new invention is not obvious (it must actually be inventive). The title of a patent does not really count, what counts are the claims of the method description.
Daala is inventive, it is a new approach to video codecs, fundamentally different to the MPEG LA patent pool for h.264 and h.265.
Daala is therefore its own prior art. Daala as prior art is documented here:
http://wiki.xiph.org/Daala
Edited 2013-10-31 12:43 UTC
No, I said they most likely already *have* a vague patent to attack it with. They don’t need to get a new one, and remember which country’s patent office we’re talking about here. The USPTO will grant a patent on pretty much anything and let the lawyers sort it out later, as long as they’re paid.
Fortunately there are many trends these days, even in the insane environment that is the contemporary US, towards preventing patent trolls of this kind.
In theory, practice and theory are the same, in practice they are not.
At least in the US the Patent Office is severely understaffed and over logged (by design), so their current policy is: grant the patent and let the lawyers sort it out afterwards. It’s under such a climate that patent trolling can thrive as a viable business model.
By design…
Absolutely on the point.
😉
Christopher “Monty” Montgomery’s blog:
“By endorsing Cisco’s plan, there’s no getting around the fact that we’ve caved on our principles.”
http://xiphmont.livejournal.com/61927.html
Are we really claiming $6.5 million annually is “whopping”, “expensive”, and “unrealistic”? Remember: this is to serve 10s of millions to an INFINITE number of clients at zero additional cost because Cisco (and several other players — INCLUDING GOOGLE) are most assuredly already at the capped figure.
Will the free software supporters realize that they should be directing this question at Google? After all, they’re probably spending a similar rate on VP8 ( http://www.osnews.com/story/26849/Google_called_the_MPEG-LA_s_bluff… ) despite Thom’s claims to the contrary and certainly spending more by developing the loser VP-series… but that cost is sunk in a loser, none of that cost actually goes into supporting the superior, dominant, and de facto H.264/H.265 codec.
Edited 2013-10-31 12:55 UTC
You expect free software supporters to fault Google for backing a royalty free standard because it is “losing” (whatever the f*ck that means) to the poster child for patent encumbered software? Really?
That is what kills me with you guys, you think there is a competition going on that the other side of your argument is trying to “win” at your expense. A patent encumbered “standard”, no matter how “free” you make it, is still patent encumbered and there is still a whole party of companies out there trying to monetize it through licensing. It is what it is. webm may have a faint stench of patents on it after the Google/MPEGLA deal, but no one is trying to monetize it. Sure, Google wants to eventually make money with it, but not by selling it – they want to make money by using it.
Im practical – this gesture from Cisco solves a real problem in a practical way for quite a lot of people. But Im one of those pesky “free software” guys you are talking about I guess… I don’t care one bit about this deal from Cisco – it solves absolutely nothing at all for me. I can see why Mozilla is going along with this, sometimes practical concerns trump ideals – they fought for a long time, but at some point the rubber hits the road and you have to get on with things. Just because they are holding their noses and going along with this doesn’t mean they like it.
webm was not a perfect play. There were still “questions” about it from a patent point of view. Google paid the bill to make that problem go away – so it is in some respects tainted by that. But it is STILL orders of magnitude better than this deal from Cisco for people who care. Why? Because I can actually include my build of it in software, and I can even change it if I want to. I can in fact do pretty much whatever I want with it. I can encode a million videos and do whatever I want with those too. I can release code to others and they can use it without any threat of royalties. I can participate.
webm has no strings attached. h.264 has strings you can’t see. Its not the same thing. Ill be happy to use h.264 whenever the patents expire or the patent pool is released without royalty – until then it is radioactive. Mozilla is putting on their hazmat suits so they can work with it, but there are not that many players in the open source world that have their particular problem set. This deal has virtually no effect on “fee software” – no one cares.
“…a whole party of companies out there trying to monetize it through licensing.”
And through other reserved means.
Yes.
Now that you’ve bizarrely expressed incredulity in a grandiose manner towards a pretty clearly expressed statement on my part, do you have an actual question?
Also: that “Yes” is conditioned on ignoring that you ignored what I actually said, and is a “Yes” to the fact that when Thom says they’ll have to hope for another sugardaddy in the next generation… Yes, I believe they should be looking to Google.
Ok, so I guess my question is why would you think the free software supporters would care at all about who pays for to the next round of codecs we don’t want to use because they are patent encumbered? Thom was obviously talking about h.264 supporters with his statement, people like you for instance.
We don’t want a “free” codec. We don’t even want a “royalty free” codec. We want a “patent free” codec – or at the least a codec with all the patents in a community patent pool with libre licensing. If the business world wants to keep doing this dance every 5-10 years that is fine by us – its their money and they can bend over and take it as often as they like.
Every few years a new codec is built by someone in the free software community, every time it is better than the last one, every time it is less likely to infringe on existing patents, and every time it is closer in quality to the best coming out of the licensing cartels. Maybe Daala will break through, maybe it will be the one after that – but it will happen, and once it does and we have a codec with a patent free lineage that establishes its own prior art and is as good or superior to the alternatives. Once that happens this whole argument just goes away. It is just a matter of time really…
Because someone is going to have to?
No. As I said, your reading comprehension is poor. Mpeg-la does not need a sugardaddy. It has no shortage of licensees. Cisco’s plans do not add any additional revenue to mpeg-la’s coffers. However, OSS will need someone to pull a “Cisco” for h.265.
Talk to Eich and Monty. I’ll take them anyday over YOU as the representatives for free software. Apparently, they’ve finally realized that self-delusion is hitting themselves.
nonsense.
more nonsense.
Completely apeshite, ridiculously-stupid nonsense.
You still don’t get it. The OSS crowd doesn’t want to use h.264 – they never really have. They are caving as in “we know everyone else is hellbent on this so to keep the peace we will go along with it”. Cisco didn’t appease the OSS crowd by doing this – the OSS crowd appeased THEM by going along with it. How f*cking hard is it for you to read between the f*cking lines????? This offers no benefit at all to supporters of a free and libre web. It solves the business worlds problem in a barely-paletable-but-better-than-the-status-quo kind of way – but is is the business world’s problem, not OSS’s.
Riiigghtt… Quotes straight out of Monty’s comments on this:
So I guess you didn’t get past the “we caved” soundbite…?
Edited 2013-11-01 20:42 UTC
You don’t get it: I don’t care if the OSS crowd wants to or not. They will. Or they won’t participate.
No shit.
Haha! Hilarious. OSS is appeasing CISCO (?) by caving on their principles?
Are you asking yourself or me?
Yup.
Yup.
Yup. OSS is still fucked unless, like Eich and Monty, you get pragmatic and accept reality.
I’m unsure what you think I’m not reading? This is in accord with everything I said and think.
There are lots of codecs that are better in a large variety of ways than MP3 – some of them completely open source, and free of patents. But we are still mostly stuck listening to tinny, wasteful MP3 files. Video will suffer the same fate. We’ll be stuck on h.264 forever. And if you don’t think the big players are fine saddling the web with outdated and incompatible technology (except maybe Google), you haven’t been paying attention. 😉
Let’s hope “the industry” will wisen up and use VP9 or Daala as their next generation codec. Since none of the next generation formats work on H.264 players, there is no ‘compatibility’ to maintain.
Oh yeah, I forgot, this is the real world. MS and Apple will only support H.264 and H.265/HEVC out of the box in Windows and OS X, just to preserve the existing royalty scheme, which is another hoop for open source OSes to go through.
Edited 2013-10-31 14:11 UTC
When Mozilla abandoned ‘open’
in exchange for ‘gratis’
Somehow FirefoxOS
ambitions
has a link into this?
:/
Exposed, untouchable source
is not open source
dionicio,
“Exposed, untouchable source is not open source”
I cannot tell whether Cisco has ulterior motives, maybe yes, maybe no.
But to be fair, it *is* open source. If Cisco had ONLY released the code under a BSD license without releasing a royalty free binary, you wouldn’t be complaining, right? The fact that Cisco *additionally* released a royalty free binary doesn’t change the fact that the source code is just as open as it was before.
The pathetic patent system is the root cause of the issue, and for what it’s worth I believe Cisco when they claim they aren’t able to release the source code royalty free under their license obligations. However, given the realities of the situation, would you go so far as to suggest that Cisco’s open source code is worse than any other open source code BECAUSE of the royalty free binaries? Most people would say ‘no’, although as I indicated in another post: if too many devs end up choosing a binary over open source versions that could still lead to negative repercussions for open source.
Like, dionicio said, it’s libre versus gratis. Cisco has positioned itself in the center of this ironic controversy by giving us the choice to choose gratis, which wasn’t an option with respect to 264.
Edited 2013-10-31 18:08 UTC
The source
and the compiling script
is there
only for you
to check they are the same.
You are not allowed
to use the source
in any other way.
Every user
still has to install the blob.
“See? No Troyan Horses here…”
“I can put whatever Troyans on the exposed code if I want”
Edited 2013-10-31 18:14 UTC
“Its my code”
“I paid for it”
“You can’t bifurcate if not like my soldiers on the field”
Maybe I am wrong…
Not even Cisco can modify H.264
without permission.
What we are talking here
is about an
implementation of the code.
This particular implementation
is allowed to be free as beer.
Protected by Cisco license if,
and only if,
downloaded from Cisco servers,
as an installable blob.
Where Am I wrong?
:/
Me no entender…
If true
this effectively
takes royalties out of the equations.
🙂
Good news
for many small economic segments.
(Not news for open causes. But still good news.)
dionicio,
“You are not allowed to use the source in any other way. Every user still has to install the blob.”
Cisco’s blog has a bit of a Q/A going on where they answer some of these concerns. Going by what Nadee Gunasena has said on behalf of Cisco, your statements are incorrect.
http://blogs.cisco.com/collaboration/open-source-h-264-removes-barr…
“The source code will be open source and distributed with a BSD lIcense.”
So this would mean your right to use/modify/distribute this source code would be the same as for any other BSD licensed source code. Keep in mind that it’s NOT the license that’s restricting usage here, it’s the patent system. All open (and closed) source software runs the risk of infringing patents held by others, we must not confuse the difference between copyright and patents.
Edited 2013-10-31 18:28 UTC
Thanks for your coolness.
Interesting times ahead…
🙂
Since you need to use the binary blob, if it isn’t available for your OS or CPU, you’re toast.
This seems like a way to keep the big 3 OSes going for the next decade without any real competition.
Devil’s Advocate: Cisco is open to producing licensed builds for anything you can port the source to.
Source: Comment reply from Nadee Gunasena on http://blogs.cisco.com/collaboration/open-source-h-264-removes-barr…
(via http://xiphmont.livejournal.com/61927.html )
Edited 2013-11-01 01:14 UTC
How do we know that if the guys at Haiku (for example) re-compiled the source themselves and asked Cisco to subsequently host the resulting binary that Cisco will say no?
I think this is a positive development considering how detrimental our patent system is. However it’s still a problem that ONLY Cisco’s binary blobs will be licensed, any works derived from their open source code would still be subject to royalties according to Cisco itself.
On the one hand, it’s no worse than today, independent open source H264 implementations will still be legally subjected to licenses just like before. On the other hand it seems to place pure open source projects at an artificial disadvantage as everyone makes a dash for the binary blobs in the interests of attaining relief from the patent system.
If we’re not very careful, this “solution” could creep up in all levels of software development. We might set into motion the events that lead all developers working on all kinds of projects to feel pressured into using binary blobs instead of open source code, and that would be a travesty.
Cisco is one of 29 H.264 licensors.
Global giants in manufacturing and R&D.
Think Ericsson, LG, Mitsubishi, NTT, Panasonic, Philips, Samsung, Toshiba….
There are 1,277 H.264 licensees.
The big names here — the Fortune 500 of video technologies — could meet the enterprise cap on H.264 royalties from the sweepings of loose change off their washroom floors.
H,264 is deeply entrenched in markets which exist outside the web. Markets in which Google has no power to influence events.
The geek needs to look beyond the web, beyond mobile. — or his next-generation video codec will be dead on arrival.