Surendra Verma, Development Manager on the Vista Kernel team, digs into Vista's new Transactional File System with Charles Torre. TxF, as it is referred to internally, is a new kernel construct that is part of an updated Vista NTFS. Surendra provides a high level overview of TxF in this video. Elsewhere, Microsoft is serious about meeting its ship date for Windows Vista during the second half of 2006.
To read all comments associated with this story, please click here.
Member since:2005-07-06
And thank YOU for your explanation and your work. It looks like this is something all operating systems should have to implement patching, installing applications, updating websites, and so on.
I would LOVE an option in Windows Explorer to "transactionally" copy and move files and folders. Something like holding down a key while dragging. And a command line tool would be welcome.
Hopefully Linux will adopt something like this in the future. ZFS doesn't have this - a snapshot of an entile filesystem is completely different from a transaction about a part of the filesystem. Going back to an earlier snapshot means losing ALL new data, even the new data that you do not want to lose!
Member since:Filesystem transactions eh?
Ok, so what do you do when you have N transactions opened
racing at *some* common directories and files?
Do you block? If so, do you have dead-lock detection?
Please elaborate.
Do you fail-fast? If so, is first-come the champion?
Please elaborate.
And finally, what of applications not using tx-semantics? How do they fare against applications
tx'ing. Is each fs-op then considered a xaction?
If this is the case, what is the performance
impact on fs-op considering the overhead?
Member since:Thanks for replying on this site.
Will TxF be turned on by default for all file system ops? I hope it will. I hope you will include support for well-behaved legacy Win32 apps, so that early adopters see immediate benefits moving to Vista. This is similar to what Apple did with Carbon. Can you have a compatibility DLL that converts all but the lowest level file ops to use proper calls to TxF? Will ALL dotNet 2+ CLR apps use TxF under Vista?
C'mon, Microsoft is an incredibly brave company. Make everyone catch up to you guys again. More importantly, make things better for everyone without even letting them know it. There's an old adage stating that when something is done *right*, it can't be easily discerned that anything has been *done* at all. Most users won't notice TxF beyond the stupid errors and corrupton that are no longer happening, but everyone should *have* it.
-JM
"At the end of a week in which Electronic Arts confirmed it wasn't developing a thing for the Wii U, one of the software engineers in EA Sports' Canada studio, in a series of since-deleted tweets, disparaged the console as 'crap' and suggested Nintendo should give up on hardware altogether. 'The Wii U is crap. Less powerful than an Xbox 360. Poor online/store. Weird tablet', tweeted Bob Summerwill, listed as a senior software engineer at EA Canada, in a reply to a tweet posting a link about EA's no-Wii U news. 'Nintendo are walking dead at this point'." The Wii U is turning into the 21st century's Virtual Boy.
"In NixOS, the entire operating system - the kernel, applications, system packages, configuration files, and so on - is built by the Nix package manager from a description in a purely functional build language. The fact that it's purely functional essentially means that building a new configuration cannot overwrite previous configurations. Most of the other features follow from this." Interesting approach. A Linux distribution, sure, but with some very refreshing ideas about system configuration.
Appfour added, among other features, C/C++ support to its new version of AIDE. From Android-IDE, "Now you can write parts of your app or your whole app in C/C++ on your device. AIDE supports the Standard Android NDK toolchain (GCC 4.6 + Bionic, STL, ...). No changes are necessary if you want to build an app developed on a PC with Eclipse. C/C++ development is fully integrated: Build errors appear in the error list and files can easily be navigated to with Go to file. The editor supports C/C++ syntax highlighting."
Ars nails it: "The answer is that Google did announce what amounts to a fairly substantial Android update yesterday. They simply did it without adding to the update fragmentation problems that continue to plague the platform. By focusing on these changes and not the apparently-waiting-in-the-wings update to the core software, Google is showing us one of the ways in which it's trying to fix the update problem."
"It is good for programmers to understand what goes on inside a processor. The CPU is at the heart of our career. What goes on inside the CPU? How long does it take for one instruction to run? What does it mean when a new CPU has a 12-stage pipeline, or 18-stage pipeline, or even a 'deep' 31-stage pipeline? Programs generally treat the CPU as a black box. Instructions go into the box in order, instructions come out of the box in order, and some processing magic happens inside. As a programmer, it is useful to learn what happens inside the box. This is especially true if you will be working on tasks like program optimization. If you don't know what is going on inside the CPU, how can you optimize for it? This article is about what goes on inside the x86 processor's deep pipeline."
"It was the only moment I heard regret slip into Otellini's voice during the several hours of conversations I had with him. 'The lesson I took away from that was, while we like to speak with data around here, so many times in my career I've ended up making decisions with my gut, and I should have followed my gut,' he said. 'My gut told me to say yes.'" The world would've been a much different place - Apple would have been less dependant on Samsung for its chips, which probably would've meant less money for Samsung to develop its Galaxy business.Glass is getting some love at Google I/O as well. New applications have been released - Facebook, Twitter, Evernote, Elle, Tumblr, and CNN. Perhaps more interesting: the newly announced Google Glass Developer Kit will allow offline applications and direct hardware access - great for hacking and expanding Glass' potential. This kit will really allow hackers to put Glass through its paces."But Beck and Merrill decided that simply banning toxic players wasn't an acceptable solution for their game. Riot Games began experimenting with more constructive modes of player management through a formal player behavior initiative that actually conducts controlled experiments on its player base to see what helps reduce bad behavior. The results of that initiative have been shared at a lecture at the Massachusetts Institute of Technology and on panels at the Penny Arcade Expo East and the Game Developers Conference." Absolutely fascinating stuff. I'm a League of Legends player, and to be honest, the community isn't nearly as bad as some make it out to be. I'm happy Riot games has the guts to employ science to address the issue.
"Android and iOS, the number one and number two ranked smartphone operating systems worldwide, combined for 92.3% of all smartphone shipments during the first quarter of 2013 as Windows Phone crept past BlackBerry for 3rd place. According to the International Data Corporation Worldwide Quarterly Mobile Phone Tracker, Android smartphone vendors and Apple shipped a total of 199.5 million units worldwide during 1Q13, up 59.1% from the 125.4 million units shipped during 1Q12." Windows Phone doubles from a few to twice few, iOS loser market share as its growth is slower than that of the overall market. BlackBerry continues slide into irrelevance."According to the latest research from our Wireless Smartphone Strategies service, global Android smartphone profits reached US$5 billion in total during the first quarter of 2013. Samsung dominated and captured an impressive 95 percent share of all Android smartphone profits." Wow.
Member since:
2005-12-04
I worked earlier in the year on Txf, and am now working on NTFS. Surendra (in the video) is my manager.
There seems to be a little confusion about a couple of points.
NTFS has always been journalled. Journalling is a very small transaction - a rename will either complete or fail, for example, you won't have two links to the same file, or no links, etc. When the volume is mounted, any half-done operations like this will be resolved. That is not new; ext3, zfs, plenty of filesystems do this.
TXF is a whole new kettle of fish. It provides for user-controlled, multiple updates, for longer periods of time. 'tummy' was exactly right with this:
Say:
copy fileb to filea
rename filea to filec
change contents of filec
create registry key HKLU/A/B
commit()
This is exactly correct. The kernel controls transactions; new applications can participate in the transaction as a Transactional Resource Manager, so that commit() can commit file changes, registry changes, or any 3rd party environment changes. The kernel understands transactions.
I can assure you, this is not a trivial undertaking.
I had a blog on this, which provides some old information; it's at http://blogs.msdn.com/because_we_can/. I'll try to update this with some more information when I get the chance.