Skip to main content

backup - How to get NTFS like snapshot behaviour in BTRFS?


I would like to use BTRFS to host VMs in VirtualBox to be able to use Snapshots without LVM or such. In theory I don't need CoW behaviour all the time because of performance reasons and using nodatacow it seems I don't need to. What I would like to have instead is an approach from my understanding Windows and NTFS seems to be using: Data is changed all the time without CoW, but if one creates a file system snapshot the current data is kept save within that snapshot by copying data away if it is to be changed in any way. The important thing seems to be that this only happens exactly one time per snapshot and really only for the modified blocks. So after a block to be modified has been copied away at first, all subsequent modifications to the same block are just applied, again without CoW behaviour.


Besides copying the original block of changed data to some safe place, from a performance perspective this makes a lot of sense to me and I would like to have exactly that behaviour to host my VMs. Those write some data all the time and I simply don't see how I need CoW behaviour for all those changes.


I only want CoW after I created a file system snapshot by purpose, e.g. for backup purposes. Afterwards I need CoW of course to be able to keep my snapshots consistent as long as I need it. But again, even after creation of the snapshots I wouldn't need CoWfor all eternity for all data, but only once for the afterwards changed blocks. All changes after the first one could simply be applied as without any CoW.


From my understanding of the BTRFS docs, if CoW happens once to some file, it keeps happening forever. But I might be wrong of course...


So, is what I would like to have possible at all with BTRFS?



Answer




If CoW happens once to some file, it keeps happening forever. But I might be wrong of course.



I think you are wrong. I have found this question about taking snapshots of a BTRFS volume mounted with nodatacow. There is a citation there (from the BTRFS mailing list) that seems crucial to your case:



On a NOCOW file the first write to a fileblock (4096 bytes) after a snapshot must still be COW, because the snapshot locks the old version in place, and now the fileblock has changed, so it MUST be written elsewhere despite the NOCOW in ordered to keep the snapshot as it was. However, the file does retain the NOCOW attribute and additional writes to the same fileblock will be in-place... until the next snapshot of course.



It looks like nodatacow mount option gives you exactly what you want. Just remember there are limitations:



nodatacow
Do not copy-on-write data for newly created files, existing files are unaffected. This also turns off checksumming! […] potentially getting partially updated files on system failures. […] switches off compression!



Source: BTRFS mount options.


Comments

Post a Comment

Popular Posts

How do I transmit a single hexadecimal value serial data in PuTTY using an Alt code?

I am trying to sent a specific hexadecimal value across a serial COM port using PuTTY. Specifically, I want to send the hex codes 9C, B6, FC, and 8B. I have looked up the Alt codes for these and they are 156, 182, 252, and 139 respectively. However, whenever I input the Alt codes, a preceding hex value of C2 is sent before 9C, B6, and 8B so the values that are sent are C2 9C, C2 B6, and C2 8B. The value for FC is changed to C3 FC. Why are these values being placed before the hex value and why is FC being changed altogether? To me, it seems like there is a problem internally converting the Alt code to hex. Is there a way to directly input hex values without using Alt codes in PuTTY? Answer What you're seeing is just ordinary text character set conversion. As far as PuTTY is concerned, you are typing (and reading) text , not raw binary data, therefore it has to convert the text to bytes in whatever configured character set before sending it over the wire. In other words, when y...
Post a Comment
Read more

linux - Extract/save a mail attachment using bash

Using normal bash tools (ie, built-ins or commonly-available command-line tools), is it possible, and how to extract/save attachments on emails? For example, say I have a nightly report which arrives via email but is a zip archive of several log files. I want to save all those zips into a backup directory. How would I accomplish that? Answer If you're aiming for portability, beware that there are several different versions of mail(1) and mailx(1) . There's a POSIX mailx command, but with very few requirements. And none of the implementations I have seem to parse attachments anyway. You might have the mpack package . Its munpack command saves all parts of a MIME message into separate files, then all you have to do is save the interesting parts and clean up the rest. There's also metamail . An equivalent of munpack is metamail -wy .
Post a Comment
Read more

ubuntu - Why does my USB hdd returns SG_IO: bad/missing sense data?

I am able to boot and run commands from external USB hdd; the message in question appears for about 45 seconds then booting continues. GRUB2 is installed on internal HDD. When choosing to boot directly to /dev/sdb the message doesn't appear, however boot time is about the same as booting to internal HDD. /dev/sdb: Timing cached reads: 1018 MB in 2.00 seconds = 508.97 MB/sec Timing buffered disk reads: 80 MB in 3.03 seconds = 26.37 MB/sec pfeiffep@de:~$ sudo hdparm -i /dev/sdb /dev/sdb: SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 10 00 00 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 HDIO_GET_IDENTITY failed: Invalid argument Gparted correctly identifies the drive as SAMSUNG MP0402H. Any ideas how to remedy the HDIO & SG_IO messages?
Post a Comment
Read more

Desktop reboots itself on sleep or hibernate

I have been using an ASUS M2NPV-VM motherboard for main home desktop workstation, operating Windows Vista x64. This computer has right from day one not been able to enter hibernate or standby; after Windows performs its final actions and brings the machine down, it would automatically revive itself for a reboot. Updating to the second latest BIOS (1201)has not helped (the latest BIOS revision would induce video refresh problems rendering it unusable). I have been reading related discussions on incidents similar to mine to no avail of a true workable solution. They appear to be more speculative guesses rather than actual knowledge on the inner workings of motherboard hardware. Does anybody have any electronic engineering experience on PC energy-saving standards to provide a more informed opinion how to go about getting this to work? More stories: this motherboard could not even reboot properly the first thing i used it. It was due to refresh rate of the onboard GPU, which had no influe...
Post a Comment
Read more