Home / server / Questions / 237084
In Process
intuited
Asked: 2011-02-18 19:31:26 +0800 CST

Synchronization of volume snapshots when doing whole system backups

  • 772

Is there a way to guarantee consistency across volumes when doing backups from LVM snapshots? Consider this scenario:

  • Some system upgrade is in progress. It will write some files to the /usr volume, and once completed, will record success in the /var volume.
  • As the upgrade is just about complete, I run a backup script that creates snapshots of the /usr and /var volumes, along with the rest of the system's volumes, and proceeds to create backups from those snapshots.
  • Just before the upgrade's last write/flush on the /usr volume completes, the backup script takes its snapshot of /usr.
  • That write completes, and the upgrade operation's success is quickly recorded in the nebulous depths of /var.
  • The backup script takes a snapshot of /var.
  • The backup script creates backups from the snapshots it has, er, snapshotted.

So the result of all of this tomfoolery is that the resulting /usr backup contains a file which is missing a few bits, and the /var backup contains metadata indicating that that file is complete and approved for use.

Without delving into the details of which operating systems' system upgrade systems would be unfazed by such trifles, is there a way to avoid such problems? At the least this seems like it could cause some application to fail unexpectedly after restoration of such a backup.

backup lvm snapshot

1 Answers

  1. The problem is a bit more general than that even. Even with one volume getting a snapshot, there's no guarantee that the data on that volume make sense at a file level. LVM snapshots only ensure block-level consistency.

    The only way to be 100% sure that your files are in a consistent state is to get your applications to flush everything to disk and suspend writes while you create the snapshot. If you really care about that, and your applications support it, you should script it in to your backup procedure.

    For your particular use case, why not just ensure that he the backup doesn't run while you are performing the upgrade? Either disable it for that time period or delay it until your upgrade has completed. At the minimum the consistency of the files being upgraded will be preserved.

    • 1