CRIU

CRIU

Checkpoint and Restore in Userspace
Developer(s)	OpenVZ Team at Virtuozzo
Initial release	23 July 2012[1]
Stable release	1.7.2 (October 28, 2015[2]) [±]
Development status	Active
Written in	C and Assembler
Operating system	Linux
Platform	x86 64, ARM
Type	Application checkpointing
License	GNU GPL v.2
Website	criu.org

Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, /krɪʊ/), is a software tool for the Linux operating system. Using this tool, it is possible to freeze a running application (or part of it) and checkpoint it to persistent storage as a collection of files. One can then use the files to restore and run the application from the point it was frozen at. The distinctive feature of the CRIU project is that it is mainly implemented in user space, rather than in the kernel.

The project is currently under active development.

History

The initial version of CRIU software was presented to the Linux developers community by Pavel Emelyanov, the OpenVZ kernel team leader, on 15 July 2011.^[3]

In September 2011, the project was presented at the Linux Plumbers Conference.^[4] In general, most of the attendees took a positive view of the project, which is proven by the fact that a number of kernel patches required for implementing the project were included in the mainline kernel. Andrew Morton, however, was a bit skeptical:

A note on this: this is a project by various mad Russians to perform c/r mainly from userspace, with various oddball helper code added into the kernel where the need is demonstrated... However I'm less confident than the developers that it will all eventually work! So what I'm asking them to do is to wrap each piece of new code inside CONFIG_CHECKPOINT_RESTORE. So if it all eventually comes to tears and the project as a whole fails, it should be a simple matter to go through and delete all trace of it.

— Andrew Morton, ^[5]

Use

The CRIU tool is being developed as part of the OpenVZ project, with the aim of replacing the in-kernel checkpoint/restore. Though its main focus is to support the migration of containers, allowing users to check-point and restore the current state of running processes and process groups. The tool can currently be used on x86-64 and ARM systems and supports the following features:

• Processes: their hierarchy, PIDs, user and group authenticators (UID, GID, SID, etc.), system capabilities, threads, and running and stopped states
• Application memory: memory-mapped files and shared memory
• Open files
• Pipes and FIFOs
• Unix domain sockets
• Network sockets, including TCP sockets in ESTABLISHED state (see below)
• System IPC
• Timers
• Signals
• Terminals
• Linux kernel-specific system calls: inotify, signalfd, eventfd and eventpoll

As of September 2013, no kernel patching is required because all of the required functionality has already been merged into the Linux kernel mainline since kernel version 3.11, which was released on September 2, 2013.^[6][7]

TCP connection migration

One of the initial project goals was to support the migration of TCP connections, the biggest challenge being to suspend and then restore only one side of a connection. This was necessary for performing the live migration of containers (along with all their active network connections) between physical servers, the main scenario of using the checkpoint/restore feature in OpenVZ. To cope with this problem, a new feature, "TCP repair mode", was implemented. The feature was included in version 3.5 of the Linux kernel mainline^[8] and provides users with additional means to disassemble and reconstruct TCP sockets without the necessity of exchanging network packets with the opposite side of the connection.

Similar projects

The following projects provide functionality similar to CRIU:

• OpenVZ
• DMTCP^[9]
• BLCR^[10]
• Linux C/R^[11]

References

1. Pavel Emelyanov (2012-07-23). "Checkpoint-restore tool v0.1".
2. "Checkpoint-restore tool v1.5".
3. Pavel Emelyanov (2011-07-15). "Checkpoint/restore mostly in the userspace".
4. "Checkpoint/restart in the userspace". Linux Plumbers Conf 2011.
5. "Merge branch 'akpm' (aka "Andrew's patch-bomb, take two")". Linux kernel source tree. 2012-01-13.
6. "Installation: Linux Kernel". Linux kernel v3.11 or newer is required, with some specific options set
7. "Linux kernel 3.11, Section 1.5. Detailed tracking of which pages a task writes". kernelnewbies.org. 2013-09-02. Retrieved 2016-05-03.
8. Pavel Emelyanov (2012-02-29). "TCP connection repair". Linux Netdev Mailing List.
9. "DMTCP: Distributed MultiThreaded CheckPointing". SourceForge.
10. "Berkeley Lab Checkpoint/Restart (BLCR) for LINUX". Lawrence Berkeley National Laboratory.
11. "Linux Checkpoint/Restart". kernel.org.

External links

• Sanidhya Kashyap. "Rebootless Kernel Update and Validation".