容器、高性能计算、云

联科集团(中国)有限公司

Agenda⚫ Virtualize & Containerize⚫ Docker & Singularity⚫ Capsule & Cloudified HPC

Virtualize & Containerize

虚拟化

虚拟化与容器化

虚拟化 容器化

主机操作系统

应用

库

应用

库

应用

库

应用

库

应用

库

主机操作系统

虚拟化软件

应用

操作系统

虚拟硬件

硬件驱动

库

应用

操作系统

虚拟硬件

硬件驱动

库

虚拟化与容器化

虚拟化 容器化

模拟出一套完整的硬件 操作系统级别的隔离

强隔离，安全性高 名字空间隔离，安全性较弱

重量级，虚机内运行完整操作系统 轻量级，容器内运行进程

支持不同种类操作系统 与主机共用同一内核

启动慢 实时启动

性能开销较大，尤其是读写密集型 几乎没有性能损失

虚拟化与容器化

⚫虚拟化引擎⚫ Vmware⚫ Parallels⚫ Hyper-V⚫ VirtualBox⚫ Qemu/KVM

⚫容器化引擎⚫Docker⚫Singularity⚫runc⚫CRI-O⚫Capsule

Docker & Singularity

Docker & Singularity

⚫Docker⚫ Rapid application deployment⚫ Portability across machines⚫ Version control and component reuse⚫ Sharing⚫ Lightweight footprint and minimal overhead ⚫ Simplified maintenance

⚫Singularity⚫ Encapsulation of the environment⚫ Containers are image based⚫ No user contextual changes or root escalation allowed⚫ No root owned daemon processes

Docker: Architecture

Docker: Images

Docker: Principles

• a series of image layers• ephemeral micro service• one process per container

Singularity

⚫Lawrence Berkeley National Lab⚫Containers for Science, Reproducibility and Mobility

⚫ singularity shell /home/public/alpine.sif⚫ singularity exec /home/public/alpine.sif pwd⚫ singularity exec /home/public/alpine.sif whoami⚫ singularity --debug exec /home/public/alpine.sif true⚫ singularity exec -p /home/public/alpine.sif ps au⚫ singularity exec /home/public/alpine.sif env

Singularity: MPI support

mpirun -n NP singularity exec /path/to/image /mpi/program

Capsule & Cloudified HPC

Capsule: Architecture

⚫Container over HPC

Slurm

OS OS OS OS OS OS OS

mpirun

sing

ula

rity

sing

ula

rity

sing

ula

rity

APP2

APP2 APP2

APP1

AP

P4

AP

P5

⚫HPC over Container

Cloud

OS OS OS OS OS OS OS

CAP CAP CAP CAP VM

Slurm

mpirun

APP2 APP2

APP1

CAP CAP

Troque

APP1

VM

VM

APP2

Capsule: Container + HPC + Cloud

Performance

Mobility Elasticity

Singularity Rescale

K8S

HPC

Container Cloud

Capsule: https://capsule.sh

⚫ capsule images⚫ amd64 + arm64⚫ ( time + space ) capsule⚫ code + data + config⚫ systemd-nspawn compatible

DEMO:

⚫平台登陆⚫应用商店⚫虚拟集群⚫作业提交⚫文件传输⚫交互操作