Today, we’re excited to announce the general availability of our next-generation Storage-optimized Z4M machine series in Google Compute Engine, available as both Virtual Machine (VM) and bare-metal instances.
We built Z4M to provide storage for AI/ML training and inference workloads such as checkpointing, distributed key-value (KV) cache and parallel file systems — workloads that handle huge data volumes and require massive parallel data processing, as well as high storage and networking throughput. Low latency access to data is equally critical to keep GPUs and TPUs fully utilized. Powered by the fifth-generation Intel Xeon Scalable processors and paired with the latest enhancements in Titanium, Z4M provides up to 168,000 GiB of Local SSD (LSSD) storage coupled with up to 400 Gbps of Cloud Remote Direct Memory Access (RDMA) networking. RDMA improves the performance of these demanding workloads by reducing data-access latency by up to 60% compared to TCP networking, so you can increase your applications’ throughput while right-sizing your cloud investment.
Z4M VMs and bare-metal instances
The Z4M VM portfolio lets you scale your infrastructure and clusters to meet workload requirements by providing a large total LSSD capacity as well as 875 GiB of LSSD capacity per vCPU. Further, Z4M bare-metal instances give you direct access to the physical hardware without a virtualization layer, reducing latency for workloads such as custom hypervisors and workloads with specific licensing needs. Z4M bare-metal instances are also ideal for agentic AI workloads, enabling developers to run isolated sandboxes at scale, including with Agent Substrate.
In addition to 168,000 GiB of LSSD storage, Z4M VMs and bare metal instances offer up to 192 vCPUs and up to 1,536 GiB of memory for at-scale data processing. Z4M instances are based on Titanium SSDs, which offload local storage processing from CPU resources to deliver real-time data processing, low-latency, high-throughput storage performance and enhanced storage security. Z4M delivers up to 15.6M random-read IOPS and up to 75,600 MiB/s sequential-read throughput, improving the LSSD storage performance and throughput compared to Z3 by up to 70% and 110% respectively.
Cloud RDMA and direct storage access
Z4M provides low-latency access to the storage layer using 400 Gbps of RDMA-enabled standard networking.This helps keep GPUs and TPUs fully utilized even when processing large multimodal datasets, by transferring massive amounts of data at line rate using NVIDIA GPUDirect Storage and TPUDirect Storage. At the same time, Z4M transfers data at full line rate while processing data locally, with a balanced-LSSD-to-networking-throughput ratio of 1.4:1.
Built for demanding workloads
|
Workload Category |
Typical Applications |
Z4M Benefits |
|---|---|---|
|
AIML training and inference |
Checkpointing, distributed Key-Value cache |
Large LSSD capacity paired with 400 Gbps low-latency RDMA network that supports GPUDirect Storage and TPUDirect Storage, keeping GPUs and TPUs fully utilized even when processing large multimodal datasets. |
|
Parallel file systems and Enterprise-class storage |
Weka, Sycomp, Silk, VDURA |
Very high vCPU:LSSD ratio of 1:875 combined with a balanced LSSD:networking throughput of 1.4: to improve applications’ performance by processing data locally while transferring data to clients at full line rate. |
|
Business-critical enterprise Databases |
SQL, NoSQL, Vector DBs, data search |
Sustained LSSD high I/O performance and throughput to sustain a large number of transactions per second. |
