Emerging Trends: SDS, AI/ML Data Pipelines, and Modern Data Center Architectures
The trends domain asks you to map new workloads onto architecture: containers and CSI, the I/O profile of AI/ML pipelines, end-to-end NVMe, and modern fabric design.
Containers, HCI and composable infrastructure
- Kubernetes consumes storage through CSI drivers that create persistent volumes on PowerFlex, PowerStore or PowerScale. Stateful workloads need snapshot, clone and topology-aware binding support, not just a mount.
- HCI such as VxRail with vSAN converges compute and storage per node, so they scale together. Composable disaggregation such as PowerFlex pools local disks into network-delivered block volumes, so compute and storage scale independently.
- SDS attributes remain abstraction, pooling, policy-driven automation and full API coverage.
AI/ML data pipelines
- Stages: ingest, curate and label, train, checkpoint, then inference. Each stage stresses storage differently.
- Training is throughput-, concurrency- and metadata-heavy: many GPUs reading many files in parallel, plus large sequential checkpoint writes every few minutes. Inference is latency- and IOPS-sensitive with smaller working sets.
- Enablers: scale-out NAS with high single-stream and aggregate throughput (PowerScale OneFS), NFS over RDMA, GPUDirect Storage to bypass host CPU copies, all-NVMe tiers for hot data, and object storage as the data lake feeding the file-based training tier.
Modern data center architecture
- End-to-end NVMe: NVMe-oF over FC, RoCE or TCP removes SCSI translation and cuts latency; 25, 100 and 400 GbE plus spine-leaf fabrics with ECMP provide non-blocking east-west bandwidth.
- DPUs and SmartNICs offload networking and storage processing; zero-trust segmentation replaces perimeter trust; telemetry and AIOps feed capacity and anomaly decisions.
- Sustainability metrics such as watts per TB and data reduction ratios now appear in design reviews and refresh decisions.
Worked example
Sixty-four GPUs each need 2 GB/s to stay saturated, so aggregate demand is 128 GB/s. A 200 Gb/s front-end port delivers 25 GB/s, so at least six such ports or nodes are required: 128 divided by 25 is 5.1, rounded up to 6 for headroom. A single 25 GbE link at about 3.1 GB/s would starve the job by a factor of forty. AI designs are sized on throughput and concurrency, not IOPS alone.
Traps that cost marks
- Sizing an AI cluster on IOPS while ignoring throughput and small-file metadata operations.
- Assuming GPUDirect Storage works over TCP without an RDMA-capable fabric and NICs.
- Forcing every workload onto HCI when compute and storage need independent scaling.
- Treating an object store as a POSIX file system for training jobs.