CXL for AI/ML: A Practical Guide to Unleashing the Potential of AI and Machine Learning

Mon Sep 16 | 8:30am
Location:
Cypress
Abstract

This session dives into the practical applications of CXL for AI/ML. We'll explore how CXL Memory Expansion, Pooling, and Sharing can boost performance by breaking traditional memory barriers. As memory demands skyrocket in the era of large language models, CXL emerges as a game-changing technology to overcome traditional memory constraints. Join us for a practical guide packed with insights showcasing CXL, where you will learn about:

  • The State of the CXL Software Ecosphere
  • Benchmarking CPU, Memory, and GPUs
  • Memory Placement and Movement Strategies for application optimization
  • The Importance of Memory in AI/ML Workloads
  • Retrieval Augmented Generation (RAG) Pipelines
  • And much, much more!

Don't miss this opportunity to gain a competitive edge in AI. Learn how to harness the full potential of CXL and take your AI/ML workloads to unprecedented levels of performance and efficiency.

Learning Objectives

Explore the performance benefits of CXL memory expansion and sharing
Discover how CXL technology enhances LLM training & inference and enables supercharged ray clusters
Learn how to leverage the memory benefits of CXL technology for AI and ML workloads


---

Steve Scargall
MemVerge
Related Sessions