CXL for AI/ML: A Practical Guide to Unleashing the Potential of AI and Machine Learning

Mon Sep 16 | 8:30am
Location:
Cypress
Abstract

This session dives into the practical applications of CXL for AI/ML. We'll explore how CXL Memory Expansion, Pooling, and Sharing can boost performance by breaking traditional memory barriers. As memory demands skyrocket in the era of large language models, CXL emerges as a game-changing technology to overcome traditional memory constraints. Join us for a practical guide packed with insights showcasing CXL, where you will learn about:

  • The State of the CXL Software Ecosphere
  • Benchmarking CPU, Memory, and GPUs
  • Memory Placement and Movement Strategies for application optimization
  • The Importance of Memory in AI/ML Workloads
  • Retrieval Augmented Generation (RAG) Pipelines
  • And much, much more!

Don't miss this opportunity to gain a competitive edge in AI. Learn how to harness the full potential of CXL and take your AI/ML workloads to unprecedented levels of performance and efficiency.

Learning Objectives

Explore the performance benefits of CXL memory expansion and sharing
Discover how CXL technology enhances LLM training & inference and enables supercharged ray clusters
Learn how to leverage the memory benefits of CXL technology for AI and ML workloads

Abstract

This session dives into the practical applications of CXL for AI/ML. We'll explore how CXL Memory Expansion, Pooling, and Sharing can boost performance by breaking traditional memory barriers. As memory demands skyrocket in the era of large language models, CXL emerges as a game-changing technology to overcome traditional memory constraints. Join us for a practical guide packed with insights showcasing CXL, where you will learn about:

  • The State of the CXL Software Ecosphere
  • Benchmarking CPU, Memory, and GPUs
  • Memory Placement and Movement Strategies for application optimization
  • The Importance of Memory in AI/ML Workloads
  • Retrieval Augmented Generation (RAG) Pipelines
  • And much, much more!

Don't miss this opportunity to gain a competitive edge in AI. Learn how to harness the full potential of CXL and take your AI/ML workloads to unprecedented levels of performance and efficiency.

Learning Objectives

Explore the performance benefits of CXL memory expansion and sharing
Discover how CXL technology enhances LLM training & inference and enables supercharged ray clusters
Learn how to leverage the memory benefits of CXL technology for AI and ML workloads


---

Steve Scargall
MemVerge
Related Sessions