Read more Read more AI Inferencing: Recommendation System
1.7x Boost in AI Inferencing Performance with CXL
Memory Bottleneck for CPU-based Recommendation System
Without CXL
Challenge:
- DLRM model sizes continue to grow beyond the capacity of a single system
- Inefficient power utilization with sparse data across distributed systems
- Limited memory bandwidth for embedding table lookup operations
- Lack of software support for memory tiering
Memory Expansion for CPU-based Recommendation System
With CXL
Solution:
- Increases memory capacity by 133% and memory bandwidth by 66%
- Boosts AI inferencing performance by 73%
- Leo provides more memory bandwidth for each AI inferencing system
- Lowers power consumption with consolidated server fleet
Videos
Read more 
Read more Accelerating Database Performance with Leo: FMS 2023
See how CXL® memory enhances OLTP solutions with increased transaction throughput, reduced infrastructure costs, and improved user experience.
Read more AI Inferencing Demo with CXL®-Attached Memory: FMS 2024
This award-winning demo shows how AI inferencing can gain significant benefits using CXL®-attached memory.
Read more CXL® Memory Pooling: Industry-First Demo
The industry’s first CXL® memory pooling solution to reduce memory stranding, optimize memory utilization and reduce TCO for cloud servers.
Read more Industry-first CXL® 2.0 RAS Capabilities Demo: FMS 2023
See the industry’s first public demonstration of the CXL® 2.0 RAS capabilities of Leo Smart Memory Controllers.
Read more Leo CXL® Memory Controllers Break Through the Memory Wall
See how Leo CXL® Smart Memory Controllers combined with 5th Gen Intel Xeon Scalable Processors increase memory bandwidth and capacity by 50%.
Read more Leo CXL® Smart Memory Controllers: First Look Demo
Get your first look and an end-to-end demonstration of Astera Labs Leo Smart Memory Controllers for CXL® 1.1 and 2.0, the industry’s first purpose-built…
Read more Leo Interop with Intel Xeon 6 Processors
Astera Labs has completed successful interop testing between Leo CXL Smart Memory Controllers and Intel Xeon 6 Processors.
