AI Infrastructure Fleet Management Made Easy with COSMOS 

AI infrastructure demands large server deployments in hyperscale data centers to meet requirements for compute power, efficiency, and total cost of ownership (TCO). However, managing such a large fleet of systems presents complex challenges of observability, data collection, and fault isolation.

COnnectivity System Management and Optimization Software – or COSMOS – is a key component of Astera Labs’ Intelligent Connectivity Platform. It enables management and optimization of resources for large fleets at cloud-scale via link, fleet, and RAS management capabilities.

COSMOS Monitors and Manages a System or Fleet

COSMOS Highlights

  • Operates in on-chip microcontrollers and systems baseboard/system management controllers
  • Provides link management, fleet management and reliability/availability/serviceability (RAS) features across the entire product portfolio
  • Delivers enhanced diagnostics and telemetry features with in-band and out-of-band management
  • Monitors the state and health of a systems’ critical data links, such as link rate, link stability, error rate, receiver margins, and more
  • Offers enhanced security features enabling device updates and configurations in a secure manner
  • Available as a C-SDK, Python-SDK and Reference Applications (or Platform Utilities)

Request the White Paper

Cloud Infrastructure Fleet Management Made Easy with COSMOS

Download

Building the Case for UALink™: A Dedicated Scale-Up Memory Semantic Fabric

Understanding the LandscapeAs AI models continue to rapidly evolve and drive a need for higher FLOPs and larger memory footprints, AI clusters will need to continue to grow to keep up. As the AI clusters rapidly scale in size from 25,000 GPUs per cluster[1] to 100,000 GPUs to 200,000 GPUs[2], not only is there a need to provide the connectivity between the GPUs in these clusters, but…

Read more

Driving AI and Cloud Innovation: How Astera Labs is Expanding its Market Opportunity

The year 2024 has been extremely exciting for Astera Labs with multiple big milestones including a successful IPO in March and the expansion of our Intelligent Connectivity Platform with the introduction of our Scorpio Smart Fabric Switch family. The company continues to scale aggressively with the goal of becoming the premier provider of purpose-built connectivity solutions into the AI and…

Read more

Overcome Next-Gen AI Infrastructure Challenges with Scorpio Smart Fabric Switches

In today’s rapidly evolving AI landscape, hyperscale data centers are under immense pressure to keep up with the processing demands for AI data flows that power Generative AI applications. AI models are moving at rapid pace and scale with four major LLMs on track for release in Q4, 2024 while models, such as Gemini 1.5 Pro-002, are weighing in at 1.5 trillion parameters with others to follow…

Read more

Astera Labs Announces Financial Results for the Third Quarter of Fiscal Year 2024

Record quarterly revenue of $113.1 million, up 47% QoQ and up 206% YoY Expanding market opportunities with new Scorpio Fabric Switches, driving higher dollar content in AI platformsSANTA CLARA, CA, U.S. – November 4, 2024 – Astera Labs, Inc. (Nasdaq: ALAB), a global leader in semiconductor-based connectivity solutions for cloud and AI infrastructure, today announced preliminary…

Read more

Astera Labs Introduces New Portfolio of Fabric Switches Purpose-Built for AI Infrastructure at Cloud-Scale

Shipping in pre-production quantities, Scorpio Smart Fabric Switches deliver maximum system utilization and uptime for scale-out PCIe 6 connectivity and scale-up GPU clustering in AI serversSANTA CLARA, CA, U.S. – October 8, 2024 – Astera Labs, Inc. (Nasdaq: ALAB), a global leader in semiconductor-based connectivity solutions for AI and cloud infrastructure, today announced a new…

Read more

Astera Labs Announces Conference Call to Review Third Quarter 2024 Financial Results

SANTA CLARA, CA, U.S. – Oct. 2, 2024 – Astera Labs, Inc. (Nasdaq: ALAB), a global leader in semiconductor-based connectivity solutions for AI and cloud infrastructure, today announced that it will release its financial results for the third quarter 2024 after the close of market on Monday, Nov. 4, 2024. Astera Labs will host a corresponding conference call at 1:30 p.m. Pacific…

Read more

Astera Labs Opens New R&D Hub in Bengaluru to Drive AI and Cloud Innovation

Dr. Shivananda Koteshwar to lead the company’s India operations and spearhead development of innovative connectivity solutions for AI and cloud infrastructureSANTA CLARA, CA, U.S. – September 11, 2024 – Astera Labs, Inc. (Nasdaq: ALAB), a global leader in semiconductor-based connectivity solutions for AI and cloud infrastructure, today announced the official opening of its…

Read more

PCIe Cabling Demo at OCP 2024

At OCP Global Summit 2024, Astera Labs demonstrated its full portfolio of PCIe cabling solutions. The live demos included Aries PCIe/CXL Smart Cable Modules with Active Electrical Cables and Active Optical Cables to deliver extended reach for rack-to-rack and row-to-row configurations.

Read more

CXL Demo for DLRM at OCP Summit 2024

At OCP Global Summit, Astera Labs demonstrated the performance benefits of CXL memory for Deep Learning Recommendation Models (DLRM). The demo featured a 5th Gen AMD EPYC processor, DDR5 memory from Samsung, and four Leo CXL Smart Memory Controllers. The demo showed that by doubling memory capacity and bandwidth in the system, there is about a 70% increase in performance for DLRM.

Read more

End-to-End PCIe 6 Live Demo at OCP Summit 2024

At OCP Global Summit 2024, Astera Labs showcased the industry’s first end-to-end PCIe 6 demo, featuring the Scorpio Smart Fabric Switch. The Scorpio P-Series Fabric Switch was linked live at PCIe 6 64Gtps speeds with Gen 6 Exerciser from Keysight. In addition, see how COSMOS software suite delivers deep diagnostics and telemetry. 

Read more