AI infrastructure customers are starting to reconsider how much high-bandwidth memory (HBM) needs to be placed alongside accelerators as external memory tiers create new options for storing key-value (KV) cache, according to Astera Labs.
The article requires paid subscription.
Subscribe Now
