SK hynix Inc. (or "the company", www.skhynix.com) announced today that it has begun mass production of the 192GB SOCAMM2, a next-generation memory module standard based on the 1cnm process (sixth-generation of the 10-nanometer technology) LPDDR5X low-power DRAM.
SOCAMM2 is a module that adapts low-power memory – which was previously used mainly in mobile products like smartphones – for server environments. It is designed to be a primary memory solution for next-generation AI servers.
SK hynix emphasized that the 1cnm based SOCAMM2 product that is now in mass production delivers more than double the bandwidth with over 75% improved power efficiency compared to conventional RDIMM, providing an optimized solution for high performance AI operations.
In particular, the company noted that its SOCAMM2 products are designed for NVIDIA Vera Rubin platform.
SK hynix expects the new SOCAMM2 product will fundamentally resolve the memory bottlenecks encountered during the training and inference of large language model (LLM) with hundreds of billions of parameters, thereby playing a pivotal role in dramatically accelerating the processing speed of the overall system.
The company stated that with the AI market shifting focus from inference to training, SOCAMM2 is gaining significant attention as a next-generation memory solution capable of operating LLMs with low power consumption. To meet the demands of its global Cloud Service Provider (CSP) customers, SK hynix has not only been providing a supply portfolio, but also stabilized its mass production system early on.
"By supplying the 192GB SOCAMM2, SK hynix has established a new standard for AI memory performance" Justin Kim, President & Head of AI Infra (CMO, Chief Marketing Officer) at SK hynix said. "We will solidify our position as the most trusted AI memory solution provider, through close collaboration with our global AI customers."
SK hynix 192GB SOCAMM2, high-bandwidth and power-efficient. Credit: SK hynix