Nvidia, in collaboration with memory manufacturers SK hynix, Micron, and Samsung, is working on a new compact and high-performance memory standard called “System On Chip Advanced Memory Module” (SOCAMM). This new technology could offer significant advantages over existing memory modules. Here are the details!
A Breakthrough for AI Computers!
According to South Korean news outlet SEDaily, SOCAMM prototypes are currently undergoing performance testing between Nvidia and memory manufacturers. If everything goes according to plan, mass production could begin by the end of the year.
This new memory standard is expected to be used in future versions of Nvidia’s AI computers from Project Digits, which was announced at CES 2025.
Advantages of SOCAMM Over Traditional DRAM
SOCAMM offers several key advantages compared to traditional DRAM and LPCAMM memory:
- Higher Power Efficiency & Lower Costs: By integrating LPDDR5X memory directly onto the chip, power efficiency will increase while costs decrease.
- Massive Data Bandwidth Increase: Unlike traditional DRAM with 260 I/O ports, SOCAMM features 694 I/O ports, significantly boosting data transfer speeds.
- Compact & Upgradeable: SOCAMM is a removable module, allowing easier upgrades and replacements. Physically, it will be about the size of an adult’s middle finger, making it much smaller than SO-DIMM modules.
Interestingly, Nvidia is not developing SOCAMM in partnership with JEDEC, the organization responsible for memory standards. This suggests that Nvidia aims to shape AI memory architectures on its own.
Since AI models require massive amounts of memory, features like higher I/O connectivity, greater capacity, and modular designs align perfectly with Nvidia’s AI ambitions.
At CES 2025, Nvidia CEO Jensen Huang stated that major steps will be taken to bring AI into the mainstream. With Project Digits AI computers launching in May, future SOCAMM-powered models could become an even more attractive option for buyers.
What are your thoughts on this new memory standard? Share your opinions in the comments!
{{user}} {{datetime}}
{{text}}