AMD has officially unveiled its next-generation open source ROCm 6.3 software platform. Developed specifically for use in artificial intelligence (AI), machine learning (ML) and high-performance computing (HPC), the platform is optimized for AMD’s Instinct GPUs. The company says the new software offers significant improvements in speed and efficiency. So, what is the purpose of the software? Who does it appeal to? Details are in our news…
What does AMD’s ROCm 6.3 software platform do?
First of all, the ROCm 6.3 software platform will accelerate the pace of AI and scientific computing. The SGLang tool introduced with the new software is specifically designed for large language models (LLMs) and visual language models (VLMs). In other words, it offers up to 6 times faster performance during the training and inference of these models, significantly reducing processing times.
FlashAttention-2 technology, which is used in the training processes of artificial intelligence models, provides a significant advantage in deep learning projects by increasing performance by 3 times. ROCm 6.3 also offers multi-node support for complex calculations such as Fourier transforms, which are frequently used in scientific research, and will significantly lighten the workload in projects requiring big data analysis.
Meanwhile, AMD’s decision to offer ROCm 6.3 as an open-source platform has also aroused great interest in the industry. Because it is open source, developers will be able to easily use this software and integrate it into their projects. It is also worth noting that the ROCm 6.3 platform is designed to be compatible with Python, a popular programming language.
In fact, AMD’s goal with ROCm 6.3 is clear: to create a leading software platform for artificial intelligence and scientific research. The company expects the software to be widely used both in the academic world and in industrial projects.
Do you think this software can really make a big difference in the technology sector? Let us know in the comments section below.