The Tiiny AI supercomputer, making waves in the technology world, stands out with its palm-sized design. This new device is capable of running massive artificial intelligence models natively. The Tiiny AI initiative aims to offer an affordable alternative to expensive hardware like the NVIDIA DGX Spark. Users will now be able to use large language models (LLMs) without needing an internet connection.

What does the Tiiny AI supercomputer offer?

This device, which has just been released, weighs only 300 grams. Its physical dimensions are 14.2 x 8 x 2.53 cm. Despite its small size, the Tiiny AI supercomputer successfully runs models with 120 billion parameters. At its heart is a 12-core ARMv9.2 processor. A dedicated heterogeneous module also accompanies this system.

The device offers approximately 190 TOPS of computational performance for AI operations. The system comes with 80 GB of LPDDR5X RAM and 1 TB of SSD storage. This high memory capacity allows for the application of aggressive quantization techniques. Thus, popular open-source models like Llama, Qwen, and Mistral run smoothly.

The company uses a technique called TurboSparse to boost performance. This method significantly improves inference efficiency. Furthermore, the PowerInfer engine dynamically distributes the workload between the CPU and NPU. The device is expected to be showcased at CES 2026.

So, what are your thoughts on this mini supercomputer? Share your opinions in the comments!