SECO

devices rockchip

Rockchip RK1828 M.2 AI Card Pushes 70 Tokens per Second for Local LLMs

Rockchip's RK1828 M.2 AI card packs 20 TOPS and 5GB of 3D-stacked DRAM, hitting 70 tok/s on Qwen2.5-7B with four-card cascading support up to 31B models.

Devices Rockchip