|
| | 笔记本跑7000亿参数GLM：无GPU也行？ | | | 量子位 ｜ 2026-09-26 | | | |
| 声明： 本消息或因风格和篇幅原因进行过编辑，但未经核实，也不代表我们的立场、观点或建议。如有侵权，联系秒删。[ 使用条款 ] |
scroll 0 1 25GB笔记本硬跑744B GLM-5.2，32GB内存挑战2.8T Kimi K3——甚至都不用GPU。
GitHub现在最火热的大模型开源小蜂鸟Colibrì，纯C实现、零引擎依赖的分层推理框架，已经狂揽32k Star。
 | 点
击
图
片
看
原
图 |
它最早是冲着GLM-5.2来的。
正常情况下，744B的总参数规模已经让普通消费级电脑望而却步，但Colibrì的办法可以说是相当简单粗暴：
内存装不下，那就别全装进去。
模型里暂时用不到的部分，直接扔在SSD里；等推理真的需要哪个专家，再现场从硬盘把它捞出来。
于是，GLM-5.2经过int4处理后大约372GB的权重，可以在最低16GB、推荐24GB左右RAM的机器上运行，GPU甚至不是必需品。
作者最初验证它的开发机，也只有12核CPU+25GB RAM。
 | 点
击
图
片
看
原
图 |
现在，Colibrì已经不满足于744B了。
0 | | | |
0
8
ii
1
0
0
|
0
https://gears.popyard.space
https://www.popyard.space/img/logo_0.jpg
https://www.popyard.space
https://news.popyard.space
https://newsx.popyard.space
https://cn.popyard.space
https://plus.popyard.space
https://studio.popyard.space
https://studio.popyard.space
https://channel.popyard.space
https://adserver.popyard.space
news
八阕
新 闻
3
news-scroll
笔记本跑7000亿参数GLM：无GPU也行？
16
2345349
2345349
0
8
0
量子位
2026-09-26
https://bbs.popyard.space
https://img5.angelyun.com/2026/8_26/73_74.jpg
desktop
google
google
underdog
0
0
normal
{ "object_name":"related_list","lan_0":"cn","sub_0":"Anthropic 撒钱：白送250（组图）","sid_0":"16","rid_0":"2344602","gfw_0":"0","subject_0":"Anthropic 撒钱：白送250（组图）","lan_1":"cn","sub_1":"阿莫迪偷师姚顺雨，奥特曼偷师梁文锋（组图）","sid_1":"16","rid_1":"2345084","gfw_1":"0","subject_1":"阿莫迪偷师姚顺雨，奥特曼偷师梁文锋（组图）","lan_2":"cn","sub_2":"AI基础设施撞上“墙”（组图）","sid_2":"16","rid_2":"2345214","gfw_2":"0","subject_2":"AI基础设施撞上“墙”（组图）","lan_3":"cn","sub_3":"谷歌TPU跑Kimi：比英伟达GPU快57%（组图）","sid_3":"16","rid_3":"2345341","gfw_3":"0","subject_3":"谷歌TPU跑Kimi：比英伟达GPU快57%（组图）","total":4 }
{ "json":"done-news-scroll-related-show","lan_0":"cn","sid_0":"16","rid_0":"2344602","src_0":"新智元","sub_0":"Anthropic 撒钱：白送250","dat_0":"2026-09-25","sex_0":0,"gfw_0":0,"pic_0":"https://img5.angelyun.com/2026/8_25/oid338473_0.jpeg","lan_1":"cn","sid_1":"16","rid_1":"2344602","src_1":"新智元","sub_1":"Anthropic 撒钱：白送250","dat_1":"2026-09-25","sex_1":0,"gfw_1":0,"pic_1":"https://img5.angelyun.com/2026/8_25/oid338473_1.jpeg","lan_2":"cn","sid_2":"16","rid_2":"2344602","src_2":"新智元","sub_2":"Anthropic 撒钱：白送250","dat_2":"2026-09-25","sex_2":0,"gfw_2":0,"pic_2":"https://img5.angelyun.com/2026/8_25/oid338473_2.jpeg","lan_3":"cn","sid_3":"16","rid_3":"2344602","src_3":"新智元","sub_3":"Anthropic 撒钱：白送250","dat_3":"2026-09-25","sex_3":0,"gfw_3":0,"pic_3":"https://img5.angelyun.com/2026/8_25/oid338473_3.jpeg","lan_4":"cn","sid_4":"16","rid_4":"2344602","src_4":"新智元","sub_4":"Anthropic 撒钱：白送250","dat_4":"2026-09-25","sex_4":0,"gfw_4":0,"pic_4":"https://img5.angelyun.com/2026/8_25/oid338473_4.jpeg","lan_5":"cn","sid_5":"16","rid_5":"2344602","src_5":"新智元","sub_5":"Anthropic 撒钱：白送250","dat_5":"2026-09-25","sex_5":0,"gfw_5":0,"pic_5":"https://img5.angelyun.com/2026/8_25/oid338473_5.jpeg","lan_6":"cn","sid_6":"16","rid_6":"2344602","src_6":"新智元","sub_6":"Anthropic 撒钱：白送250","dat_6":"2026-09-25","sex_6":0,"gfw_6":0,"pic_6":"https://img5.angelyun.com/2026/8_25/oid338473_6.jpeg","lan_7":"cn","sid_7":"16","rid_7":"2344602","src_7":"新智元","sub_7":"Anthropic 撒钱：白送250","dat_7":"2026-09-25","sex_7":0,"gfw_7":0,"pic_7":"https://img5.angelyun.com/2026/8_25/oid338473_7.jpeg","lan_8":"cn","sid_8":"16","rid_8":"2344602","src_8":"新智元","sub_8":"Anthropic 撒钱：白送250","dat_8":"2026-09-25","sex_8":0,"gfw_8":0,"pic_8":"https://img5.angelyun.com/2026/8_25/oid338473_8.jpeg","lan_9":"cn","sid_9":"16","rid_9":"2345084","src_9":"字母AI","sub_9":"阿莫迪偷师姚顺雨，奥特曼偷师梁文锋","dat_9":"2026-09-26","sex_9":0,"gfw_9":0,"pic_9":"https://img5.angelyun.com/2026/8_26/oid338826_0.jpeg","lan_10":"cn","sid_10":"16","rid_10":"2345084","src_10":"字母AI","sub_10":"阿莫迪偷师姚顺雨，奥特曼偷师梁文锋","dat_10":"2026-09-26","sex_10":0,"gfw_10":0,"pic_10":"https://img5.angelyun.com/2026/8_26/oid338826_1.jpeg","lan_11":"cn","sid_11":"16","rid_11":"2345084","src_11":"字母AI","sub_11":"阿莫迪偷师姚顺雨，奥特曼偷师梁文锋","dat_11":"2026-09-26","sex_11":0,"gfw_11":0,"pic_11":"https://img5.angelyun.com/2026/8_26/oid338826_2.jpeg","lan_12":"cn","sid_12":"16","rid_12":"2345214","src_12":"华尔街日报","sub_12":"AI基础设施撞上“墙”","dat_12":"2026-09-26","sex_12":0,"gfw_12":0,"pic_12":"https://img5.angelyun.com/2026/8_26/oid338904_0.jpeg","lan_13":"cn","sid_13":"16","rid_13":"2345214","src_13":"华尔街日报","sub_13":"AI基础设施撞上“墙”","dat_13":"2026-09-26","sex_13":0,"gfw_13":0,"pic_13":"https://img5.angelyun.com/2026/8_26/oid338904_1.jpeg","lan_14":"cn","sid_14":"16","rid_14":"2345341","src_14":"量子位","sub_14":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_14":"2026-09-26","sex_14":0,"gfw_14":0,"pic_14":"https://img5.angelyun.com/2026/8_26/oid338956_0.jpeg","lan_15":"cn","sid_15":"16","rid_15":"2345341","src_15":"量子位","sub_15":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_15":"2026-09-26","sex_15":0,"gfw_15":0,"pic_15":"https://img5.angelyun.com/2026/8_26/oid338956_1.jpeg","lan_16":"cn","sid_16":"16","rid_16":"2345341","src_16":"量子位","sub_16":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_16":"2026-09-26","sex_16":0,"gfw_16":0,"pic_16":"https://img5.angelyun.com/2026/8_26/oid338956_2.jpeg","lan_17":"cn","sid_17":"16","rid_17":"2345341","src_17":"量子位","sub_17":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_17":"2026-09-26","sex_17":0,"gfw_17":0,"pic_17":"https://img5.angelyun.com/2026/8_26/oid338956_3.jpeg","lan_18":"cn","sid_18":"16","rid_18":"2345341","src_18":"量子位","sub_18":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_18":"2026-09-26","sex_18":0,"gfw_18":0,"pic_18":"https://img5.angelyun.com/2026/8_26/oid338956_4.jpeg","lan_19":"cn","sid_19":"16","rid_19":"2345341","src_19":"量子位","sub_19":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_19":"2026-09-26","sex_19":0,"gfw_19":0,"pic_19":"https://img5.angelyun.com/2026/8_26/oid338956_5.jpeg","lan_20":"cn","sid_20":"16","rid_20":"2345341","src_20":"量子位","sub_20":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_20":"2026-09-26","sex_20":0,"gfw_20":0,"pic_20":"https://img5.angelyun.com/2026/8_26/oid338956_6.jpeg","lan_21":"cn","sid_21":"16","rid_21":"2345341","src_21":"量子位","sub_21":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_21":"2026-09-26","sex_21":0,"gfw_21":0,"pic_21":"https://img5.angelyun.com/2026/8_26/oid338956_7.jpeg","lan_22":"cn","sid_22":"16","rid_22":"2345341","src_22":"量子位","sub_22":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_22":"2026-09-26","sex_22":0,"gfw_22":0,"pic_22":"https://img5.angelyun.com/2026/8_26/oid338956_8.jpeg","lan_23":"cn","sid_23":"16","rid_23":"2345341","src_23":"量子位","sub_23":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_23":"2026-09-26","sex_23":0,"gfw_23":0,"pic_23":"https://img5.angelyun.com/2026/8_26/oid338956_9.jpeg","lan_24":"cn","sid_24":"16","rid_24":"2345341","src_24":"量子位","sub_24":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_24":"2026-09-26","sex_24":0,"gfw_24":0,"pic_24":"https://img5.angelyun.com/2026/8_26/oid338956_10.jpeg","lan_25":"cn","sid_25":"16","rid_25":"2345341","src_25":"量子位","sub_25":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_25":"2026-09-26","sex_25":0,"gfw_25":0,"pic_25":"https://img5.angelyun.com/2026/8_26/oid338956_11.jpeg","lan_26":"cn","sid_26":"16","rid_26":"2345341","src_26":"量子位","sub_26":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_26":"2026-09-26","sex_26":0,"gfw_26":0,"pic_26":"https://img5.angelyun.com/2026/8_26/oid338956_12.jpeg","lan_27":"cn","sid_27":"16","rid_27":"2345341","src_27":"量子位","sub_27":"谷歌TPU跑Kimi：比英伟达GPU快57%","dat_27":"2026-09-26","sex_27":0,"gfw_27":0,"pic_27":"https://img5.angelyun.com/2026/8_26/oid338956_13.jpeg","total":28,"action":"fetch" }
点击朱笔，直抒胸臆