Show HN: DeepSeek V3 in ~200 lines of pure Jax
Hacker News 热议:Show HN: DeepSeek V3 in ~200 lines of pure Jax(114 赞 / 7 评论,来源 github.com)
一句话概要
DeepSeek V3 (MLA, DeepSeekMoE, aux-loss-free balancing, MTP) in 190 lines of pure JAX, trained on a MacBook Air. Write-up: vaibhaav.in/writing/deepseek-v3-jax - Vaibhaav-Tiwari/deepseek-v3-jax
原文开头节选
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} main Branches Tags Go to file Code Open more actions menu Latest commit History 4 Commits 4 Commits Folders and files Name Name Last commit message Last commit date post post .gitignore .gitignore LICENSE LICENSE README.md README.md charts.py charts.py deepseek_v3.py deepseek_v3.py plots.py plots.py prepare_data.py prepare_data.py requirements.txt requirements.txt sample.py sample.py smoke_metal.py smoke_metal.py sources.txt sources.txt tests.py tests.py train.py train.py View all files Repository files navigation DeepSeek V3 in pure JAX The architecture from the DeepSeek-V3 technical report in 190 lines of pure JAX , pretrained from scratch on a MacBook Air on public-domain detective fiction.
No Flax, no Equinox, no PyTorch. Params are plain dicts of arrays and every part of the model is a function you can read top to bottom in …
(以上为原文节选,完整内容见下方”原文来源”)
这条动态今日登上 Hacker News 首页(114 赞 / 7 评论,来源 github.com)。技术雷达每日自动聚合 AI 工程、后端架构、DevOps 方向的前沿动态;相关工程落地可浏览下方的相关服务与延伸阅读,或直接与我们团队交流。
原文来源: Hacker News