Show HN：我做了一个微型 MoE/Engram 可视化工具

事件

As part of a ML study group I've been building tools to experiment with ML concepts. I use AI Coding agents to develop software, mostly cloud-based but I keep trying local LLMs on 12G, 16G, and 24G VRAM GPUs. Freetoken has made it possible to run larger MoE models on smaller GPUs. This inspired me to use my ML tools to build a tiny MoE model from scratch so I can experiment with different agent optimizations and things like Engram, recursive models, hierarchical modeles, KV Cache compression etc. My link above shows results of building different tiny models, one dense, the rest MoE variants. There is a lot of code and tooling behind this. Goals: - build tiny MoE models that run in a browser to give interactive help (today I use deterministic matchers to respond to user queries; still researching how to improve this with better trained MoE models). - build tiny MoE models that run on small ARM and RISC-V development boards, possibly using NPUs (using no_std Rust). My tools are an alternative to Python, ML libraries, Jupyter notebooks, and Google Colab. My approach is a REPL and/or AOT Compilable array-programming DSL written in Rust. This language has ML concepts as first class language elements and built in visualization primitives. It runs in a browser via WASM. It runs at the CLI on both Apple and Linux (supporting Apple GPU and NVIDIA GPU libraries, Ollama-based REPL context-senstive help). It is extensible via dyamic plug-in Rust libraries. I have created many d

来源

本条目由采集管线自动抓取并发布，完整内容见下方来源链接。

*采集源：Hacker News*