Transformer 架构与训练详解
从整体架构、注意力机制到优化器与大规模预训练,系统梳理 Transformer 的组成和训练过程。
A long-term research and learning notebook for posts, notes, papers, projects, and research directions.
Knowledge base
Search the local content index across titles, descriptions, tags, categories, and full text.
9 results
从整体架构、注意力机制到优化器与大规模预训练,系统梳理 Transformer 的组成和训练过程。
A compact note on why the Bellman equation is more than a recurrence: it is a way to organize decisions under uncertainty.
A working definition for connecting perception, temporal prediction, and action in embodied learning systems.
A study note on how finite precision changes the behavior of recursive digital filters.
An early record of how affordance conditioning changes temporal consistency in generated driving scenes.
A research project exploring controllable video generation for rare traffic interactions and safety analysis.
The evolving system behind experiments, paper notes, and research questions in this knowledge base.