A long-term research and learning notebook for posts, notes, papers, projects, and research directions.

Theme

#Transformer

Entries connected by a shared research or learning theme.

Deep LearningAug 27, 202618 min read

Transformer 架构与训练详解

从整体架构、注意力机制到优化器与大规模预训练，系统梳理 Transformer 的组成和训练过程。

Autonomous DrivingSep 3, 202613 min read

NeuralNDE：用 Transformer 行为模型 + Conflict Critic + Safety Mapping + 对抗训练，生成统计意义上逼近真实世界的自然驾驶环境，包括 crash 与 near-miss 等长尾安全关键事件。