Lifan Sun's blog

Lifan Sun's blog, Welcome to my blog.

  • Blog
  • About
  • RSS
  • Search

Reading Notes: LLaMA Technical Report

Apr 28, 2025

Word Embedding Techniques

Apr 22, 2025

Understanding Tokenization Methods

Apr 21, 2025

Rotatry Positional Encoding

Mar 19, 2025

Reading Notes: “FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness”

Mar 8, 2025

Reading Notes: “Efficient Memory Management for Large Language Model Serving with PagedAttention”

Mar 7, 2025

Reading Notes: “Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer”

Mar 2, 2025


© Lifan Sun 2023 - 2025