500AI
Search

Guangyu Song

  • RWKV: Reinventing RNNs for the Transformer Era
  • Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
  • GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
  • RWKV-7 "Goose" with Expressive Dynamic State Evolution
  • RWKV (project)

All names