500AI
← People

Johan Sokrates Wind

Source-listed: University of Oslo

  • Language models
  • Sequence models

Selected work

3
  1. RWKV: Reinventing RNNs for the Transformer EraAuthor · 2023
  2. Icecuber ARC solver / DSL solution to the ARC challengeContributor · 2020
  3. Implicit Regularization Makes Overparameterized Asymmetric Matrix Sensing Robust to PerturbationsContributor · 2025

Source-linked involvement

1
  1. RWKV-7 “Goose” with Expressive Dynamic State EvolutionAuthor · 2025