Hi, I'm Jiaqi Cao. Call me Max.
Pre-train Researcher @ IQuest
prev. @ NBG Lab & Shanghai AI Lab
Research interests
- Sparsity Scaling: Exploring next-gen model architectures to open new axes for sparsity scaling [Memory Decoder].
- Continual Learning: Exploring context-to-weight mechanisms that enable continual learning [MLP Memory].
- Self-Evolve Agent: With new designs from sparsity scaling & continual learning, build agent that memorizes and evolves.