07:43
Tencent releases Simple Attention Sparsification on Hugging Face
Tencent published the Simple-Attention-Sparsification model on Hugging Face. It is a text-generation model built on qwen3 with sparse attention for long context, trained on OpenR1-Math-220k.
1 official