Tencent-Hunyuan/Simple-Attention-Sparsification
- Total stars
- 60
- Today
- +0
More actions
Code for our resarch paper "SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking"
Save to My finds to follow releases and star growth. Saved in this browser.
About the project
SAS is a gated sparse-attention mechanism that learns per-query which context blocks to attend to, optimizing context ranking end-to-end with the language modeling loss. The repo provides the paper's training and evaluation code.
Useful for
- Train sparse attention on Qwen3-4B/8B/14B with the OpenR1-Math-220k dataset
- Evaluate the model on MATH, GPQA-Diamond, AIME24/25 and LongBench-E via sglang-blocksparse
- Run BFCL function-calling and VitaBench tool-use benchmarks with sparse attention
README summarized by DeepSeek V4.1 Flash. Details may be inaccurate. Read the original README →
Star growth looks organic. Data as of September 26, 2026, 10:16 UTC.
The star-growth assessment does not verify whether the project is safe to run.
Stars per day
Bars show stars per UTC day; the line is a moving average of available history. Gaps mean missing data, not zero growth. Today's bar is incomplete. Red marks spike days.
Why it’s trending
- The repository is 16 days old and already has 60 stars.
Measured growth: the last 7 completed days
The full 7-day window is unavailable; no weekly total or comparison is calculated.
Daily measurements · UTC
- October 27, 2026
- —
- October 28, 2026
- —
- October 29, 2026
- —
- October 30, 2026
- —
- October 31, 2026
- —
- November 1, 2026
- —
- November 2, 2026
- —
Completed days come from GitHub star history; today and forecasts are excluded from this comparison. History checked: September 21, 2026, 00:18 UTC. Sources and measurement limits →
Three GitHub discoveries in each edition
What they do, why they are gaining interest, and what to check before using them.
Editions at 10:00, 16:00, 22:00 MSK.
Numbers
- Total stars
- 60
- Today
- +0 stars on 2026-09-26 (UTC), ≈ 0 by evening
- Forks
- 1
- Issues and pull requests
- 0
- Watchers
- 0
- Language
- Python
- Created
- September 10, 2026
- Last push
- September 14, 2026
Star trust
Growth looks organic: forks and discussion are in line with active projects, and stars arrive unevenly, the way people give them.
These are heuristics, not a verdict: we judge by the repository’s behavior, not by a list of stargazers.
Spotted in
- September 16, 2026Top new repositories this week: #184
README badge
Paste it into your README — the badge shows the current magnitude and links to this page.
[](https://gitnova.dev/en/r/Tencent-Hunyuan/Simple-Attention-Sparsification)