microsoft/LLMLingua

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

6.8k
Stars
452
Forks
68.4
Radar Score
Rising
Momentum

Scoring Breakdown

Impact86.4
Velocity51.7
Health63.0

Growth Metrics

7-Day Stars
+16
30-Day Stars
+72
Acceleration
0.95x
Language
Python

Why it ranks

Strong momentum — adoption is accelerating week over week.

LLM Frameworks · inference engineTop 85% globallyLast push 2d ago+16 stars / 7d+72 stars / 30d

Popular Alternatives & Competitors

Top projects in the same category (LLM Frameworks) — compare side by side.

ZhuLinsen/daily_stock_analysis
Python★ 70.8kVel: 8583.2
kingcharleslzy-ai/dsh-purge
JavaScript★ 7.2kVel: 8981.3
career-ops-hq/career-ops
JavaScript★ 82.1kVel: 7380.9
ggml-org/llama.cpp
C++★ 134.2kVel: 7080.2
Compare All Side-by-Side →

🛡️ Enterprise Readiness & Commercial Safety

Organic Growth
92%
High Confidence
License
Permissive (Commercial Friendly)
Safe for commercial use, modification, and distribution.
Health Grade
A
Based on maintenance, issue response, and release cadence.
Radar Score
68.4
Composite of Impact, Velocity, and Health.
Disclaimer: This is an automated heuristic assessment based on public GitHub signals. Always perform your own security audit, dependency review, and legal compliance check before production deployment.

Share & Embed

Display live Radar metrics in your documentation, website, or social profiles.

View on GitHub