xigh/herbert-rs

Local LLM inference engine written from scratch in Rust — hand-written AVX-512 assembly kernels, Metal & Vulkan compute shaders. Supports Qwen3, Mistral3, ... Q4/INT8/BF16 quantization.

35
Stars
4
Forks
24.3
Radar Score
Stable
Momentum

Scoring Breakdown

Impact16.6
Velocity26.4
Health33.4

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Rust

Why it ranks

Modest but positive momentum.

LLM Frameworks · inference engineTop 92% globally

🛡️ Enterprise Readiness & Commercial Safety

Organic Growth
95%
High Confidence
Growth pattern looks organic.
License
Permissive (Commercial Friendly)
Safe for commercial use, modification, and distribution.
Health Grade
C
Based on maintenance, issue response, and release cadence.
Radar Score
24.3
Composite of Impact, Velocity, and Health.
Disclaimer: This is an automated heuristic assessment based on public GitHub signals. Always perform your own security audit, dependency review, and legal compliance check before production deployment.

Share & Embed

Display live Radar metrics in your documentation, website, or social profiles.

View on GitHub