The Local LLM Index / Quantization & Formats / #239
abman23/on-device-ai-comm
by abman23 · Quantization & Formats · updated 2y ago
On-device AI/LLM comm system | Pre-trained LLM integrated with 5G-NR PHY | Fine-tuned BART on noisy 3GPP CDL channels | 50 % compression via quantization | Evaluated with NVIDIA Sionna LLS
16
momentum
24
stars
3
forks
#239
rank