Streaming Session Output
SSE REAL-TIME TELEMETRY
Live HTTP Range (206) GGUF v3 Binary Header & Tensor Parser
IDLE
GGUF Architecture Metadata KV Pairs
| Metadata Key | Parsed Binary Value |
|---|
Embedded Jinja Chat Template (tokenizer.chat_template)
Tensor Graph Layout Explorer
| # | Tensor Name | Quant | Dimensions | Data Offset |
|---|
Memory Budget & Generated Launch Commands
● RESIDENT FIT
ESTIMATED RESIDENT FOOTPRINT
88.96GiB / 96 GiB
1. Download Selected GGUF Checkpoints
2. Build & Serve with DwarfStar (antirez/ds4 or huihui-support/ds4 TP/UDS)
3. Alternative: Fringe210/llama.cpp-deepseek-v4-flash-cuda