Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia
25 points by Maverick617 2 hours ago | 2 comments
PcChip 53 minutes ago
I didn't see any benchmarks against vllm, sglang, exllama, etc
replyrancor 44 minutes ago
Since this is basically a wrapper around libllama.so, I would assume that the performance is roughly the same as llama.cpp upstream.
reply