Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
java gpu nvidia compilers granite mistral accelerators tornadovm llm java21 gguf mistral-7b llama3 phi-3 phi-3-mini ibm-granite qwen2-5 deepseek-r1 qwen3 qwen3-8
-
Updated
Oct 20, 2026 - Java