Remote GPU Access: llama.cpp Inference
Run llama.cpp inference from a Linux guest using STRATUM remote GPU access and guest tools.
WALKTHROUGH 14 / 28
SEE IT IN ACTION.
Install the Linux guest tools and demonstrate STRATUM synthetic PCI-to-GPU access across the network, loading a model and running llama.cpp inference without a local physical GPU.