When serving multiple users (batch size 4) on the same GPU, how does the memory usage differ from a single user?

Question

MLQuiz · Accepted Answer

The text explains: 'Model Weights: 14 GB (SHARED – loaded once) ... KV Cache User A/B/C/D: 800 MB each'. Only KV cache multiplies with user count.