LocalLLaMA seeks local LLM for medical PDFs

This is a help request, not a product announcement — but it highlights a real and growing use case: privacy-sensitive document processing with local models.

• –4GB VRAM is a tight constraint that rules out most 7B+ models at full precision; quantized models (Q4/Q5 GGUF via llama.cpp) are the practical answer
• –Medical PDF extraction is a compelling local-only use case where data privacy concerns make cloud LLMs a non-starter
• –Tools like Ollama, LM Studio, or llama.cpp with a 3B-4B quantized model (Phi-3 Mini, Gemma 3, Mistral 7B Q4) would fit this hardware profile
• –The question reflects a broader trend of healthcare-adjacent professionals exploring local AI to handle sensitive documents without cloud exposure