Run BioMistral 7B locally on iPhone, iPad & Mac

Medical · 4.37 GB download · needs 8 GB RAM · Q4_K_M GGUF

Fine-tuned on PubMed. General health & biomedical Q&A. 8 GB+.

In privateSLM, BioMistral 7B is reading and questioning medical literature (informational only — not a substitute for professional medical advice). You download the model once, and from then on every conversation runs entirely on your device — no cloud, no account, no tracking, and it keeps working with the radio off.

At a glance

ModelBioMistral 7B
CategoryMedical
Download size4.37 GB (one time)
QuantizationQ4_K_M (GGUF)
Minimum device RAM8 GB
Runs offlineYes — fully on-device after download
SourceHugging Face

Will it run on my device?

BioMistral 7B needs a device with at least 8 GB of RAM — that means iPhone 16 Pro and later, M-series iPad Pro / Air, and any Apple Silicon Mac. The privateSLM catalog states the RAM requirement for every model up front, so you know before you download.

How to run BioMistral 7B in privateSLM

  1. Get privateSLM on the App Store — one-time purchase, no subscription.
  2. Open Models, pick BioMistral 7B, and tap Download (4.37 GB, once).
  3. Select it as your active model and chat — airplane mode included.

On iPhones, iPads and Macs with Apple Intelligence, privateSLM can also answer instantly with the built-in system model — zero downloads. A catalog model like BioMistral 7B is for when you want this particular specialist, offline, under your control.

Related models

FAQ

Does BioMistral 7B run offline on iPhone?

Yes. After a one-time 4.37 GB download inside privateSLM, BioMistral 7B runs entirely on-device via llama.cpp. Airplane mode works — nothing is ever sent to a server.

How much RAM does BioMistral 7B need?

A device with at least 8 GB of RAM — in practice iPhone 16 Pro and later, M-series iPad Pro / Air, and any Apple Silicon Mac.

Is BioMistral 7B free to use in privateSLM?

The model itself is open-weights (Q4_K_M GGUF) and the download is free. privateSLM is a one-time purchase — no subscription, no per-message fees.