StandardsAboutContact
The Weights
Granite Switch 4.1 Bundles Chat, Decisions and Speech

Granite Switch 4.1 Bundles Chat, Decisions and Speech

IBM puts chat, probabilistic decisions, a safety guardian and speech-to-text in one Apache 2.0 checkpoint. The launch post shows no benchmark scores.

Granite Switch 4.1 is a useful consolidation, not a safety upgrade: IBM folds chat, a Decision aLoRA, a Guardian aLoRA and English speech-to-text into one Apache 2.0 checkpoint, served from one endpoint. The model card warns the guardian is no substitute for application-level safety testing, and the launch post gives no scores.

The Weights Desk · 4 min read

IBM released Granite Switch 4.1 on October 15, 2026, according to its Hugging Face launch post. It is a single checkpoint, in 8B and 30B sizes, that answers chat requests, returns probabilistic decisions, runs a safety guardian and transcribes audio. The engineering idea is sound and the license is permissive. The performance claims, though, arrive without numbers, and the model card is more cautious than the launch post.

What is actually in the checkpoint

The 8B model card describes a Granite 4.1 8B base, a Decision adapter, a Guardian Core adapter and a 470M-parameter English-only speech encoder, joined by a switch layer that routes token spans by control token. The card lists a 131,072-token context and an Apache 2.0 license. Hub metadata shows 9B parameters, while the card describes the base as 8B.

How requests are routed

Callers choose a behavior per request. Per the card, chat is the default, while passing adapter_name through chat_template_kwargs selects decision or guardian-core. Audio goes in as a base64 WAV input_audio part, and the transcript replaces it in context. The launch post adds that the adapters are activated LoRAs, so KV cache from a base generation can be reused for later decisions.

Decisions are probabilities, not verdicts

The Decision adapter is read by requesting logprobs on single-token option labels and applying a softmax. The card notes vLLM caps logprob_token_ids at 128 per request, so large option sets need chunking. It also advises treating the output as a prior rather than a certified classification, especially outside trained domains. That caveat matters for any workflow that gates actions on these scores.

The performance claims are unquantified

The launch post says the guardian outperforms several named decision models on average and calls the speech component the fastest on the OpenASR Leaderboard, but gives no scores for either. A Doom demo reports 60 to 100 decisions per second on a 3B custom build, in a footnoted comparison the post itself does not standardize. We have not reproduced any of this, so treat it as vendor claims.

Where the safety story stops

The model card says the guardian adapter is not a substitute for application-level safety testing. It also omits the factuality-detection, factuality-correction and policy-guardrails adapters, and the model inherits the safety profile of base Granite 4.1. Speech is not jointly trained with the LLM, and transcription errors can change downstream responses. A red team should test the audio path as an input channel.

Verdict

Signal, with conditions. One Apache 2.0 checkpoint that handles chat, scored decisions, guardian checks and transcription simplifies serving, and the KV-cache reuse is a plausible latency win. Before adopting it, benchmark the guardian and ASR on your own traffic, including adversarial audio and jailbreak prompts, because the public evidence offers claims but no scores. Watch for IBM's promised Adapter SDK and for independent measurements.

What is Granite Switch 4.1?
It is a family of IBM Granite models, in 8B and 30B sizes, that bundle a base chat model, a Decision adapter, a Guardian adapter and a speech-to-text encoder in one checkpoint. A switch layer routes token spans to the right component.
Is it licensed for commercial use?
The 8B model card lists Apache 2.0. The launch post does not state a license, so check the card for the specific checkpoint you deploy.
Does the Guardian adapter replace safety testing?
No. The model card says the guardian adapter is not a substitute for application-level safety testing. It also omits the factuality-detection, factuality-correction and policy-guardrails adapters.
Are the speed and quality claims verified?
Not by us. The launch post claims the guardian beats several named decision models and that the speech component is the fastest on the OpenASR Leaderboard. It gives no figures, so these are unverified vendor claims.
  1. Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint — Hugging Face
  2. Granite Switch 4.1 8B model card — IBM Granite on Hugging Face