StandardsAboutContact
The Weights
Palette: IBM's Self-Hosted 20B Deck Model, Teardown

Palette: IBM's Self-Hosted 20B Deck Model, Teardown

IBM Research's Palette places second on a slide-generation benchmark mean, but it has no public weights or paper. Wait before you plan around it.

Bottom line: Wait. Palette, an IBM Research slide-deck system built on a self-hostable 20B open-weight model, scored 59.7 on the PresentBench three-domain mean against NotebookLM's 60.8. The result is close, but the weights, code and paper are not linked, and the evaluation still needs a frontier model to draft plans.

The Weights Desk · 4 min read

Bottom line: Wait. IBM Research's Palette, described in a Hugging Face post, generates slide decks in a chosen design language with a 20B open-weight model that an organization can host itself. On PresentBench it ranks second on the three-domain mean, 59.7 against NotebookLM's 60.8. The result is promising, but the post links no weights, code or paper, so nobody outside IBM can reproduce it yet.

How Palette builds a deck

Palette splits deck building into two roles served by one LoRA adapter, according to IBM Research. The designer reads a plan and writes a structured JSON brief covering palette, type system and per-slide layout. The coder then writes pptxgenjs JavaScript for each slide. Because the brief fixes every slide's context, coder calls run in parallel, which IBM says makes the coding stage about 6-7 times faster.

The training data is synthetic and small

The training set is about 1,000 decks, roughly 10,000 slides, generated by an unnamed large open teacher model because no public corpus existed. Designs follow the IBM Design Language, and each example includes counterfactual reasoning explaining a rejected alternative. IBM says reference decks, not prompt rules, curbed invented facts, because the teacher copied examples more than it followed instructions.

The repair harness is the most reusable idea

Palette renders each slide and measures overlap, clipping and overflow with a geometry checker. Flagged slides go to a separate editor model, and the rewrite is kept only if the checker confirms improvement. IBM reports this adds 3.5 points on average across 131 PresentBench decks. The keep-only-if-better rule makes automated repair safe by default and transfers to other generation tasks.

What the benchmark does and does not show

Palette placed first in Economics and Education and third in Talk, where two closed systems scored higher, per the post. PresentBench scores fundamentals, visual design, completeness, correctness and fidelity. The authors concede it does not measure adherence to a specific design language, so the central claim is untested. Per-domain scores are not given, and plan drafting relied on a frontier model.

Open gaps before anyone depends on it

Three gaps stand out. Faithfulness was the hardest failure, yet the post reports no measured rate of invented facts after the fix. Figure-heavy decks remain a known weakness, with figure extraction only planned. And the post links no weights, code or paper, so the results are a vendor-side report rather than something a reader can rerun and argue with.

The bottom line: Wait

Bottom line: Wait. The deciding number is 59.7 versus 60.8, a near-tie with a closed product, reported by the builder, without released artifacts. Revisit when weights and a reproducible harness appear, and when someone measures design-language adherence and fact fidelity directly. Teams with confidential decks and a house style should watch it, since the self-hosting rationale is sound.

Should enterprises adopt Palette now?
Wait. The post reports a 59.7 PresentBench mean, 1.1 points behind NotebookLM, but links no model weights, code repository or paper. The plan-drafting step also uses a frontier model, so the pipeline is not fully self-contained.
How does Palette generate a deck?
One LoRA adapter on a 20B open-weight model acts first as designer, writing a JSON brief with palette, type system and per-slide layout. It then acts as coder, writing pptxgenjs JavaScript for each slide. A checker renders slides and flags overlap, clipping and overflow.
Does the benchmark prove it follows a design language?
No. IBM's authors state that PresentBench does not measure adherence to a specific design language and that they know of no benchmark that does. The score reflects general deck quality, not brand fidelity.
  1. Palette: teaching a small model to build decks in your design language — Hugging Face (IBM Research)
  2. PresentBench dataset card — Hugging Face (PresentBench)