Situation

In The Last Post I Fine-Tuned Muse Glimmer 30B To Call Tools Better, Found It Calling Tools Everywhere, Added Negative Examples, And Picked Checkpoint 200 Out Of The Second Run. It Ended With One Honest Line: I Hadn’t Merged Or Shipped Any Of It.

This Post Is The Shipping Part. The Adapter Was Trained With PEFT On A Single 48GB GPU. The Model Actually Runs On A 32GB Mac Studio, Through MLX, As A 4-Bit Model Behind A Small Shim Service. Those Two Worlds Don’t Share A File Format, And The Mac Doesn’t Have Much Room To Spare.

Continue reading

Situation

My Local Muse Glimmer 30B Kept Leaking Its Own Tool-Calling Markers Into Replies, So I Planned To Fix It At The Source With A QLoRA Fine-Tune Instead Of Patching The Parser Again. Before Training Anything I Ran A Baseline Eval And It Said Leak Rate 0%, Parallel Calls 2%. Both Numbers Looked Wrong, So I Opened The Raw Outputs And Found Every Single One Contained <| Tokens. The Metric Was Broken, Not The Model. I Fixed It, Concluded The Parser Was Already Enough, And Trained Anyway As An Experiment. Version One Made Parallel Tool Calls Work Almost Perfectly And Also Made The Model Call A Tool On Two Thirds Of Questions That Needed None.

Continue reading

Situation

Been Looking At New Models Lately, And Came Across Muse Glimmer, A 30B Model That’s Supposed To Be Really Good For Personal Use. Wanted To See If It Could Replace Gemma-4 As My Log-Summarizer Backend, Plus A Similar Role On My Personal Assistant. LM Studio Was Already Running On This Machine, So I Just Tried Loading It There. It Failed Immediately:

No module named 'mlx_vlm.speculative.drafters.muse_glimmer'

Continue reading