Situation
In The Last Post I Fine-Tuned Muse Glimmer 30B To Call Tools Better, Found It Calling Tools Everywhere, Added Negative Examples, And Picked Checkpoint 200 Out Of The Second Run. It Ended With One Honest Line: I Hadn’t Merged Or Shipped Any Of It.
This Post Is The Shipping Part. The Adapter Was Trained With PEFT On A Single 48GB GPU. The Model Actually Runs On A 32GB Mac Studio, Through MLX, As A 4-Bit Model Behind A Small Shim Service. Those Two Worlds Don’t Share A File Format, And The Mac Doesn’t Have Much Room To Spare.