Mu Language Model is a Small Language Model (SLM) from Microsoft that acts as an AI Agent for Windows Settings. Read this ...

The encoder and decoder are lightweight models. The encoder takes in raw input bytes and creates the patch representations that are fed to the global transformer.