Benchmarks show that well-distilled SLMs with 1 billion parameters perform comparably to much larger models on tasks like classification, summarisation and question answering. Compared to ...