As uncovered by PhantomOfEarth in a beta build of Windows 11 (22635), there's going to be an option to have the taskbar icons made smaller - but this is hidden in the preview right now.