If you press the key combination Alt-Shift-Esc or right-click an empty area in the taskbar, you can launch the Task Manager ...

As uncovered by PhantomOfEarth in a beta build of Windows 11 (22635), there's going to be an option to have the taskbar icons made smaller - but this is hidden in the preview right now.