If not, you can access it from the Start menu. You'll find the File Explorer icon by default in the Pinned section of the Start menu. You can click the app icon to open a new File Explorer window.
Here is how to show or hide the file icon overlay on thumbnails in Windows 11 or Windows 10 computers. You can enable or disable file icons on thumbnails in Windows ...