Once done, you can choose multiple .txt files and open them. All of them will be opened in a separate window. If you cannot find this option even in Windows 11, you must update the Notepad app.

Next time you open Notepad, the previous files will not open; a new window will open. To view your files from previous sessions, ... \windows\notepad.exe c:\windows\system32\notepad.exe.