Yes, you are absolutely right, using a board with several real hardware serial ports is the obvious solution. That obvious solution is named “Arduino Mega” and generally is priced at $60.