Is the last selected riding mode saved after the system is switched off?

Yes, the system makes a note of the most recently selected riding mode.
On eBikes, however, the mode is set to “Off” when switched on.