Having to level them back up from 1 just to switch their job is a massive pain. especially if you switch your main and want to keep your retainer leveled up with you.

just have em cost a ridiculous amount of GC Seals or something.

I didn't find the right solution from the internet.
References:

marketing videos