Honestly I can’t see why you’d choose average, non-wealthy. If you want quiet and peaceful, you’re sure to get it when wealthy, just pay for a large residence and security on the outskirts, then stay inside. Use disguises/body doubles when going out. Except for a little organizational overhead, which you can also pay people to do for you, you can have everything you want when you’re famous and wealthy.