LOL, same here. Most of the time I knew, but in a rental car or something, I could never remember...
My charging port is in the front center now--and this is causing me problems with some street chargers because I can't get the cable far enough over. There's no arrow for that....