If you are worried for your safety from your family, make a plan to leave, dating is the least of your worries.
If you don’t think it’s right for your date to know where your mom lives, then just meet them out where you are going, tell them you don’t need to be picked up or dropped off. Have the date, say goodbye, go home.