If you want to use the location field from Google Calendar inside your reminder messages you can use the token $CUSTOM3.
So you could say something like:
Hello this is a reminder of is a reminder that we have a scheduled visit on $APPOINTMENT_DATE_SHORT - $APPOINTMENT_START_TIME at $CUSTOM3. Please visit $REPLYLINK to confirm or reply with Yes.
