"No, we were in an inn when we left."

He pauses. "Or we should be. We were leaving my tower which is... a small pocket dimension. So without me to have the spell active it would have dumped us back in the inn." Provided nothing went wrong. Which... he's pretty confident it didn't, but not completely.