"Hugh and Sutton wanted to get away," a source shared.