In March, during the breaks between Swift’s incredible international leg of her Eras Tour, the 34-year-old couple took a memorable trip to the Bahamas.

They took a few days off and vacationed in the Bahamas, an insider told PEOPLE. “For them both, it was a much-needed break. They took great pleasure in it. Together, they are incredibly content.

During the pop star’s Eras Tour, the couple traveled the world and had quality time together in between gigs in Australia and Singapore in February and March.

Get the best of PEOPLE, from celebrity news to gripping human interest stories, sent straight to your inbox by subscribing to their free daily newsletter.

Travis was able to hear Swift’s most recent song before to the highly anticipated release of her highly anticipated new album, The Tortured Poets Department, on April 19.

The athlete listened to album tracks early, according to several people close to the athlete who spoke with PEOPLE.

Regarding his response to the record, one source stated, “He is always in awe of her.”