Don't call it "Losers Bracket." Call it the "Second Chance Match." Frame it as: "Team 5, you waited. Now you play the team that just lost its perfect record. Winner stays alive."
As soon as teams lose in Round 2 or beyond, they drop into the Lower Bracket. The team that lost the very first game (#4 or #5) waits for the losers of the Round 2 matches to filter down. Total Games and Duration 5 team bracket double elimination