The Cats were cruising at the Gabba on Saturday, up by 32 points on a wet night before Brisbane kicked seven goals to their two in the second half to win 10.10 (70) to 9.7 (61).
The loss followed an upset seven-point defeat to St Kilda six days earlier.
"Big parts of the game we had under control, so it's very annoying we let it slip," Scott said.
"But if you have losses early in the season and think ... 'we're so far off' ... we're miles away from that space.
"You try to look forward. There have been so many years when we've ended up in a pretty good position and you look back and think 'that game's really going to hurt us' and in the end it hasn't.
"You'll get plenty of opportunities to feel sorry for yourself and let it compound, but you've just got to hang in a little bit."
While frustrated by a string of "critical errors", Scott looked to the defensive efforts of Irishman Oisin Mullin on Charlie Cameron and 19-year-old key defender Connor O'Sullivan as clear upsides.
"We've got some young guys that can come in and improve us quickly, which we'll need," he said.
"If we don't find a way to improve, the competition's pretty ominous."
Defender Tom Stewart was named to play despite suffering a knee injury last week, before being replaced shortly before the first bounce on Saturday.
Confident he'll play next week against Melbourne, Scott said they had given Stewart as long as possible to prove his fitness and that "if he was a fair way off yesterday when we got on the plane, we wouldn't have brought him".
Bailey Smith did play after missing what would have been his second game for the club last week with a calf niggle and was among the best on ground in the first half.
"He's going to really help us ... he's already made a difference," Scott said.
23°C