The Brumbies were looking for a club record 14 successive wins over their interstate arch rivals when they met in round six in Sydney but fell to a 28-23 loss.
Wallabies wannabe Toole, who has had a breakout season, said the loss "burnt" and his team wanted to make amends against NSW, who are ranked seventh on the ladder.
"Yeah, it definitely did," the 25-year-old said on Tuesday.
"The Tahs have got a great team and like you said they beat us earlier in the year and all the boys are hungry to get one back over them."
As well as that defeat, Australia's top-placed team, sitting third, were stung last round by their first loss in Canberra to the Hurricanes since 2017.
Toole had his hands full with bullocking winger Kini Naholo, who sits second on the competition's try-scoring tally.
The speedster said the Brumbies had had some tough training and video sessions since the loss.
"The whole team and squad were quite disappointed," he said.
"We had a hard review today and a hard training session and hopefully we can bounce back from that.
"One of the big improvements is our line speed - we weren't really getting off the line against the Hurricanes so if we can get off the line and make our tackles this weekend against the Tahs we should go alright.
"If we drop too many tackles, it's pretty hard to win games."
Toole is in the mix for Wallabies selection for the upcoming British and Irish Lions series but he said he was just trying to focus on helping the Brumbies win the Super title.
"I can't really focus on it too much. I've been close the last couple of years but I think the best way I can try and get in that Wallabies squad is to go deep into the competition with the Brumbies."
Meanwhile, the Waratahs announced the re-signing of a trio of players with prop Daniel Botha, lock Ben Grant and centre Henry O'Donnell all extending their contracts for another two years.
12°C