The two World Cup winners will play no further part in the competition, but will not be replaced in the squad, with home and away fixtures against Argentina to follow Saturday's rematch with the Wallabies in Sydney.
"We now have 32 players in camp and with (flyhalf) Elton (Jantjies) expected to recover for the matches against Argentina, and players such as Andre (Esterhuizen), Jesse (Kriel) and Frans (Steyn) all being capable centres, we are well covered," Springbok coach Jacques Nienaber said in a media release from South African Rugby on Wednesday.
"Our plan from the outset of the season was to give most of the players in our expanded squad game time as we build towards the Rugby World Cup, and this involved rotating a few players, so we'll use this opportunity to build our depth."
The updated news on Pollard and Am came a day after Nienaber named a team with eight changes for the second clash with the Wallabies.
Meanwhile the Springboks' front row is confident makeshift hooker Deon Fourie can make an impact off the bench after his surprise selection.
The 35-year-old is having a fairytale year, returning home after seven years in France to help the Stormers win the United Rugby Championship, followed by a first Test cap against Wales in July when he became the oldest Springbok debutant.
Fourie has been picked as replacement hooker in a shock move by coach Jacques Nienaber, who has selected Malcolm Marx to start and dropped last week's first choice hooker Joseph Dwerba.
Fourie was taken on the tour to Australia as the third choice hooker in place of the injured Bongi Mbonambi despite not having played there since March 2019 and having not played a full time role at No. 2 since the 2017-18 season.
Prop Trevor Nyakane told a virtual news conference on Wednesday the Springbok front row had no qualms about Fourie's ability.
"We've only worked with him as a hooker on the training field but Deon is a very experienced player, he's played in that position before," Nyakane said.
"I watched him at school level and he was a hooker and it was a surprise to me when he started playing on the flank when we got to provincial level.
"He is in sync, he knows what we are trying to achieve as a pack and has fitted in perfectly. Things are shaping up to be great. I know he will tackle the challenge head on."