Amakhosi have endured a challenging opening to the campaign, with mistakes costing them in some important matches.
However, Kwinika insists the squad must respond collectively instead of allowing individual errors to dominate the conversation.
The defender has particularly backed captain Brandon Petersen, who has faced criticism after making costly mistakes in some of their matches.
Despite the scrutiny, Kwinika believes Petersen remains an important figure within the dressing room and should continue receiving the backing of his teammates.
"I think errors are part of football. I stand with Biza (Brandon Petersen) any day. He's our leader. He's a big boy. He understands where he is," Kwinika told the media.
The defender believes football is built around collective responsibility, arguing that goals conceded are rarely the result of one player's actions alone.
"If someone can kick the ball into the net, it means someone else didn't close down enough. So, it can't always be on Biza. It's a team effort. All of us contribute to that," he added.
Kwinika also pointed to Petersen's performances in previous matches, reminding critics of the occasions when the goalkeeper has helped Amakhosi out of difficult situations.
While defending his captain, Kwinika has also welcomed the influence of new midfielder Lebohang Maboe.
The experienced midfielder has enjoyed a positive start at Chiefs, and Kwinika believes his winning mentality could be particularly valuable to the club's younger players.
"He knows what winning is, how to win, and you can take as much as you can from him," Kwinika said.
For Kwinika, the combination of experienced leaders and younger players could prove crucial as Chiefs look to turn their early-season setbacks into a stronger campaign.
Amakhosi have dropped four points from their last two league matches, drawing 1-1 with Mamelodi Sundowns before being held to a 2-2 draw by Richards Bay. They will now be looking to return to winning ways when they host Siwelele FC at Dobsonville Stadium on Sunday.
The match will be played at the Soweto venue instead of FNB Stadium, which is unavailable due to the Springboks' Rugby Championship clash against New Zealand.
