Swans defender Chico Flores was sent off at the Liberty Stadium inside 15 minutes after being booked twice in quick succession.
At times we weren’t at our best but we got the three points
And Ba proved the Blues’ hero once again as the Senegal striker’s shot from the edge of the box sealed the victory after his goal against Paris Saint-Germain in midweek.
“Patience was the key today, especially after they had a man sent off not long into the game,” Terry told Sky Sports.
“At times we weren’t at our best but we got the three points and we’ll take them home with us today.”
The win kept Chelsea in second place in the Premier League table, just two points behind leaders Liverpool with four games left to play.
And match-winner Ba was delighted that the Blues’ resilience paid off.
“It was difficult today, especially for the strikers,” said Ba. “They were defending very tight together.
“The through-ball for my goal was perfect from Nemanja Matic and I had to finish it for the team and I did.”
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news