The Cameroon international was starting his third Premier League game since his move to the Merseyside outfit from Bundesliga side Schalke 04 in the summer transfer window.
Liverpool had conceded two goals in two games since Matip struck up a promising partnership with Croatia international Dejan Lovren ahead of their trip to west London.
And the African defender managed to keep a lid on Costa for most of the Stamford Bridge clash aside from the centre-forward’s second-half finish.
Former Manchester United defender Neville was particularly impressed with Matip’s assured performance up against Costa in west London.
“I thought Matip and Lovren did very well. Costa never got in the game. When they did get balls up to Costa, Matip was really aggressive against him,” Neville told Sky Sports.
Liverpool finished with their worst defensive record in Premier League history last season after conceding 51 times in the 2015/16 campaign.
Jurgen Klopp’s side have collected 10 points from a possible 15 after five Premier League in what has been a tough start to the season for Liverpool.
The Merseyside outfit will take on Hull City in their next Premier League fixture next Saturday afternoon.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news