The Belgium international came off the bench to win an added-time penalty before the 25-year-old stepped up and dispatched the spot-kick to seal three points.
Liverpool manager Jurgen Klopp has used the £32.5m signing sparingly since the former Borussia Dortmund boss replaced Brendan Rodgers at Anfield in October.
Benteke has started just six Premier League games since the German was named as Rodgers’s successor.
Former Arsenal and West Ham striker Hartson was impressed by Benteke’s cameo performance at Selhurst Park.
“Benteke played like superman when he came on. He had a point to prove coming off the bench,” Hartson told BBC Sport.
Benteke has scored seven goals and has made two assists in 24 Premier League appearances so far this season.
The towering Belgian striker has only started 12 top-flight games under Rodgers and Klopp.
Liverpool are in seventh place in the Premier League table following their 2-1 win.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news