The Gunners headed into the game under pressure to find a win after their 2-0 loss to Leicester City last time out.
Unai Emery’s side had only won one of their previous five Premier League games heading into the home clash against the Saints on Saturday.
Danny Ings gave the visitors a surprise lead in the eighth minute, but Alexandre Lacazette levelled for Emery’s men in the 18th minute.
James Ward-Prowse thought he had won it for the Saints when he netted in the 71st minute to put the visitors in front once again.
Arsenal looked to be heading to another Premier League defeat, but Lacazette netted a last-gasp equaliser in the sixth minute of stoppage time to salvage a point for the home side.
England legend Lineker was clearly not impressed by Arsenal’s performance overall as he reacted to Lacazette’s second goal on social media.
Writing on Twitter, Lineker said: “Lacazette grabs a last ditch equaliser for Arsenal after what was frankly a dreadful display against a very good Southampton side.”
Arsenal’s draw left them in seventh place in the Premier League table and well off the pace in the race for the top four.
Emery’s side have only managed to win four of their opening 13 Premier League games under the Spanish head coach this season.
They will return to Premier League action next weekend with a trip to Norwich City.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news