The defender made his first Premier League appearance of the season as the north London side secured all three points in a thrilling game at The Emirates.
Arsenal were twice behind against Leicester before eventually going on to win the game thanks to Olivier Giroud’s late winner.
Kolasinac, who joined Arsenal from Schalke this summer, played in a three-man defence which struggled to cope with Leicester’s threat all night.
And former Manchester United defender Neville was less than impressed by the Bosnian’s contribution in the build-up to Shinji Okazaki’s equaliser in the first half.
Speaking to Sky Sports after the game, Neville said: “Leicester take a short one, credit to them, and they just take Arsenal unawares with no authority at the back.
“(Harry) Maguire does really well to guide it across and Okazaki beats (Granit) Xhaka in the air.
“But I have to say, the new centre-back Kolasinac, it’s so irresponsible what he does.
“He’s there at that back post, he drifts forward. I have no idea what he is doing.
“I have no idea, he just leaves a massive void for the rest of his team to cover and they can’t cover it. It’s poor from him.”
Arsenal will now turn their attentions towards their next Premier League game – a trip to Stoke City on Saturday evening as they look to get their new campaign off to a positive start.
The Gunners finished in fifth place in the Premier League last season but won the FA Cup by beating Chelsea in the final back in May.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news