Wilfied Bony scored the winner from the second minute of injury time after Cheick Tiote had fouled Marvin Emnes at St James’ Park.
I felt we should have won this game but errors at the end of both halves has cost us dear
The Ivorian had earlier levelled for the visitors after Shola Ameobi’s 23rd-minute strike broke the deadlock for the Magpies.
And Pardew was left to rue another disappointing Magpies performance, with his side losing five Premier League games on the bounce.
“It was a game that looked like it was going to a draw. I felt we played a lot better and it was a killer blow the last goal,” Pardew told BBC Sport.
“It was a free-kick for us and there is no way we should have let that happen. There were three or four errors [in that goal].”
He added: “It is disappointing. We’ve had two key injuries in the game as well. It was a game that didn’t go well for us in terms of that. We had good tenacity for the game.
“I felt we should have won this game but errors at the end of both halves has cost us dear.”
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news