Remy, who joined Chelsea from Queens Park Rangers last weekend, came on just before the hour and hit a superb first-time strike past David De Gea.
The goal was the 27-year-old’s sixth strike for his country on his 28th appearance for Les Bleus.
Remy signed a four-year deal with the west London club after Chelsea triggered the £10.5m release clause in his QPR contract.
The striker, who spent last season on loan to Newcastle United, came close to joining Liverpool earlier in the summer before his move fell through.
Remy scored 14 goals in the Premier League for the Magpies last season before returning to Loftus Road.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news