Wantaway Modrić, who has netted 17 goals in 159 appearances for Spurs has attracted interest from Manchester United and Real Madrid since the season came to an end in May.
Tottenham flew to America on Saturday for their tour and reports in Spain suggest the Croatian playmaker was not part of the travelling party.
“I think Modrić is wrong,” Villas-Boas told Spanish newspaper AS. “This will go against him. He has worsened the situation with what he’s doing and now the chairman [Daniel Levy] is very angry.
“This is also not a good time for Daniel Levy, who is in the USA at the moment, because his wife is ill.”
Villas-Boas, who was sacked as Chelsea manager in March, admitted he had tried to sign the Tottenham midfielder last summer but Spurs remained firm and refused to sell their prized asset.
The 34-year-old was appointed as Harry Redknapp’s successor in June, and the former Porto boss admits Modrić’s potential departure would be a big loss to the north London outfit.
“He’s good, very good. I tried to sign him last summer for Chelsea. He will be a big loss. He’s a player who can make the difference, who gives a lot of clarity to the play when the team needs it and who can play in several positions,” he added.
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news