He fears he will be "locked out" after publicly speaking about her marriage to Prince Harry, The Sun reported.
The ex-TV lighting director revealed he has not spoken to her since the royal wedding.
"I don’t expect to see her or hear back from her and that’s OK," the 74-year-old is quoted as saying in the report.
He feels the royals have "locked the door, pulled the windows down and closed the shades” because of the number of interviews he has given.
However, he stands by his decision to speak out. "All I was doing was saying things I wanted to say," he told The Sun.
Adding, "I now want to go on vacation somewhere and try to get some peace."
Despite the circumstances, he also wishes his daughter well and hopes to one day re-establish a relationship with her....