The heavyweight boxer, nicknamed the Gypsy King, spent last Friday morning in Crispins Café in East Street with his father John.
Cafe owners Jo and Simon spoke to the pair and had a picture taken with them, which they later posted on Facebook.
Crispins owner Jo Newman said: ‘It was on the house because my husband is a big fan.
Google reviews of afternoon tea: Top five places in Portsmouth to get your cake fix
German Doner Kebab to open first restaurant in Havant
Here are the rarest 50p coins in circulation and how valuable they are
GMB union security staff at Fawley oil refinery secure 31 per cent inflation busting pay rise following lengthy negotiations
Rowlands Castle physio practice helping ‘patients to live a better life’ celebrates 14 years in business
‘When he left he asked if we wanted to take a photo. It was a one off event.’
Jo said although she had watched Tyson Fury fight before, she didn't recognise him initially.
Jo and her husband Simon took over Crispins ten months ago and said this weekend was their best yet though she didn't believe it is linked to the boxer's visit.
In 2015 Tyson Fury won the unified WBA (Super), IBF, WBO and IBO world belts by beating long-reigning world champion Wladimir Klitschko in Germany.
In his upcoming autobiography he has spoken out about a suicide bid in the aftermath of his win over Klitschko, after becoming overcome by a feeling emptiness and reaching 28 stone.