"Is that so? I apologize for the wariness, this place is not as sturdy as it should be, so it doesn't hurt to be too careful..."
"I'm glad you don't, although... That adventurer was making a joke, I'm afraid."
*points towards the nearest table, who is clearly cracked in many points* "See? That's the table that mister Gem threw a stack of paper too a few weeks back. It broke down from the weight of the stack and had to be hastily repaired as no spares were available."
*points towards a particularly cranky piece of wood in the ground* "And that one is a loose wood that mister Gem broke, he sometimes enters the tavern through a hidden tunnel that leads there."
*points towards a big crack in the ceiling* "And that one is his hidden escape route. When mister Pierre wishes to scold mister Gem, mister Gem is quick to jump up there and open a hidden trapdoor above that leads to the tavern's ceiling.
"As you can see, mister Gem has broken a fair amount of things in this building already, and yet he never puts any money into repairing it, and I'm afraid the quality of the furniture isn't among the best either, as it never lasts long, so... A small speck of fire might actually burn the whole place down, I'm afraid."