Think about that nice life that the fisherman describes again. “I sleep late, fish a little, play with my children, take siesta with my wife, stroll into the village each evening where I sip wine and play guitar with my amigos: I have a full and busy life, señor.”
That life is a pretty cheap one. He catches most of his own food and probably has a garden to fulfill the rest. He doesn’t need a mansion for this lifestyle. He sips wine in the evening, but it’s probably wine given to him by friends and he likely gives them fish in exchange for it.