I would call. & simply state that next time there will be a fee for services. Most people have to contract for others to "house sit" and the like. It's HIS property but if there is even an OUTSIDE chance it could hurt you - well? - then, just make the call.
Tough one!