Do you believe I have grounds for an appeal?

You probably have grounds for an appeal but your chances of winning may only be 50:50. The place is a dump, your chances of coming out of this more successfully are not good enough to risk the hassle and effort. Find somewhere decent for yourself to have a comfortable life and let this guy try and find someone else to live in the shack.