Actually, reading the emails in which he is calling you names would not help because although it is totally unprofessional, callous and boorish, we cannot sue anybody for calling us names.
If you want to keep the pool liner, you will have to deal with him coming to fix it and then paying him.
If you want the pool liner removed, you will only have to deal with him once - when he comes over to take out the pool liner.
The decision is totally up to you. If I were in your position, I would not reward him for calling me names. I would tell him to come and take his liner out and I would buy a pool liner from another company, even if it cost me more. I would never give anyone the satisfaction of calling me all kinds of names and then handing over my hard earned money to him. If anything were to happen with the liner in the future, I would again have to be dealing with him, and who knows what kind of service he would give me in the future, so I would rather cut my ties with him now. But that's just me.
You have to make the final decision if it is worth it to continue to deal with him, knowing that you cannot sue him for name calling,
I realize that this is not exactly the Answer you were hoping for and it would have given me great pleasure to give you the Answer you wanted to hear, but I have an ethical obligation to you to give you only correct Answers and information, so I am respectfully asking that you not hold the law applicable to your situation against me,
Please be kind enough to rate Excellent Service" so that I receive credit for assisting you,
Bonus and Positive Feedback on survey is very much appreciated,