No matter what you say a person chooses to felt hurt or not. How you say it is more important. Try to be sensitive to him yet firm in your decision. If you feel guilt or pity he may not be able to move forward and both of you will feel stuck. Try to be honest with him and explain your reasons for wanting to break off the relationship.