Retirement benefits, including annuities, 401(k) plans, IRAs, etc., do not affect the amount of Social Security that you will receive at retirement. The only thing that affects the amount of Social Security benefits that you receive are wages that you earn if you continue to work and you are less than full retirement age.
Where outside income, such as pensions, annuities, IRA distributions, etc., will affect you is they can change the amount of Social Security that is taxable when you start collecting. If your adjusted gross income (not including Social Security) plus 50% of your Social Security benefits plus any tax-free interest (from municipal bonds) is between $25,000 and $34,00 on a single return or between $32,000 and $44,000 on a joint return, your Social Security becomes partially taxable. Depending on your income, up to 85% of your benefits can be taxed.
I hope this answers your question! If you have any more, please feel free to ask and I will be happy to answer.
Thanks! Have a great week!