If you don't ever delete any emails from your mailbox, yes, they will just continue to stay on the email server (and in your mailbox) permanently. Most mail providers have quota limits in place, but usually the free storage space provided for emails is so high that you will likely not need to worry about that in a lifetime. :)
Please let me know if you have any further questions or concerns. Thank you!