All warts, not just genital warts, are due to the human papilloma virus. So what your physician was telling you was that you had a wart. A wart would have nothing at all to do with problems with conceiving. This would be nothing to worry about.
Happy to answer any further questions. Thank you.