Programming Questions? Ask a Programmer for Answers ASAP
Hello and thank you for contacting us, a paid expert support site. My name is XXXXX XXXXX I'd be glad to assist you with your issue.
Just so I understand the problem - your site is age verified using that service and you need crawlers to bypass, correct?
yes, my website is http://fincigs.com Since age verifier was place on site crawlers seem blocked?
Trying to see if they offer a method for bypassing. Do you remember how you integrated it?
Was the company itself. Not sure. we just took the work over prior to implementation
Ok. Do you have any FTP information for the site so I can see how it is implemented? Might be a simple script change that redirects crawlers.
Their arguing the point it isn't effecting the crawl
No I would have to ask my developer for FTP. Script change is what someone who took a quick look siad
Trying to explain to them and they said no one else has ever brought up the issue in 10 years lol
If it is possible to get the FTP information, I can take a look at the files and see if it is possible. If the age verification was working correctly, it should automatically allow crawlers to bypass.
Let me try searching to see if I can see any information beyond the age verification page
Nope, it's crawling correctly, it seems
First result - it has sublinks below the description and the subsequent results are also internal pages.
yeah but check the cache paged it is either the age landing page or a 404
I'm not able to view cached Google pages. Hrm - well - it is getting past the age verification because he sees the other pages - unless you have an SEO plugin that does site maps?
What do you think of my question?
well we wipped the robotstxt clean and is now reading url's
Ah, I was going to suggest looking at that but that only allows or disallows - wasn't sure if that would help or not.
I guess disallowing the age verification page might help
thanks man.. you talked me into thinking.