Thursday, May 19, 2016

Review Your Robots.txt File; Assess Your Meta Robots Tagging

On the off chance that you have a robots.txt record on your site, check by going to/robots.txt. You might be amazed to discover you are withholding pages, organizers, pictures, and so forth from web crawlers that can direct people to your website. 

Also, run a site filter with a device, for example, Screaming Frog  to survey if there are any pages on your site you are barring through a meta robots tag. Both of these are a brisk fix in the event that you do discover issues. 

Accidentally labeled pages or robots.txt passages are normally the guilty party of an engineer who neglected to evacuate the assignments when another page moved live or a past site chairman who considered the quality substance irrelevant for the masses.