Maybe it's only me, but I would like to ensure that some websites we monitor are always indexable by Search engines / bots (Google bots, Bing bots, Yahoo).
By checking:
the meta robots
the HTTP header
the rules in robots.txt (if possible...)
Am I the only one with this feature request?
1 Comment
Well so far it's true I didn't get this request but thanks for posting the suggestion here, some users may realize they actually want this by seing it and add their vote :)
Sign in to comment