Message:

<p>[QUOTE=&quot;desertgem, post: 2505046, member: 15199&quot;]Good robots will honor a no trespass tag in the code. A malicious robot won&#039;t</p><p><br /></p><p>The &quot;#&quot; below are added by me.</p><p>~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~</p><p><br /></p><p>&quot;You can use a special HTML &lt;META&gt; tag to tell robots not to index the content of a page, and/or not scan it for links to follow.</p><p><br /></p><p>For example:</p><p><br /></p><p>#&lt;html&gt;</p><p>#&lt;head&gt;</p><p>#&lt;title&gt;...&lt;/title&gt;</p><p><b>#&lt;META NAME=&quot;ROBOTS&quot; CONTENT=&quot;NOINDEX, NOFOLLOW&quot;&gt;</b></p><p>#&lt;/head&gt;</p><p><br /></p><p>There are two important considerations when using the robots &lt;META&gt; tag:</p><p><br /></p><ul> <li>robots can ignore your &lt;META&gt; tag. Especially malware robots that scan the web for security vulnerabilities, and email address harvesters used by spammers will pay no attention.</li> <li>the NOFOLLOW directive only applies to links on this page. It&#039;s entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.&quot;<br /> <br /> <a href="http://www.robotstxt.org/meta.html" target="_blank" class="externalLink ProxyLink" data-proxy-href="http://www.robotstxt.org/meta.html" rel="nofollow">http://www.robotstxt.org/meta.html</a><br /> <br /> <br /> </li> </ul><p>[/QUOTE]</p><p><br /></p>

Your name or email address:

Do you already have an account?

• No, create an account now.
• Yes, my password is:
• Forgot your password?

Stay logged in