<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	>
<channel>
	<title>Comments on: Calling out bad crawlers: the Kintiskton nuisance</title>
	<atom:link href="http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance/feed" rel="self" type="application/rss+xml" />
	<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance</link>
	<description>HTML, CSS, Javascript, PHP, and other assorted code</description>
	<pubDate>Fri, 10 Sep 2010 00:15:32 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.6.2</generator>
		<item>
		<title>By: Brinley Ang</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-256</link>
		<dc:creator>Brinley Ang</dc:creator>
		<pubDate>Thu, 12 Aug 2010 07:38:24 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-256</guid>
		<description>It even parses urls in JavaScript code without correctly executing the code itself and ended up hitting my site with 404s.</description>
		<content:encoded><![CDATA[<p>It even parses urls in JavaScript code without correctly executing the code itself and ended up hitting my site with 404s.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tony</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-251</link>
		<dc:creator>Tony</dc:creator>
		<pubDate>Tue, 13 Jul 2010 13:25:26 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-251</guid>
		<description>They were just crawling my site pretty heavily but I was watching in real time my site traffic, so they done a bit of crawling until I made an htaccess file with:

deny from 65.208.151.

And it stopped them within seconds :)

I chose to deny the the whole range (1-255) because no doubt they will use new ip's soon enough but they should only change their server ip's (meaning only that last number will change).

If anyone wants to stop them crawling, simply make a text file, and write in it:

deny from 65.208.151.

and save it. Then upload the txt file to your web hosting and rename it .htaccess and its done :)

You can't rename your text file to .htaccess in windows you have to do it in your ftp when the file hits your web server because windows FORCES you to put something before a . in a file name. Linux/UNix web servers do not.</description>
		<content:encoded><![CDATA[<p>They were just crawling my site pretty heavily but I was watching in real time my site traffic, so they done a bit of crawling until I made an htaccess file with:</p>
<p>deny from 65.208.151.</p>
<p>And it stopped them within seconds <img src='http://themaingate.net/dev/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>I chose to deny the the whole range (1-255) because no doubt they will use new ip&#8217;s soon enough but they should only change their server ip&#8217;s (meaning only that last number will change).</p>
<p>If anyone wants to stop them crawling, simply make a text file, and write in it:</p>
<p>deny from 65.208.151.</p>
<p>and save it. Then upload the txt file to your web hosting and rename it .htaccess and its done <img src='http://themaingate.net/dev/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>You can&#8217;t rename your text file to .htaccess in windows you have to do it in your ftp when the file hits your web server because windows FORCES you to put something before a . in a file name. Linux/UNix web servers do not.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: bob3160</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-248</link>
		<dc:creator>bob3160</dc:creator>
		<pubDate>Sat, 12 Jun 2010 14:52:45 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-248</guid>
		<description>Just blocked them. Wondered what was making my server so busy.</description>
		<content:encoded><![CDATA[<p>Just blocked them. Wondered what was making my server so busy.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: canuck</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-208</link>
		<dc:creator>canuck</dc:creator>
		<pubDate>Wed, 17 Jun 2009 14:25:53 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-208</guid>
		<description>Hi.  They came on to my site and I received over 600 hits from them in approx half an hour.  I was able to exempt my statcounter.com from logging their IP address, but that doesn't mean they can no longer access my site.

I use blogger.  Is there a place in my Template where I can insert info that would deny them even loading my page?  I am computer not-too-smart and so if you can help in kid language, that would be ideal :)

Cheers &#38; thanks.</description>
		<content:encoded><![CDATA[<p>Hi.  They came on to my site and I received over 600 hits from them in approx half an hour.  I was able to exempt my statcounter.com from logging their IP address, but that doesn&#8217;t mean they can no longer access my site.</p>
<p>I use blogger.  Is there a place in my Template where I can insert info that would deny them even loading my page?  I am computer not-too-smart and so if you can help in kid language, that would be ideal <img src='http://themaingate.net/dev/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
<p>Cheers &#38; thanks.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Julian Perry</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-203</link>
		<dc:creator>Julian Perry</dc:creator>
		<pubDate>Fri, 15 May 2009 07:10:56 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-203</guid>
		<description>I am getting very similar activity from cuil.com.
Direct hits from 216.129.119.16.
Google Adsense shows the hits as page impressions for one day then they're gone the next.</description>
		<content:encoded><![CDATA[<p>I am getting very similar activity from cuil.com.<br />
Direct hits from 216.129.119.16.<br />
Google Adsense shows the hits as page impressions for one day then they&#8217;re gone the next.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Kintiskton &#171; Mark Turner Dot Net</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-199</link>
		<dc:creator>Kintiskton &#171; Mark Turner Dot Net</dc:creator>
		<pubDate>Thu, 23 Apr 2009 16:45:22 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-199</guid>
		<description>[...] that made choose not to share my web content with Kintiskton. I first added the subnet to my .htaccess rules but decided to add it to my firewall rules. That took care of [...]</description>
		<content:encoded><![CDATA[<p>[...] that made choose not to share my web content with Kintiskton. I first added the subnet to my .htaccess rules but decided to add it to my firewall rules. That took care of [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: mrdeus</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-183</link>
		<dc:creator>mrdeus</dc:creator>
		<pubDate>Sat, 28 Feb 2009 21:12:10 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-183</guid>
		<description>I blocked this bot today. It's annoying because it loads images and everything. And does it all at once, like you said.

It's shorter to use the CIDR notation for the .htaccess file:

Deny from 65.208.151.112/29</description>
		<content:encoded><![CDATA[<p>I blocked this bot today. It&#8217;s annoying because it loads images and everything. And does it all at once, like you said.</p>
<p>It&#8217;s shorter to use the CIDR notation for the .htaccess file:</p>
<p>Deny from 65.208.151.112/29</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: LGR</title>
		<link>http://themaingate.net/dev/uncategorized/calling-out-bad-crawlers-the-kintiskton-nuisance#comment-180</link>
		<dc:creator>LGR</dc:creator>
		<pubDate>Fri, 27 Feb 2009 19:11:00 +0000</pubDate>
		<guid isPermaLink="false">http://themaingate.net/dev/?p=183#comment-180</guid>
		<description>I have the exact same problem. I just ban those IP's by default now on every site I work on. I guess that is all we can do to stop them. Thanks Verizon Business for being a nuisance.</description>
		<content:encoded><![CDATA[<p>I have the exact same problem. I just ban those IP&#8217;s by default now on every site I work on. I guess that is all we can do to stop them. Thanks Verizon Business for being a nuisance.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
