Bots

We are currently blocking the following bots from doing any HTTP Requests:

```
AESOP_com_SpiderMan
```
```
Alexibot
```
```
Anonymouse.org
```
```
asterias
```
```
attach
```
```
BackDoorBot
```
```
BackWeb
```
```
bandit
```
```
Baiduspider
```
```
BatchFTP
```
```
Bigfoot
```
```
Black.Hole
```
```
BlackWidow
```
```
BlowFish
```
```
Bot mailto:craftbot@yahoo.com
```
```
BotALot
```
```
Buddy
```
```
BuiltBotTough
```
```
Bullseye
```
```
BunnySlippers
```
```
Cegbfeieh
```
```
CheeseBot
```
```
CherryPicker
```
```
ChinaClaw
```
```
Collector
```
```
Copier
```
```
CopyRightCheck
```
```
cosmos
```
```
Crescent
```
```
Custo
```
```
DA
```
```
DISCo
```
```
DIIbot
```
```
DittoSpyder
```
```
Download
```
```
Download Demon
```
```
Download Devil
```
```
Download Wonder
```
```
Downloader
```
```
dragonfly
```
```
Drip
```
```
eCatch
```
```
EasyDL
```
```
ebingbong
```
```
EirGrabber
```
```
EmailCollector
```
```
EmailSiphon
```
```
EmailWolf
```
```
EroCrawler
```
```
Exabot
```
```
Express WebPictures
```
```
Extractor
```
```
EyeNetIE
```
```
FileHound
```
```
FlashGet
```
```
Foobot
```
```
flunky
```
```
FrontPage
```
```
GetRight
```
```
GetSmart
```
```
GetWeb!
```
```
Go!Zilla
```
```
Google Wireless Transcoder
```
```
Go-Ahead-Got-It
```
```
gotit
```
```
Grabber
```
```
GrabNet
```
```
Grafula
```
```
Harvest
```
```
hloader
```
```
HMView
```
```
httplib
```
```
HTTrack
```
```
humanlinks
```
```
ia_archiver
```
```
IlseBot
```
```
Image Stripper
```
```
Image Sucker
```
```
InfoNaviRobot
```
```
InfoTekies
```
```
Intelliseek
```
```
InterGET
```
```
Internet Ninja
```
```
Iria
```
```
JennyBot
```
```
JetCar
```
```
JOC
```
```
JustView
```
```
Jyxobot
```
```
Kenjin.Spider
```
```
Keyword.Density
```
```
larbin
```
```
LeechFTP
```
```
LexiBot
```
```
lftp
```
```
libWeb/clsHTTP
```
```
likse
```
```
LinkextractorPro
```
```
LinkScan/8.1a.Unix
```
```
LNSpiderguy
```
```
LinkWalker
```
```
lwp-trivial
```
```
LWP::Simple
```
```
Magnet
```
```
Mag-Net
```
```
MarkWatch
```
```
Mass Downloader
```
```
Mata.Hari
```
```
Memo
```
```
Microsoft.URL
```
```
Microsoft URL Control
```
```
MIDown tool
```
```
MIIxpc
```
```
Mirror
```
```
Missigua Locator
```
```
Mister PiX
```
```
moget
```
```
Mozilla/3.Mozilla/2.01
```
```
MozillaNEWT
```
```
NAMEPROTECT
```
```
Navroad
```
```
NearSite
```
```
NetAnts
```
```
Netcraft
```
```
NetMechanic
```
```
NetSpider
```
```
Net Vampire
```
```
NetZIP
```
```
NextGenSearchBot
```
```
NG
```
```
NICErsPRO
```
```
NimbleCrawler
```
```
Ninja
```
```
NPbot
```
```
Octopus
```
```
Offline Explorer
```
```
Offline Navigator
```
```
Openfind
```
```
OutfoxBot
```
```
PageGrabber
```
```
Papa Foto
```
```
pavuk
```
```
pcBrowser
```
```
PHP version tracker
```
```
Pockey
```
```
ProPowerBot/2.14
```
```
ProWebWalker
```
```
psbot
```
```
Pump
```
```
QueryN.Metasearch
```
```
RealDownload
```
```
Reaper
```
```
Recorder
```
```
ReGet
```
```
RepoMonkey
```
```
RMA
```
```
Siphon
```
```
sitecheck.internetseer.com
```
```
SiteSnagger
```
```
SlySearch
```
```
SmartDownload
```
```
Snake
```
```
Snapbot
```
```
Snoopy
```
```
sogou
```
```
SpaceBison
```
```
SpankBot
```
```
spanner
```
```
Sqworm
```
```
Stripper
```
```
Sucker
```
```
SuperBot
```
```
SuperHTTP
```
```
Surfbot
```
```
suzuran
```
```
Szukacz/1.4
```
```
tAkeOut
```
```
Teleport
```
```
Telesoft
```
```
TurnitinBot/1.5
```
```
The.Intraformant
```
```
TheNomad
```
```
TightTwatBot
```
```
Titan
```
```
toCrawl/UrlDispatcher
```
```
True_Robot
```
```
turingos
```
```
TurnitinBot
```
```
URLy.Warning
```
```
Vacuum
```
```
VCI
```
```
VoidEYE
```
```
Web Image Collector
```
```
Web Sucker
```
```
WebAuto
```
```
Webbandit
```
```
Webclipping.com
```
```
WebCopier
```
```
WebEMailExtrac
```
```
WebEnhancer
```
```
WebFetch
```
```
WebGo IS
```
```
Web.Image.Collector
```
```
WebLeacher
```
```
WebmasterWorldForumBot
```
```
WebReaper
```
```
WebSauger
```
```
WebSite
```
```
Website eXtractor
```
```
Website Quester
```
```
Webster
```
```
WebStripper
```
```
WebWhacker
```
```
WebZIP
```
```
Whacker
```
```
Widow
```
```
WISENutbot
```
```
WWWOFFLE
```
```
WWW-Collector-E
```
```
Xaldon
```
```
Xenu
```
```
Zeus
```
```
Zyborg
```
```
Nutch
```
```
Python-urllib
```
```
WinHTTP
```
```
DoCoMo
```
```
Zollard
```
```
AhrefsBot
```
```
aiHitBot
```
```
MJ12bot
```
```
HTTP_Request2
```
```
TweetmemeBot
```
```
ips-agent
```
```
masscan
```
```
IstellaBot
```
```
CRAZYWEBCRAWLER
```
```
sqlmap
```
```
SELECT
```
```
BLP_bbot
```
```
SemRush
```
```
Screaming Frog
```
```
Yandex
```
```
Baidu
```
```
Garlik
```
```
DomainCrawler
```
```
SeoScanners
```
```
Linguee Bot
```

Additional bots can be limited upon request. Contact the servicedesk to get a bot listed.

Page tree

Bots