Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

We are currently blocking the following bots from doing any HTTP Requests:

  • AESOP_com_SpiderMan

  • Alexibot

  • Anonymouse.org

  • asterias

  • attach

  • BackDoorBot

  • BackWeb

  • bandit

  • Baiduspider

  • BatchFTP

  • Bigfoot

  • Black.Hole

  • BlackWidow

  • BlowFish

  • Bot

    mailto:craftbot@yahoo.com

  • BotALot

  • Buddy

  • BuiltBotTough

  • Bullseye

  • BunnySlippers

  • Cegbfeieh

  • CheeseBot

  • CherryPicker

  • ChinaClaw

  • Collector

  • Copier

  • CopyRightCheck

  • cosmos

  • Crescent

  • Custo

  • DA

  • DISCo

  • DIIbot

  • DittoSpyder

  • Download

  • Download

    Demon

  • Download

    Devil

  • Download

    Wonder

  • Downloader

  • dragonfly

  • Drip

  • DuckDuckBot

  • eCatch

  • EasyDL

  • ebingbong

  • EirGrabber

  • EmailCollector

  • EmailSiphon

  • EmailWolf

  • EroCrawler

  • Exabot

  • Express

    WebPictures

  • Extractor

  • EyeNetIE

  • FileHound

  • FlashGet

  • Foobot

  • flunky

  • FrontPage

  • GetRight

  • GetSmart

  • GetWeb!

  • Go!Zilla

  • Google

    Wireless

    Transcoder

  • Go-Ahead-Got-It

  • gotit

  • Grabber

  • GrabNet

  • Grafula

  • Harvest

  • hloader

  • HMView

  • httplib

  • HTTrack

  • humanlinks

  • ia_archiver

  • IlseBot

  • Image

    Stripper

  • Image

    Sucker

  • InfoNaviRobot

  • InfoTekies

  • Intelliseek

  • InterGET

  • Internet

    Ninja

  • Iria

  • JennyBot

  • JetCar

  • JOC

  • JustView

  • Jyxobot

  • Kenjin.Spider

  • Keyword.Density

  • larbin

  • LeechFTP

  • LexiBot

  • lftp

  • libWeb/clsHTTP

  • likse

  • LinkextractorPro

  • LinkScan/8.1a.Unix

  • LNSpiderguy

  • LinkWalker

  • lwp-trivial

  • LWP::Simple

  • Magnet

  • Mag-Net

  • MarkWatch

  • Mass

    Downloader

  • Mata.Hari

  • Memo

  • Microsoft.URL

  • Microsoft

    URL

    Control

  • MIDown

    tool

  • MIIxpc

  • Mirror

  • Missigua

    Locator

  • Mister

    PiX

  • moget

  • Mozilla/3.Mozilla/2.01

  • MozillaNEWT

  • NAMEPROTECT

  • Navroad

  • NearSite

  • NetAnts

  • Netcraft

  • NetMechanic

  • NetSpider

  • Net

    Vampire

  • NetZIP

  • NextGenSearchBot

  • NG

  • NICErsPRO

  • NimbleCrawler

  • Ninja

  • NPbot

  • Octopus

  • Offline

    Explorer

  • Offline

    Navigator

  • Openfind

  • OutfoxBot

  • PageGrabber

  • Papa

    Foto

  • pavuk

  • pcBrowser

  • PHP

    version

    tracker

  • Pockey

  • ProPowerBot/2.14

  • ProWebWalker

  • psbot

  • Pump

  • QueryN.Metasearch

  • RealDownload

  • Reaper

  • Recorder

  • ReGet

  • RepoMonkey

  • RMA

  • Siphon

  • sitecheck.internetseer.com

  • SiteSnagger

  • SlySearch

  • SmartDownload

  • Snake

  • Snapbot

  • Snoopy

  • sogou

  • SpaceBison

  • SpankBot

  • spanner

  • Sqworm

  • Stripper

  • Sucker

  • SuperBot

  • SuperHTTP

  • Surfbot

  • suzuran

  • Szukacz/1.4

  • tAkeOut

  • Teleport

  • Telesoft

  • TurnitinBot/1.5

  • The.Intraformant

  • TheNomad

  • TightTwatBot

  • Titan

  • toCrawl/UrlDispatcher

  • True_Robot

  • turingos

  • TurnitinBot

  • URLy.Warning

  • Vacuum

  • VCI

  • VoidEYE

  • Web

    Image

    Collector

  • Web

    Sucker

  • WebAuto

  • Webbandit

  • Webclipping.com

  • WebCopier

  • WebEMailExtrac

  • WebEnhancer

  • WebFetch

  • WebGo

    IS

  • Web.Image.Collector

  • WebLeacher

  • WebmasterWorldForumBot

  • WebReaper

  • WebSauger

  • WebSite

  • Website

    eXtractor

  • Website

    Quester

  • Webster

  • WebStripper

  • WebWhacker

  • WebZIP

  • Whacker

  • Widow

  • WISENutbot

  • WWWOFFLE

  • WWW-Collector-E

  • Xaldon

  • Xenu

  • Zeus

  • Zyborg

  • Nutch

  • Python-urllib

  • WinHTTP

  • DoCoMo

  • Zollard

  • AhrefsBot

  • aiHitBot

  • MJ12bot

  • HTTP_Request2

  • TweetmemeBot

  • ips-agent

  • masscan

  • IstellaBot

  • CRAZYWEBCRAWLER

  • sqlmap

  • SELECT

  • BLP_bbot

  • SemRush

  • Screaming

    Frog

  • Yandex

  • Baidu

  • Garlik

  • DomainCrawler

  • SeoScanners

  • Linguee

    Bot

Additional bots can be limited upon request. Contact the servicedesk to get a bot listed.