404checker
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator
ASPSeek
Asterias
AwarioRssBot
BackDoorBot
backlink-check
BacklinkCrawler
Bandit
BatchFTP
BDCbot
BDFetch
Bigfoot
BlowFish
BotALot
Brandprotect
Buddy
BunnySlippers
BuzzSumo
CazoodleBot
Cegbfeieh
CheTeam
Cloud mapping
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Copyscape
Cosmos
crawl.sogou.com
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
Demon
Deusu
Devil
DigitalPebble
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainSigmaCrawler
Download Wonder
EasyDL
Ebingbong
eCatch
ECCP/1.0
Ecxi
EMail Wolf
EroCrawler
evc-batch
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
facebookscraper
Fimap
Flunky
Foobot
FrontPage
FyberSpider
Genieo
GermCrawler
Getintent
Gigabot
G-i-g-a-b-o-t
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeshotCrawler
GT::WWW
Haansoft
Harvest
heritrix
Heritrix
IDBot
Image Fetch
Indy Library
instabid
Intelliseek
InterGET
InternetSeer
internetVista monitor
ips-agent
IRLbot
Iskanie
JamesBOT
Jetty
Joomla
Jorgee
JustView
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
Likse
Linkdexbot
LinkextractorPro
LinkScan
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan
Mass Downloader
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIIxpc
MJ12bot
Morfeus Fucking Scanner
Msrabot
Name Intelligence
Nameprotect
NearSite
Nessus
Netcraft
netEstate NE Crawler
NetSpider
NetZIP
NextGenSearchBot
NICErsPRO
NimbleCrawler
Nimbostratus
Nmap
Offline Explorer
OnCrawl
Openfind
Openvas
OpenVAS
OutclicksBot
Page Analyzer
PageScorer
Papa Foto
pcBrowser
PECL::HTTP
Picsearch
Pimonster
Pi-Monster
Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP
Probethenet
ProPowerBot
RankActive
RankFlex
Rankivabot
RealDownload
Reaper
RebelMouse
RedesScrapy
Ripper
Rogerbot
ScanAlert
scan.lol
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks
SEOlyticsCrawler
SEOprofiler
seoscanners
sexsearcher
Siphon
SiteExplorer
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SMTBot
Snake
Snapbot
SocialRankIOBot
Sogou web spider
SpankBot
Spanner
Spbot
Sqlworm
Steeler
SuperHTTP
Surfbot
SurveyBot
sysscan
Szukacz
tAkeOut
Teleport
Telesphorep
The Intraformant
Trendiction
trendiction.de
True_Robot
Turingos
TurnitinBot
TwengaBot
UnisterBot
URLy Warning
Vacuum
Virusdie
VoidEYE
WebBandit
Web Collage
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Sauger
WebStripper
WebZIP
WinHTTrack
Wonderbot
Woobot
Wotbox
x22Mozilla
YoudaoBot
Zade
zauba.io
ZmEu
ZyBorg