404checker
ADmantX
AfD-Verbotsverfahren
AIBOT
AiHitBot
Aipbot
Alexibot
AlphaBot
Apexoo
autoemailspider
Backlink-Ceck
backlink-check
BackWeb
Badass
BatchFTP
Battleztar Bazinga
BBBike
BDFetch
BetaBot
Bigfoot
Black Hole
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
CopyRightCheck
Copyscape
crawl.sogou.com
CrazyWebCrawler
Crescent
DBLBot
demandbase-bot
Deusu
Devil
DigitalPebble
DIIbot
Disco
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FlashGet
Flunky
Foobot
FyberSpider
GetWeb
Gotit
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeFX
Haansoft
Havij
HEADMasterSEO
Hloader
HTTP::Lite
HTTrack
Humanlinks
Iblog
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
Internet Ninja
IRLbot
IstellaBot
JamesBOT
Jbrofuzz
Jetty
JOC Web Spider
Joomla
Keyword Density
Lanshanbot
LeechFTP
LeechGet
Libwhisker
Linkdexbot
LinqiaRSSBot
Lipperhey
Lmspider
LNSpiderguy
Ltx71
MarkWatch
Masscan
Mata Hari
MauiBot
Meanpathbot
MeanPath Bot
MFC_Tear_Sample
Microsoft Data Access
MIIxpc
Mister PiX
Mr.4x3
MSIECrawler
muhstik-scan
Name Intelligence
Navroad
NetAnts
netEstate NE Crawler
NetMechanic
Nettrack
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
NPbot
oBot
Offline Explorer
Offline Navigator
Openvas
OrangeBot
PageAnalyzer
Page Analyzer
PageGrabber
Pandalytics
Panscient
Pavuk
PECL::HTTP
Picscout
Picsearch
Pockey
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Pump
Quick-Crawler
RankActiveLinkBot
RankFlex
Rankivabot
RebelMouse
RedesScrapy
ReGet
RepoMonkey
RocketCrawler
s1z.ru
SalesIntelligent
Scanbot
scan.lol
ScoutJet
Screaming
ScreenerBot
Searchestate
SemrushBot
SEOkicks
SeoSiteCheckup
SEOstats
sexsearcher
Siphon
SiteExplorer
Siteimprove
SiteSnagger
Site Sucker
Sitevigil
SlySearch
Snoopy
SocialRankIOBot
Sogou web spider
Spammen
Spanner
Spbot
Spinn3r
SputnikBot
spyfu
Sqworm
Steeler
Sucker
Sucuri
Swiftbot
TeleportPro
The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toata
trendiction.de
Turnitin
TwengaBot
Twice
URLy.Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
Voil
WBSearchBot
Webalta
Web Collage
WebCopier
Web Fuck
WebmasterWorldForumBot
WebPix
Web Pix
WebReaper
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
WebStripper
WebSucker
WebWhacker
Whack
Who.is Bot
Widow
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zeus
zgrab
ZyBorg