404checker
404enemy
Abonti
ADmantX
AIBOT
AiHitBot
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
Apexoo
archive.org_bot
arquivo-web-crawler
Aspeigel
Asterias
Attach
autoemailspider
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
Barkrowler
BatchFTP
BDFetch
BetaBot
Bitacle
Blackboard
Black Hole
BlackWidow
BLEXBot
Boardreader
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CCBot
Chlooe
Claritybot
cognitiveseo
Copier
CopyRightCheck
Copyscape
crawler4j
crawl.sogou.com
Custo
DatabaseDriverMysqli
Devil
Digincore
DigitalPebble
Discoverybot
DittoSpyder
DomainSigmaCrawler
Dotbot
eCatch
Ecxi
EroCrawler
evc-batch
Evil
Extractor
FDM
FemtosearchBot
Fimap
Flunky
Freeuploader
FyberSpider
Fyrebot
Genieo
GermCrawler
GetWeb
G-i-g-a-b-o-t
Gotit
Go!Zilla
GrabNet
GrapeFX
GridBot
HaosouSpider
Heritrix
Hloader
HTTrack
Humanlinks
Id-search
InfoNaviRobot
InfoTekies
instabid
Intelliseek
Internet Ninja
Iria
IRLbot
Iskanie
JamesBOT
Jetty
JikeSpider
JustView
Kinza
Kozmosbot
Larbin
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Magnet
Mail.RU_Bot
MarkWatch
Mata Hari
Mb2345Browser
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
MIDown tool
MJ12bot
Mojeek
MSFrontPage
MSIECrawler
muhstik-scan
NearSite
Nessus
Netcraft
NetMechanic
Net Vampire
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Octopus
Offline Explorer
Openvas
OPPO A33
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
page scorer
Pavuk
pcBrowser
PeoplePal
Pi-Monster
Pixray
plumanalytics
POE-Component-Client-HTTP
polaris version
Probethenet
ProPowerBot
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankActive
Reaper
Ripper
RocketCrawler
Rogerbot
s1z.ru
scan.lol
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SEOkicks-Robot
Seomoz
SEOprofiler
SeoSiteCheckup
serpstatbot
sexsearcher
Siphon
SISTRIX
Site Sucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sociscraper
SpaceBison
Spammen
spyfu
Sqlmap
Steeler
Stripper
SuperBot
Szukacz
T0PHackTeam
tAkeOut
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
Titan
Toata
Toweyabot
True_Robot
Turingos
Turnitin
TurnitinBot
VeriCiteCrawler
VidibleScraper
Voil
WallpapersHD
WBSearchBot
Web Auto
WebBandit
Web Collage
WebCopier
WebEnhancer
Web Enhancer
Web Fuck
WebmasterWorldForumBot
webmeup-crawler
Web Pix
Web Sauger
Webshag
WebsiteExtractor
Webster
WebWhacker
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zermelo
zgrab