404checker
80legs
ADmantX
AIBOT
ALittle Client
Aboundex
AhrefsBot
Aipbot
Anarchy
Anthill
AwarioRssBot
AwarioSmartBot
BDCbot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
BetaBot
Bigfoot
BlackWidow
Blackboard
BlowFish
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CheeseBot
Cliqzbot
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
Curious
DTS Agent
DatabaseDriverMysqli
Demon
Devil
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnyzBot
DomainCrawler
Drip
ECCP/1.0
EMail Siphon
Ebingbong
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
FDM
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
GoZilla
Gotit
GrabNet
HEADMasterSEO
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Hloader
Humanlinks
HybridBot
Iblog
Id-search
IndeedBot
InfoNaviRobot
InterGET
InternetSeer
Iria
Iskanie
IstellaBot
JustView
Kinza
LNSpiderguy
LWP::Simple
Larbin
Lftp
LibWeb
Libwhisker
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Majestic-SEO
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mozlila
NPbot
NetLyzer
NetSpider
NetZIP
Netcraft
Netvibes
Nibbler
Niki-bot
Nikto
Nutch
OnCrawl
OpenLinkProfiler
OrangeBot
OutclicksBot
PageAnalyzer
Papa Foto
Pi-Monster
PleaseCrawl
Pockey
ProPowerBot
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Reaper
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOstats
SMTBot
SalesIntelligent
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
Spanner
Steeler
Sucker
SuperBot
SurveyBot
Swiftbot
Teleport
TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Tracemyfile
TurnitinBot
URLy.Warning
VB Project
Vacuum
VeriCiteCrawler
WBSearchBot
WPScan
WWW::Mechanize
Wallpapers/3.0
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebFuck
WebGo IS
WebPix
WebSucker
WebWhacker
WebsiteQuester
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
Xenu
Zauba
Zitebot
ZmEu
ZoomBot
autoemailspider
check1.exe
coccocbot-web
crawler4j
dataforseo.com
demandbase-bot
heritrix
instabid
internetVista monitor
netEstate NE Crawler
oBot
page scorer
polaris version
s1z.ru
satoristudio.net
seobility
seoscanners
serpstatbot
sexsearcher
sp_auditbot
spyfu
tAkeOut
voyagerx.com
x09Mozilla
x22Mozilla
zgrab