nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-29 22:08:27 +00:00

250 lines
2.5 KiB
Text

360Spider
404checker
AIBOT
Acunetix
Alligator
AlphaBot
Anarchy
Anthill
Apexoo
Aspiegel
AwarioRssBot
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
BetaBot
Blackboard
Brandprotect
Buck
Buddy
BuiltBotTough
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
Cegbfeieh
Cogentbot
Copier
Copyscape
CrunchBot
DBLBot
DatabaseDriverMysqli
Devil
Dirbuster
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
Dotbot
Dragonfly
ECCP/1.0
Ebingbong
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Fimap
FrontPage
Fyrebot
Genieo
GetRight
Gigabot
Go!Zilla
GrabNet
Grabber
GrapeFX
HMView
Haansoft
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
IlseBot
Image Fetch
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iria
Iskanie
Jetty
JikeSpider
Joomla
JustView
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Lftp
LinkScan
Linkbot
LinksManager
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
MauiBot
Mb2345Browser
Mediatoolkitbot
Mister PiX
Mojolicious
Needle
Net Vampire
NetAnts
NetMechanic
Netvibes
Nibbler
Nimbostratus
Ninja
Nuclei
Nutch
Octopus
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Panscient
PeoplePal
Pi-Monster
Piepmatz
Pockey
Psbot
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
Rankivabot
Reaper
Recorder
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
Scanbot
ScoutJet
Screaming
ScrepyBot
SearchmetricsBot
SemrushBot
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
Snapbot
Sociscraper
Sosospider
SpaceBison
Spammen
SpankBot
Spanner
Sqlworm
Sqworm
Steeler
Sucker
Sucuri
Surfbot
SurveyBot
TeleportPro
Telesoft
Telesphoreo
TheNomad
Titan
Toweyabot
Tracemyfile
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy Warning
Upflow
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Auto
Web Pix
Web Sucker
WebCollage
WebCopier
WebEnhancer
WebLeacher
WebReaper
WebStripper
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Whacker
Widow
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Zauba
Zeus
ZumBot
ZyBorg
arquivo-web-crawler
autoemailspider
backlink-check
coccocbot-web
cognitiveseo
com.plumanalytics
demandbase-bot
evc-batch
facebookscraper
instabid
ips-agent
isitwp.com
lwp-trivial
netEstate NE Crawler
oBot
ripz
scan.lol
sexsearcher
sitechecker.pro
siteripz
sp_auditbot
webpros.com
x09Mozilla
x22Mozilla
zauba.io