nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-13 10:20:57 +00:00

250 lines
2.7 KiB
Text

404enemy
ADmantX
Acunetix
AllSubmitter
Anarchy
Anarchy99
Apexoo
Aspiegel
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
BatchFTP
Bigfoot
Bitacle
Blackboard
BlowFish
Boardreader
Brandwatch
Buck
BunnySlippers
CATExplorador
CSHttp
Cegbfeieh
CheeseBot
ChinaClaw
Chlooe
Citoid
Collector
Copyscape
Cosmos
Crescent
Custo
DBLBot
DIIbot
DTS Agent
DataCha0s
Demon
DigitalPebble
Dirbuster
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
EMail Siphon
Ebingbong
Ecxi
EirGrabber
EroCrawler
Exabot
Extreme Picture Finder
Ezooms
Flunky
Foobot
Freeuploader
GetWeb
Go-Ahead-Got-It
Gotit
GrabNet
Grafula
HEADMasterSEO
Harvest
Heritrix
Humanlinks
HybridBot
IDBTE4M
IDBot
IndeedBot
InfoNaviRobot
Intelliseek
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jorgee
Jyxobot
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
Lftp
Likse
LinkScan
LinkWalker
LinkextractorPro
Litemage_walker
MSFrontPage
MSIECrawler
MTRobot
Majestic12
MarkWatch
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Needle
NetLyzer
NetMechanic
NetSpider
Netcraft
Nettrack
NimbleCrawler
Nimbostratus
Nmap
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
PHPCrawl
Pandalytics
Papa Foto
PeoplePal
PictureFinder
Pixray
Pockey
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot
RankurBot
ReGet
RebelMouse
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
ScoutJet
Searchestate
Seekport
SemanticJuice
SemrushBot
Seomoz
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
Snake
Sociscraper
Sosospider
Sottopop
Spammen
Spbot
SputnikBot
SuperBot
T0PHackTeam
TeleportPro
TheNomad
Trendiction
Turingos
Turnitin
Twice
URLy.Warning
Upflow
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers
WeSEE
Web Pix
Web Sauger
Web Sucker
WebAuto
WebFuck
WebGo IS
WebImageCollector
WebReaper
WebZIP
Webalta
Website Quester
WebsiteExtractor
WebsiteQuester
Whacker
Widow
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZumBot
adscanner
autoemailspider
backlink-check
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
instabid
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
probe-image-size
ripz
seocompany.store
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
trendiction.com
voyagerx.com
x22Mozilla
xpymep1.exe
zgrab