nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-03 22:07:16 +00:00

250 lines
2.6 KiB
Text

AIBOT
ALittle Client
Aboundex
Acunetix
AhrefsBot
Alligator
AlphaBot
Anarchy99
Atomseobot
BBBike
BDCbot
BLEXBot
BackWeb
BatchFTP
BetaBot
Bitacle
Blackboard
Bolt
Brandwatch
Buck
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
ChinaClaw
Citoid
Claritybot
CyotekWebCopy
DIIbot
Deusu
Digincore
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Download Wonder
Drip
EMail Siphon
EMail Wolf
EasyDL
EroCrawler
Exabot
Express WebPictures
Extreme Picture Finder
Flunky
Foobot
Freeuploader
Fuzz
G-i-g-a-b-o-t
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
GridBot
HTTP::Lite
Haansoft
Harvest
Heritrix
HonoluluBot
HybridBot
IRLbot
Id-search
IlseBot
InfoNaviRobot
Intelliseek
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
Jetty
Jyxobot
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
LinkpadBot
LinqiaScrapeBot
Lipperhey
Ltx71
Mag-Net
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
MolokaiBot
Musobot
Name Intelligence
Net Vampire
NetLyzer
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Not
Offline Explorer
Offline Navigator
OnCrawl
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
PageAnalyzer
Pandalytics
Papa Foto
Petalbot
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot
ProWebWalker
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
RebelMouse
RedesScrapy
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SMTBot
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
Seekport
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteCheckerBotCrawler
SiteSucker
Sitevigil
Snapbot
Sogou web spider
SpaceBison
Spammen
Spbot
Spinn3r
SputnikBot
Steeler
Stripper
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
TheNomad
Thumbor
Toata
Tracemyfile
True_Robot
Turingos
TwengaBot
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebFuck
WebPix
WebReaper
WebStripper
Website Quester
Webster
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
gopher
instabid
linkdexbot
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
probe-image-size
s1z.ru
scalaj-http
seocompany.store
serpstatbot
sexsearcher
sogouspider
sp_auditbot
spyfu
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
zauba.io