nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-29 10:07:04 +00:00

100 lines
1.1 KiB
Text

AIBOT
Aboundex
Anarchy
AwarioSmartBot
BackWeb
Bigfoot
Blackboard
CSHttp
Calculon
CazoodleBot
CheeseBot
CrazyWebCrawler
Curious
DomainCrawler
Ebingbong
Ecxi
FDM
Fuzz
G-i-g-a-b-o-t
GPTBot
GalaxyBot
GetRight
Go!Zilla
Go-Ahead-Got-It
HEADMasterSEO
HTMLparser
Harvest
HybridBot
Iblog
InternetSeer
JOC Web Spider
JikeSpider
Jorgee
LNSpiderguy
LibWeb
Libwhisker
Ltx71
MTRobot
Masscan
Mb2345Browser
MicroMessenger
Microsoft Data Access
Minefield
Mojeek
Mojolicious
NICErsPRO
Nameprotect
NetZIP
NextGenSearchBot
Nmap
OrangeBot
Picsearch
ScrepyBot
Semrush
SemrushBot
SeoSiteCheckup
Site Sucker
SiteLockSpider
Siteimprove
SlySearch
SocialRankIOBot
Sottopop
SpankBot
Steeler
Telesoft
Trendictionbot
URLy Warning
VB Project
VeriCiteCrawler
Virusdie
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Auto
Web Fetch
Web Pix
Web Sauger
WebFetch
WebGo IS
WebmasterWorldForumBot
Whack
Wonderbot
Zade
ZyBorg
archive.org_bot
arquivo-web-crawler
check1.exe
crawler4j
evc-batch
lwp-trivial
muhstik-scan
scalaj-http
seoscanners
sitechecker.pro
siteripz
spyfu
sysscan
ubermetrics-technologies.com
x09Mozilla