nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-03 10:07:26 +00:00

100 lines
1.1 KiB
Text

404checker
ADmantX
Aipbot
BacklinkCrawler
Chlooe
Copyscape
Craftbot
CrazyWebCrawler
DSearch
DittoSpyder
DomainSigmaCrawler
EMail Siphon
Ebingbong
Evil
Exabot
Freeuploader
GermCrawler
Go!Zilla
Gotit
GrabNet
GrapeshotCrawler
HaosouSpider
Humanlinks
InternetSeer
JamesBOT
JikeSpider
LNSpiderguy
Lanshanbot
Libwhisker
Likse
LinksManager
MFC_Tear_Sample
MSFrontPage
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mr.4x3
Msrabot
Net Vampire
NetMechanic
NetSpider
Nettrack
Offline Explorer
Offline Navigator
OpenVAS
Pandalytics
Piepmatz
ProPowerBot
Pump
PxBroker
RankurBot
ReGet
RealDownload
RebelMouse
RepoMonkey
SISTRIX
SalesIntelligent
ScoutJet
Seekport
Semrush
Shodan
Snake
SpankBot
Spbot
SuperBot
Toata
Turingos
Turnitin
TwengaBot
Voil
WASALive-Bot
WWW-Mechanize
Wallpapers/3.0
Web Fetch
Web Pix
Web Sucker
WebCopier
WebEnhancer
WebGo IS
Webshag
Website Quester
Whatweb
WiseGuys Robot
Zitebot
archive.org_bot
check1.exe
coccocbot
evc-batch
ips-agent
iubenda-radar
meanpathbot
oBot
seobility
sitechecker.pro
sogouspider
spyfu
trendiction.de
x09Mozilla
x22Mozilla