nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-31 10:06:49 +00:00

100 lines
1.1 KiB
Text

AlphaBot
Ankit
Apexoo
Asterias
AwarioSmartBot
BBBike
Backlink-Ceck
Barkrowler
BlackWidow
Blow
BotALot
Buddy
Calculon
ChatGPT-User
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Crescent
DTS Agent
Digincore
Discoverybot
DomCopBot
ExtLinksBot
FacebookBot
Firefox/7.0
FlashGet
Fyrebot
GermCrawler
GetRight
Grafula
HaosouSpider
Havij
Iblog
InternetMeasurement
Iria
IstellaBot
Keybot Translation-Search-Machine
Leap
LexiBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
MSFrontPage
MTRobot
Magnet
Masscan
Microsoft Data Access
Mister PiX
Musobot
NetAnts
NetSpider
NextGenSearchBot
OutclicksBot
OutfoxBot
Petalbot
PleaseCrawl
ProPowerBot
RSSingBot
SISTRIX
SemrushBot
SenutoBot
Shodan
Site Sucker
Sitevigil
SmartDownload
Spammen
Spbot
Spider_Bot
Surfbot
Telesphorep
Tracemyfile
VoidEYE
WASALive-Bot
WEBDAV
WISENutbot
WPScan
Web Sucker
WebFetch
WebGo IS
WebPix
WebWhacker
Website Quester
Whack
Xaldon WebSpider
YoudaoBot
Zermelo
cah.io.community
crawler.feedback
crawler4j
netEstate NE Crawler
openai.com
pcBrowser
scalaj-http
sitechecker.pro
sp_auditbot
sysscan
webpros.com
zauba.io