nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-10 22:08:00 +00:00

100 lines
1 KiB
Text

ADmantX
ASPSeek
AdsTxtCrawlerTP
AfD-Verbotsverfahren
AiHitBot
Alligator
AwarioSmartBot
BBBike
BackDoorBot
Badass
Bitacle
BuiltBotTough
CherryPicker
Custo
DBLBot
DTS Agent
DataCha0s
Dispatch
Drip
Ecxi
HTTP::Lite
HaosouSpider
Id-search
InfraSec Scanner
JamesBOT
JetCar
Jetty
Lanshanbot
Larbin
Leap
LeechGet
LexiBot
Libwhisker
Likse
LinkextractorPro
Lmspider
MIDown tool
MQQBrowser
MSFrontPage
MTRobot
MarkMonitor
Masscan
Microsoft Data Access
Mister PiX
Moblie Safari
Mojolicious
NetLyzer
NetSpider
Nibbler
Nikto
Nimbostratus
Offline Navigator
PECL::HTTP
PageThing.com
Pi-Monster
Pixray
Probethenet
PyCurl
RankActive
RankFlex
RankingBot
RankingBot2
ReGet
Screaming
SemanticJuice
SemrushBot-SWA
SiteSnagger
Siteimprove
SlySearch
SmartDownload
Snoopy
Spider_Bot/3.0
Sqlworm
SuperBot
TeleportPro
TightTwatBot
Trendictionbot
TurnitinBot
Twice
Upflow
WISENutbot
Web Sauger
WebEnhancer
WebGo IS
WebSauger
Widow
Zade
ZyBorg
archive.org_bot
clark-crawler
crawl.sogou.com
crawler4j
facebookscraper
heritrix
oBot
seostar
sexsearcher
sysscan
trendiction.com
webmeup-crawler