nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-02-19 10:07:17 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
AIBOT
Abonti
Aboundexbot
AfD-Verbotsverfahren
Aipbot
Anarchy99
Backlink-Ceck
Blow
Brandprotect
Buddy
BuiltWith
CCBot
Calculon
Chlooe
Cosmos
Crawling at Home Project
DataCha0s
Digincore
Disco
Discoverybot
Dotbot
Evil
Extractor
EyeNetIE
Freeuploader
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
HTMLparser
Havij
Humanlinks
IRLbot
Iblog
Image Sucker
Iria
IstellaBot
LexiBot
LinkScan
LinkWalker
MIDown tool
MQQBrowser
MSFrontPage
MegaIndex.ru
Microsoft Data Access
Moblie Safari
Navroad
Netvibes
Ninja
Nmap
Offline Navigator
OpenLinkProfiler
OpenVAS
POE-Component-Client-HTTP
PageThing.com
Panscient
Petalbot
PictureFinder
PxBroker
QueryN Metasearch
RankActive
Rankivabot
Re-re
RebelMouse
Rogerbot
SalesIntelligent
Seekport
Sottopop
SpaceBison
SuperBot
Thumbor
TightTwatBot
TinyTestBot
TwengaBot
Upflow
WISENutbot
Web Fetch
Web Pix
Web Sauger
WebBandit
WebCollage
WebCopier
WebImageCollector
WebLeacher
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zeus
Zitebot
arquivo-web-crawler
arquivo.pt
crawl.sogou.com
imagesift.com
isitwp.com
iubenda-radar
openai.com
scan.lol
seocompany.store
webprosbot