nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-19 10:14:14 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
Aboundex
Alligator
Apexoo
BackStreet
Blackboard
Brandwatch
Bullseye
Bytespider
CensysInspect
Cloud mapping
Cocolyzebot
Cogentbot
Craftbot
Curious
Deusu
DomainAppender
Domains Project
ExtractorPro
FlashGet
Freeuploader
Genieo
Gigabot
GrapeshotCrawler
HTTP::Lite
Iblog
InfoTekies
Intelliseek
Iria
Iskanie
JennyBot
JetCar
Kozmosbot
LeechFTP
Libwhisker
LieBaoFast
LinqiaRSSBot
Litemage_walker
MSFrontPage
MSIECrawler
Majestic12
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mozlila
Musobot
NetLyzer
NetMechanic
NetSpider
Nimbostratus
Nmap
Openfind
OrangeBot
OrangeSpider
OutclicksBot
Pandalytics
ProWebWalker
Psbot
RSSingBot
Rainbot
Rankivabot
RealDownload
Recorder
SEOkicks
Searchestate
SeekportBot
Semrush
SemrushBot
SemrushBot-FT
SemrushBot-SWA
SentiBot
Seomoz
Site Sucker
Sociscraper
Sogou web spider
Sqlmap
Toata
True_Robot
Typhoeus
WBSearchBot
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Fuck
WebEnhancer
Whacker
Woobot
Zauba
crawler.feedback
facebookscraper
instabid
linkfluence
polaris version
ripz
sexsearcher
spyfu
tAkeOut
webmeup-crawler