nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-31 10:07:10 +00:00

100 lines
1 KiB
Text

01h4x.com
Aboundexbot
AwarioRssBot
BLEXBot
Backlink-Ceck
BatchFTP
Bitacle
Blackboard
BlowFish
BotALot
Buck
BuiltWith
Calculon
Copier
Crawling at Home Project
Custo
DSearch
DTS Agent
ECCP/1.0
Fuzz
G-i-g-a-b-o-t
GT::WWW
GrapeshotCrawler
HaosouSpider
Hloader
HonoluluBot
LNSpiderguy
Larbin
LeechFTP
LibWeb
LieBaoFast
LinkScan
Lipperhey Spider
Ltx71
MIIxpc
MSIECrawler
MauiBot
Minefield
Moblie Safari
NetLyzer
Netcraft
Nimbostratus
Nutch
Offline Explorer
PHPCrawl
Pandalytics
Petalbot
ProPowerBot
RankingBot
RankingBot2
Re-re
RebelMouse
RedesScrapy
RocketCrawler
SalesIntelligent
Seomoz
SiteCheckerBotCrawler
Sitebeam
SmartDownload
Snoopy
Sociscraper
Sottopop
Spammen
SpankBot
Spanner
SuperHTTP
Suzuran
Telesoft
TinyTestBot
VCI
VelenPublicWebCrawler
WBSearchBot
Web Collage
WebBandit
WebPix
Webshag
WebsiteExtractor
Widow
WinHTTrack
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YaK
YoudaoBot
ZmEu
ZoomBot
arquivo.pt
evc-batch
heritrix
instabid
internetVista monitor
ips-agent
lwp-trivial
meanpathbot
mediawords
openai.com
probe-image-size
scalaj-http
sitechecker.pro
tAkeOut