nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-31 10:07:15 +00:00

100 lines
1 KiB
Text

404enemy
80legs
ASPSeek
Alligator
Bolt
Buddy
BuzzSumo
Calculon
CazoodleBot
CheeseBot
Citoid
Claritybot
ClaudeBot
Cosmos
Crawling at Home Project
DSearch
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomCopBot
Ecxi
EirGrabber
Extractor
FemtosearchBot
FlashGet
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GrapeshotCrawler
HTTrack
Heritrix
Image Sucker
InfraSec Scanner
InternetMeasurement
JetCar
Lipperhey Spider
MTRobot
MarkMonitor
MauiBot
Metauri
Microsoft URL Control
Minefield
Moblie Safari
Mozlila
Name Intelligence
Nettrack
Netvibes
NimbleCrawler
PageGrabber
Panscient
Papa Foto
PyCurl
Rankivabot
Re-re
RepoMonkey
ScreenerBot
SentiBot
SiteSucker
Sitebeam
Sosospider
Sottopop
SpaceBison
SpankBot
Sqlworm
Swiftbot
Thumbor
True_Robot
UnisterBot
Vacuum
Vagabondo
Virusdie
VoidEYE
WEBDAV
WISENutbot
WWW-Mechanize
WebFetch
WebReaper
Website Quester
Wonderbot
Wprecon
Xaldon_WebSpider
YaK
Zauba
Zitebot
adscanner
clark-crawler
demandbase-bot
evc-batch
heritrix
instabid
muhstik-scan
ripz
s1z.ru
scalaj-http
scan.lol
sexsearcher
sogouspider
voyagerx.com
webpros.com
zauba.io