nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-26 10:07:44 +00:00

100 lines
1 KiB
Text

Aboundexbot
Aipbot
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
Badass
BetaBot
Blackboard
Boardreader
Bolt
BunnySlippers
Chlooe
CopyRightCheck
Craftbot
Devil
DigitalPebble
DomCopBot
DomainAppender
ExtractorPro
FHscan
FacebookBot
GetWeb
Gigabot
Grabber
GrapeFX
HTMLparser
HTTP::Lite
Hloader
IDBTE4M
Image Fetch
ImagesiftBot
InfoNaviRobot
InfraSec Scanner
Intelliseek
InterGET
JOC Web Spider
LinkScan
MIDown tool
MSIECrawler
MTRobot
Mag-Net
Majestic12
MarkWatch
MeanPath Bot
Minefield
Moblie Safari
Mojolicious
NPbot
Netcraft
Netvibes
Nikto
Ninja
Offline Explorer
Offline Navigator
PageGrabber
Pavuk
Picscout
RankingBot
Rankivabot
RealDownload
ScoutJet
SeekportBot
SemrushBot
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SpankBot
Spbot
SputnikBot
Swiftbot
True_Robot
Twice
UnisterBot
Vagabondo
VidibleScraper
WWW-Collector-E
WWW::Mechanize
Web Pix
WebFetch
WebGo IS
WebLeacher
WebSauger
WebmasterWorldForumBot
Website Quester
WinHTTrack
Xenu
Zauba
Zermelo
anthropic-ai
instabid
linkfluence
mediawords
s1z.ru
scalaj-http
sexsearcher
sp_auditbot
xpymep1.exe