nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-27 22:08:03 +00:00

100 lines
1 KiB
Text

Aboundexbot
Alligator
Anarchie
Apexoo
AwarioBot
AwarioSmartBot
BBBike
BackStreet
Blackboard
Bolt
Buddy
CheTeam
Cogentbot
Crawling at Home Project
CyotekWebCopy
DigitalPebble
Fimap
GrabNet
GridBot
HTMLparser
HaosouSpider
HybridBot
IDBTE4M
Id-search
InfraSec Scanner
Internet Ninja
Iria
JetCar
Kozmosbot
Larbin
LibWeb
Likse
LinkpadBot
Lipperhey
Lipperhey Spider
Lmspider
MQQBrowser
Majestic SEO
Majestic-SEO
Mojolicious
Mozlila
Navroad
Needle
Nettrack
Ninja
Octopus
Offline Explorer
OpenVAS
PECL::HTTP
Page Analyzer
PeoplePal
Petalbot
Pixray
Pockey
ProWebWalker
RealDownload
SEOlyticsCrawler
ScanAlert
ScreenerBot
SemrushBot
SemrushBot-BA
SeoCherryBot
Site Sucker
SmartDownload
Sqlmap
Sqlworm
Stripper
Sucuri
Surfbot
T8Abot
TurnitinBot
VCI
VidibleScraper
Voil
WWW::Mechanize
Web Enhancer
Web Sucker
WebWhacker
WebZIP
Webshag
Website Quester
WebsiteQuester
Webster
WinHTTrack
Woobot
Wprecon
crawler.feedback
evc-batch
everyfeed-spider
heritrix
muhstik-scan
netEstate NE Crawler
polaris version
scan.lol
serpstatbot
sexsearcher
sitechecker.pro
sysscan
tAkeOut
webmeup-crawler