nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-14 10:07:38 +00:00

100 lines
1 KiB
Text

404checker
80legs
AIBOT
Anarchy
Apexoo
BackDoorBot
Boardreader
Bolt
BotALot
Brandprotect
BuzzSumo
CODE87
CazoodleBot
CensysInspect
Chlooe
Citoid
Claritybot
Curious
Custo
Devil
DomainStatsBot
Dotbot
EroCrawler
Extreme Picture Finder
FDM
GetRight
Grafula
Image Sucker
InfoNaviRobot
InfoTekies
Iria
Iskanie
JustView
Keybot Translation-Search-Machine
Keyword Density
LeechGet
Lightspeedsystems
LinksManager
Ltx71
MJ12bot
Magnet
Majestic12
MicroMessenger
Mojeek
Nameprotect
Needle
NetMechanic
Netcraft
PECL::HTTP
PageThing.com
Papa Foto
Piepmatz
Pimonster
Pixray
Pockey
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RealDownload
RocketCrawler
Rogerbot
SalesIntelligent
ScoutJet
Scrapy
SemanticJuice
SeobilityBot
Siphon
Sociscraper
SpankBot
Sqlworm
Sqworm
Sucker
Sucuri
Suzuran
T0PHackTeam
TeleportPro
The Intraformant
Turnitin
TurnitinBot
UnisterBot
Vagabondo
WEBDAV
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Enhancer
WebEnhancer
WebWhacker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
WinHTTrack
Xenu
ZoomBot
eCatch
page scorer
spyfu
x22Mozilla
zgrab