nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-12 10:07:10 +00:00

100 lines
1,016 B
Text

80legs
Abonti
Aboundex
Acunetix
AdsTxtCrawlerTP
AhrefsBot
Aipbot
Anarchy99
Ankit
Anthill
BackDoorBot
Black Hole
Boardreader
Buddy
BuiltBotTough
ChinaClaw
Chlooe
Demon
Deusu
Dirbuster
DnyzBot
DomCopBot
ECCP/1.0
Ebingbong
EirGrabber
Fimap
Freeuploader
Genieo
Grafula
Havij
Humanlinks
HybridBot
Image Fetch
Indy Library
Intelliseek
JOC Web Spider
JamesBOT
JustView
Leap
Likse
Magnet
Mail.RU_Bot
MauiBot
Mb2345Browser
Moblie Safari
Mozlila
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
NetZIP
Ninja
Offline Explorer
Openfind
PageGrabber
PageScorer
PleaseCrawl
Pu_iN
Re-re
Screaming
ScreenerBot
SenutoBot
Seomoz
SiteSnagger
Snoopy
Sosospider
SpaceBison
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TinyTestBot
True_Robot
Turnitin
TurnitinBot
V-BOT
VCI
Vacuum
VelenPublicWebCrawler
WASALive-Bot
WEBDAV
WeSEE
Web Auto
Web Sauger
clark-crawler
crawler4j
dataforseo.com
domainsproject.org
instabid
isitwp.com
iubenda-radar
lwp-request
mediawords
oBot
plumanalytics
serpstatbot
sexsearcher
trendiction.com
x22Mozilla