nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-30 10:17:48 +00:00

250 lines
2.7 KiB
Text

404checker
80legs
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
Alexibot
AllSubmitter
Anarchie
Anarchy99
Anthill
Apexoo
Asterias
BBBike
BDCbot
BDFetch
BackWeb
Bandit
Barkrowler
BatchFTP
Bigfoot
BlackWidow
Blackboard
BlowFish
Brandwatch
Buddy
BuiltBotTough
BunnySlippers
CATExplorador
CCBot
Calculon
CensysInspect
CheeseBot
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Craftbot
Crawling at Home Project
Crescent
CrunchBot
CyotekWebCopy
DSearch
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Dirbuster
Discobot
Discoverybot
DnyzBot
DomCopBot
Download Wonder
EasyDL
EirGrabber
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Freeuploader
Fuzz
Fyrebot
GT::WWW
GermCrawler
GetRight
GetWeb
Getintent
GoZilla
Gotit
GrabNet
GrapeFX
GrapeshotCrawler
HMView
HaosouSpider
Harvest
HybridBot
IDBot
Id-search
IlseBot
Image Sucker
InfoNaviRobot
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JetCar
Jorgee
Kenjin Spider
LinqiaMetadataDownloaderBot
Lmspider
MIIxpc
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Microsoft Data Access
Mojeek
NPbot
Name Intelligence
Navroad
Needle
NetLyzer
NetMechanic
NetZIP
Nettrack
Niki-bot
Nikto
Nmap
Offline Explorer
Openfind
Openvas
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
Petalbot
Pi-Monster
Piepmatz
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pump
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SEOlyticsCrawler
SEOstats
Scanbot
Scrapy
ScreenerBot
Searchestate
SemrushBot
SeobilityBot
Siphon
SiteLockSpider
Sitevigil
Snoopy
SpaceBison
Spammen
Spinn3r
SputnikBot
Sqlworm
Steeler
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
Thumbor
Titan
Toweyabot
Trendictionbot
True_Robot
TurnitinBot
Typhoeus
V-BOT
VB Project
Vacuum
Vagabondo
VidibleScraper
Voltron
WASALive-Bot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sucker
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebLeacher
WebPix
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WiseGuys Robot
Wprecon
Xaldon WebSpider
YoudaoBot
Zade
Zeus
ZoomBot
ZyBorg
archive.org_bot
autoemailspider
cah.io.community
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
demandbase-bot
domainsproject.org
facebookscraper
heritrix
instabid
internetVista monitor
magpie-crawler
mediawords
probe-image-size
ripz
seoscanners
sexsearcher
sitechecker.pro
sp_auditbot
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe