nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-04 22:07:13 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
AIBOT
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Alligator
Anarchie
Anarchy99
Ankit
Anthill
Aspiegel
Atomseobot
Attach
BBBike
BDCbot
BackDoorBot
BackStreet
Badass
Barkrowler
BatchFTP
BlackWidow
Blackboard
Blow
BlowFish
BotALot
Brandprotect
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
CCBot
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
DIIbot
DSearch
Deusu
Devil
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Flunky
Freeuploader
FrontPage
G-i-g-a-b-o-t
GetRight
GetWeb
GrabNet
Grabber
GrapeshotCrawler
GridBot
HTTP::Lite
Harvest
Heritrix
HybridBot
IDBTE4M
IRLbot
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JetCar
JustView
Keyword Density
LNSpiderguy
Larbin
Leap
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MQQBrowser
MSFrontPage
MTRobot
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
Nameprotect
NearSite
Nessus
NetSpider
NetZIP
Nettrack
Netvibes
Nmap
Offline Explorer
OnCrawl
OrangeSpider
OutclicksBot
PageGrabber
PeoplePal
Petalbot
Pi-Monster
Pimonster
Pixray
ProWebWalker
PxBroker
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScrepyBot
SemanticJuice
Semrush
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteSucker
SlySearch
SmartDownload
Sogou web spider
Spanner
Sqlmap
Sqlworm
Sqworm
Sucuri
SuperHTTP
Surfbot
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesoft
The Intraformant
Thumbor
Toata
Toweyabot
Tracemyfile
Trendiction
Typhoeus
URLy Warning
URLy.Warning
VB Project
Vagabondo
VelenPublicWebCrawler
Voltron
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
Wallpapers
Web Fetch
Web Pix
WebAuto
WebCopier
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebPix
WebReaper
WebWhacker
Webalta
Webshag
Website Quester
WebsiteExtractor
Widow
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zeus
ZmEu
ZoomBot
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
ips-agent
isitwp.com
iubenda-radar
meanpathbot
muhstik-scan
plumanalytics
polaris version
ripz
s1z.ru
sitechecker.pro
sogouspider
sysscan
tAkeOut
trendiction.com
trendiction.de
webgains-bot
webprosbot
x22Mozilla
xpymep1.exe