nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-26 22:08:49 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
Abonti
Acunetix
AiHitBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchie
Ankit
Anthill
Asterias
Attach
AwarioRssBot
BDFetch
BackDoorBot
Black Hole
Blackboard
BlowFish
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
BunnySlippers
Calculon
CazoodleBot
Cogentbot
Collector
Copier
Copyscape
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
Dispatch
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Drip
EMail Wolf
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTrack
Iblog
IlseBot
InfoTekies
InterGET
Iskanie
JOC Web Spider
Kozmosbot
LeechGet
Lftp
LibWeb
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mozlila
Mr.4x3
Musobot
NPbot
Name Intelligence
Navroad
NetLyzer
NetZIP
NextGenSearchBot
Nibbler
Nikto
Ninja
Nuclei
Octopus
Openfind
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
PageThing.com
Papa Foto
PeoplePal
Picscout
Picsearch
Pixray
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScanAlert
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteSnagger
Siteimprove
SlySearch
Snoopy
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sucker
SuperHTTP
Surfbot
SurveyBot
Swiftbot
T8Abot
Teleport
Telesoft
Telesphorep
Toata
Trendiction
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
VCI
VidibleScraper
Virusdie
VoidEYE
WEBDAV
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
Web Sauger
WebBandit
WebLeacher
WebSauger
WebStripper
Webalta
Website Quester
WebsiteQuester
Webster
Whack
Widow
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
ZmEu
ZoomBot
ZoominfoBot
archive.org_bot
autoemailspider
backlink-check
cah.io.community
crawler4j
dataforseo.com
demandbase-bot
eCatch
gopher
instabid
ips-agent
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
scalaj-http
scan.lol
seostar
sitechecker.pro
siteripz
trendiction.com
trendiction.de
ubermetrics-technologies.com
webprosbot
x09Mozilla