nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-09 07:13:44 +00:00

250 lines
2.5 KiB
Text

80legs
ADmantX
AIBOT
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchy
Anthill
Apexoo
Asterias
AwarioRssBot
BDCbot
BLEXBot
BackStreet
BackWeb
BacklinkCrawler
BatchFTP
BetaBot
Bigfoot
BlowFish
Bolt
Buck
BunnySlippers
BuzzSumo
CCBot
CODE87
Calculon
CensysInspect
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Cosmos
Craftbot
CrazyWebCrawler
Curious
CyotekWebCopy
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Dirbuster
Disco
Discobot
DittoSpyder
DomainCrawler
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
Evil
Express WebPictures
Extractor
EyeNetIE
FDM
FemtosearchBot
Fimap
Fuzz
FyberSpider
Genieo
GetWeb
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
GrapeFX
GridBot
HMView
IDBot
IRLbot
IlseBot
InfoTekies
InterGET
Iria
Jetty
JikeSpider
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
LeechFTP
LexiBot
Lightspeedsystems
Likse
LinkpadBot
Lipperhey Spider
Ltx71
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Mr.4x3
Name Intelligence
Net Vampire
NetLyzer
NetSpider
Nettrack
Nibbler
Nikto
NimbleCrawler
Ninja
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
PECL::HTTP
Page Analyzer
PageScorer
PageThing.com
Panscient
PeoplePal
Petalbot
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
Probethenet
Psbot
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
Reaper
Recorder
RepoMonkey
RocketCrawler
SalesIntelligent
Scanbot
Screaming
ScrepyBot
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
Site Sucker
Siteimprove
Sitevigil
SlySearch
Snake
Sociscraper
SpankBot
SputnikBot
Sqlworm
Sqworm
SuperBot
Suzuran
Teleport
The Intraformant
TheNomad
TightTwatBot
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WEBDAV
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Enhancer
Web Fetch
WebAuto
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebSauger
WebWhacker
WebZIP
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wprecon
Zitebot
ZmEu
ZoomBot
ZoominfoBot
check1.exe
cognitiveseo
crawl.sogou.com
crawler4j
eCatch
evc-batch
instabid
internetVista monitor
isitwp.com
lwp-request
meanpathbot
oBot
page scorer
pcBrowser
plumanalytics
polaris version
ripz
seobility
seostar
serpstatbot
sogouspider
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
x22Mozilla