nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-11 22:07:32 +00:00

250 lines
2.5 KiB
Text

360Spider
404checker
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchy
Apexoo
Asterias
Attach
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle
Blow
BlowFish
BotALot
Brandwatch
Buck
Buddy
BuiltWith
BunnySlippers
CCBot
CODE87
ChinaClaw
Cliqzbot
Cocolyzebot
Copier
Copyscape
Cosmos
Craftbot
Curious
DBLBot
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
Dirbuster
Disco
DnBCrawler-Analytics
DomainSigmaCrawler
DomainStatsBot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
Evil
Express WebPictures
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Flunky
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grafula
GrapeshotCrawler
HTMLparser
Haansoft
HaosouSpider
Harvest
Iblog
IndeedBot
Indy Library
Internet Ninja
InternetSeer
Iria
JOC Web Spider
Jetty
Jorgee
Jyxobot
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Leap
LeechFTP
LibWeb
Libwhisker
Likse
LinkScan
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Litemage_walker
MIDown tool
MSFrontPage
Mag-Net
MarkMonitor
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
Musobot
NPbot
Nessus
NetAnts
NetMechanic
NetSpider
Niki-bot
NimbleCrawler
Ninja
Nmap
Nutch
Offline Explorer
Offline Navigator
Openvas
PHPCrawl
Panscient
Pavuk
PeoplePal
Petalbot
Pimonster
Pixray
ProPowerBot
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Rankivabot
Re-re
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
Scanbot
Screaming
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Siteimprove
Snapbot
Snoopy
Sosospider
SpankBot
Stripper
SuperHTTP
Surfbot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
Teleport
Thumbor
Toata
Trendiction
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
Upflow
V-BOT
VCI
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Fuck
Web Pix
Web Sucker
WebFetch
WebPix
WebReaper
WebZIP
Webshag
WebsiteExtractor
Webster
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
Xaldon WebSpider
Xenu
Zade
Zauba
Zermelo
Zeus
ZmEu
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
com.plumanalytics
evc-batch
gopher
instabid
isitwp.com
lwp-trivial
magpie-crawler
page scorer
polaris version
satoristudio.net
seobility
serpstatbot
sitechecker.pro
siteripz
sp_auditbot
trendiction.com
trendiction.de
voyagerx.com
webpros.com
x09Mozilla
zgrab