nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-26 10:09:03 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
AlphaBot
Anarchy99
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BackStreet
Backlink-Ceck
Badass
Barkrowler
BetaBot
Bitacle
Blow
BlowFish
Brandprotect
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CSHttp
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Chlooe
Citoid
Claritybot
Cliqzbot
Cloud mapping
Copyscape
Crescent
CrunchBot
Custo
DBLBot
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Demon
Dirbuster
Disco
Discoverybot
DittoSpyder
DomCopBot
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
Evil
EyeNetIE
FDM
FHscan
Fimap
Firefox/7.0
Flunky
Foobot
Fuzz
Genieo
GermCrawler
GetWeb
Getintent
Go!Zilla
GoZilla
Gotit
GrabNet
Grafula
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTP::Lite
HaosouSpider
Havij
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
IndeedBot
Indy Library
Intelliseek
Iskanie
JOC Web Spider
JetCar
Jyxobot
Kinza
Kozmosbot
Larbin
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
Magnet
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mojeek
Mojolicious
Mozlila
Mr.4x3
Musobot
Name Intelligence
NearSite
Needle
Net Vampire
NetAnts
NetZIP
Netcraft
Nettrack
NimbleCrawler
Nimbostratus
Nuclei
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Pavuk
Petalbot
Pi-Monster
Probethenet
Psbot
PyCurl
RSSingBot
RankFlex
Rankivabot
RankurBot
Re-re
Ripper
RocketCrawler
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
Screaming
Seekport
SemrushBot
SentiBot
SiteCheckerBotCrawler
SiteExplorer
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Spinn3r
Sqlworm
Stripper
Sucuri
Swiftbot
Szukacz
T8Abot
Telesoft
Telesphoreo
Telesphorep
Toata
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
VCI
VelenPublicWebCrawler
Voil
WASALive-Bot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Enhancer
Web Sauger
Web Sucker
WebFetch
WebFuck
WebGo IS
WebZIP
WebmasterWorldForumBot
Webster
Whatweb
Wonderbot
Wotbox
Wprecon
Xaldon WebSpider
Zade
Zeus
Zitebot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
com.plumanalytics
dataforseo.com
domainsproject.org
evc-batch
facebookscraper
gopher
iubenda-radar
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
oBot
probe-image-size
ripz
satoristudio.net
serpstatbot
sysscan
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io