nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-11 14:10:54 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ADmantX
Abonti
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchie
Apexoo
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Badass
Bandit
BetaBot
Bigfoot
BlowFish
BotALot
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
Cegbfeieh
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Copyscape
Curious
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Dirbuster
Discoverybot
DittoSpyder
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Drip
ECCP/1.0
EMail Wolf
Ecxi
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
Fimap
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Getintent
Gigablast
Gigabot
Gotit
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HaosouSpider
Heritrix
Hloader
HybridBot
IRLbot
Iblog
IlseBot
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Joomla
Kenjin Spider
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic SEO
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Mozlila
Musobot
NetAnts
NetMechanic
NetZIP
Netvibes
NextGenSearchBot
Nimbostratus
Nmap
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageScorer
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
ProWebWalker
Psbot
Pump
PyCurl
RankFlex
RankingBot
ReGet
Rogerbot
SEOlyticsCrawler
SEOprofiler
SISTRIX
Scanbot
Scrapy
SearchmetricsBot
Semrush
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
SpankBot
Spbot
Steeler
Sucker
T0PHackTeam
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toata
Trendiction
Trendictionbot
True_Robot
Turingos
URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT
VCI
VelenPublicWebCrawler
VidibleScraper
Voil
Voltron
WBSearchBot
WPScan
WWW-Collector-E
WWWOFFLE
Web Enhancer
Web Pix
Web Sauger
Web Sucker
WebCopier
WebFetch
WebLeacher
WebPix
WebWhacker
WebZIP
WebsiteExtractor
WebsiteQuester
Webster
Whack
Widow
WinHTTrack
Woobot
Wprecon
Zauba
ZmEu
ZyBorg
backlink-check
check1.exe
evc-batch
facebookscraper
ips-agent
mediawords
netEstate NE Crawler
oBot
polaris version
ripz
s1z.ru
seoscanners
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
trendiction.com
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io
zgrab