nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-23 10:09:27 +00:00

250 lines
2.6 KiB
Text

ADmantX
AIBOT
ALittle Client
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Ankit
Anthill
Apexoo
Aspiegel
Asterias
Attach
AwarioRssBot
BLEXBot
BackWeb
BacklinkCrawler
Bigfoot
BlackWidow
Blackboard
Boardreader
Brandprotect
BuiltBotTough
Bullseye
BuzzSumo
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Copier
Crawling at Home Project
DBLBot
DatabaseDriverMysqli
Deusu
Devil
Digincore
Dirbuster
Disco
DomainStatsBot
Domains Project
Dotbot
Ecxi
EirGrabber
Evil
Express WebPictures
Extractor
ExtractorPro
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Flunky
Foobot
Fuzz
Fyrebot
GT::WWW
GalaxyBot
GetRight
Getintent
Gigablast
Gigabot
Go-Ahead-Got-It
GrabNet
GridBot
HTMLparser
HTTP::Lite
Harvest
Heritrix
Humanlinks
HybridBot
IDBTE4M
IRLbot
Id-search
IlseBot
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
Iskanie
JOC Web Spider
Jbrofuzz
JennyBot
JikeSpider
Joomla
Jorgee
Jyxobot
LNSpiderguy
Larbin
LibWeb
LinkWalker
LinkextractorPro
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MTRobot
Mail.RU_Bot
Majestic-SEO
Majestic12
Masscan
Mata Hari
Meanpathbot
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojolicious
Msrabot
NPbot
Name Intelligence
NetAnts
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nuclei
Offline Navigator
OrangeBot
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
PageGrabber
Petalbot
Pimonster
Pixray
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
ReGet
RedesScrapy
Ripper
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitevigil
SlySearch
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
SpankBot
Spanner
Stripper
Sucuri
Surfbot
Teleport
Telesphoreo
Telesphorep
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Virusdie
VoidEYE
Voltron
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Pix
Web Sauger
Web Sucker
WebBandit
WebCopier
WebLeacher
WebPix
WebStripper
WebZIP
Webshag
WebsiteExtractor
Webster
Whack
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
ZmEu
ZyBorg
arquivo-web-crawler
clark-crawler
coccocbot-web
cognitiveseo
crawler.feedback
facebookscraper
internetVista monitor
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
page scorer
ripz
s1z.ru
scalaj-http
seobility
seostar
sexsearcher
siteripz
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
zauba.io