nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-25 10:18:47 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Asterias
Attach
AwarioSmartBot
BBBike
BackStreet
BackWeb
Bandit
BlowFish
Bolt
BuiltWith
BuzzSumo
CATExplorador
CheeseBot
CherryPicker
Cogentbot
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
DBLBot
DIIbot
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
Domains Project
Download Wonder
Dragonfly
EMail Siphon
Ecxi
EirGrabber
EroCrawler
Exabot
ExtractorPro
EyeNetIE
FDM
FHscan
FemtosearchBot
Fimap
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
Go!Zilla
GrapeFX
GrapeshotCrawler
GridBot
Havij
IRLbot
Id-search
IlseBot
IndeedBot
InfoTekies
InterGET
Iskanie
JOC Web Spider
JamesBOT
Jetty
JustView
Kozmosbot
LNSpiderguy
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkpadBot
LinksManager
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MJ12bot
MQQBrowser
Majestic12
MarkMonitor
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NPbot
Name Intelligence
Needle
NetAnts
NetLyzer
NetMechanic
Netvibes
Niki-bot
Nimbostratus
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
OutclicksBot
PECL::HTTP
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
Pavuk
Picscout
PictureFinder
Pimonster
Pixray
ProPowerBot
Probethenet
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
Rankivabot
Re-re
Recorder
Ripper
RocketCrawler
Rogerbot
SEOkicks
SISTRIX
SMTBot
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
Semrush
Seomoz
Shodan
Siphon
Site Sucker
SiteLockSpider
Siteimprove
Sitevigil
Snoopy
SocialRankIOBot
Sogou web spider
Sqlmap
Sqlworm
Sqworm
Sucuri
SuperBot
Surfbot
SurveyBot
Szukacz
T0PHackTeam
Teleport
Telesoft
TightTwatBot
Toweyabot
Tracemyfile
True_Robot
Turnitin
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
WWW-Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Sauger
WebBandit
WebEnhancer
WebFetch
WebStripper
WebSucker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Webster
Whack
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Wotbox
Wprecon
Xaldon_WebSpider
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
ZyBorg
cah.io.community
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
eCatch
evc-batch
facebookscraper
internetVista monitor
mediawords
oBot
page scorer
polaris version
ripz
s1z.ru
scalaj-http
seobility
sexsearcher
sitechecker.pro
sogouspider
spyfu
sysscan
trendiction.de
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab