nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-22 10:10:45 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
AIBOT
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
AlphaBot
Anarchie
Ankit
Anthill
Apexoo
Atomseobot
Attach
AwarioSmartBot
BBBike
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
BetaBot
Blow
Bolt
BotALot
Buck
BuiltBotTough
Bullseye
BunnySlippers
CCBot
Calculon
CheeseBot
ChinaClaw
Cogentbot
Copyscape
Crawling at Home Project
Custo
DatabaseDriverMysqli
Demon
Deusu
Devil
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
EMail Wolf
Ebingbong
EirGrabber
FDM
Firefox/7.0
FlashGet
Foobot
Freeuploader
Fuzz
Fyrebot
GetRight
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Humanlinks
Iblog
Id-search
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
Internet Ninja
Iria
JamesBOT
JetCar
Jetty
Jorgee
Kenjin Spider
Keyword Density
Larbin
LexiBot
LieBaoFast
Likse
LinkWalker
Linkdexbot
LinkextractorPro
Lmspider
MIIxpc
MJ12bot
MQQBrowser
Mag-Net
Majestic12
Masscan
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft Data Access
Moblie Safari
Msrabot
Musobot
NPbot
Navroad
Net Vampire
NetMechanic
NetZIP
Nibbler
Ninja
Nuclei
Nutch
OpenLinkProfiler
OpenVAS
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
Pandalytics
Pi-Monster
Picscout
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
Pu_iN
Pump
PyCurl
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
Reaper
Recorder
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
SemrushBot
SentiBot
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Snoopy
Sogou web spider
Spammen
SpankBot
Spbot
Sqlworm
SuperBot
SuperHTTP
T8Abot
TeleportPro
Telesphoreo
TightTwatBot
Titan
Toata
Tracemyfile
Trendiction
True_Robot
Turingos
TurnitinBot
Twice
Upflow
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voil
Voltron
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WallpapersHD
Web Fuck
Web Pix
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebReaper
WebStripper
WebWhacker
Webster
Whack
Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zauba
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
check1.exe
clark-crawler
eCatch
internetVista monitor
meanpathbot
netEstate NE Crawler
pcBrowser
plumanalytics
s1z.ru
scan.lol
seocompany.store
serpstatbot
sitechecker.pro
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
zauba.io
zgrab