nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-15 10:09:46 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
80legs
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Ankit
Atomseobot
AwarioRssBot
BBBike
BDCbot
BDFetch
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Blow
BlowFish
BotALot
Brandwatch
BunnySlippers
BuzzSumo
CCBot
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
Cocolyzebot
Cogentbot
Collector
Copier
Crawling at Home Project
Crescent
CrunchBot
DBLBot
DatabaseDriverMysqli
Digincore
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainSigmaCrawler
Drip
EMail Wolf
Ebingbong
EroCrawler
Express WebPictures
Extreme Picture Finder
FemtosearchBot
Fimap
Fuzz
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
GoZilla
Grafula
HMView
Hloader
HonoluluBot
IDBTE4M
IDBot
Iblog
Image Sucker
Indy Library
InfoTekies
Iria
JennyBot
JikeSpider
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LexiBot
LibWeb
LinqiaMetadataDownloaderBot
MIDown tool
MJ12bot
MQQBrowser
MTRobot
Mata Hari
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
Navroad
Nessus
Net Vampire
NetAnts
NetSpider
Nettrack
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Not
Nuclei
OnCrawl
OpenVAS
Openfind
Openvas
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Panscient
PeoplePal
Pi-Monster
Picsearch
PictureFinder
ProWebWalker
Pu_iN
Pump
PxBroker
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
RankingBot2
Rankivabot
ReGet
Reaper
RepoMonkey
SEOkicks
SEOstats
SISTRIX
SMTBot
ScoutJet
Scrapy
SearchmetricsBot
Seekport
SemanticJuice
Seomoz
SiteCheckerBotCrawler
SiteExplorer
SmartDownload
Snake
Snoopy
SocialRankIOBot
SpaceBison
Spanner
Spinn3r
Sqworm
Steeler
Stripper
Surfbot
Swiftbot
Szukacz
Teleport
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Toata
Toweyabot
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
V-BOT
VCI
Vacuum
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebCollage
WebFetch
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Widow
WinHTTrack
ZmEu
ZoomBot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
eCatch
evc-batch
heritrix
internetVista monitor
magpie-crawler
mediawords
muhstik-scan
oBot
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
seobility
seoscanners
serpstatbot
sexsearcher
sogouspider
sysscan
trendiction.de
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com