nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-10 10:11:00 +00:00

250 lines
2.7 KiB
Text

404checker
ASPSeek
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
Anarchy99
Anthill
Apexoo
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
Badass
BlackWidow
Blackboard
Blow
Bolt
Brandprotect
Brandwatch
BuiltWith
Bullseye
CATExplorador
CCBot
CODE87
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
CopyRightCheck
Cosmos
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DataCha0s
Deusu
Digincore
Dirbuster
Discoverybot
DittoSpyder
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Ebingbong
EirGrabber
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Ezooms
FemtosearchBot
Firefox/7.0
FrontPage
GalaxyBot
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
GrabNet
HMView
HTMLparser
HaosouSpider
Harvest
Heritrix
Hloader
IRLbot
InternetSeer
JamesBOT
Jbrofuzz
JetCar
Jetty
Keybot Translation-Search-Machine
LNSpiderguy
Leap
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MIIxpc
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Name Intelligence
Nameprotect
Navroad
Nessus
NetAnts
NetMechanic
NetSpider
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Not
Nuclei
Offline Navigator
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Pi-Monster
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
ProPowerBot
Probethenet
Psbot
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankurBot
Re-re
RedesScrapy
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
Scanbot
ScoutJet
Scrapy
SearchmetricsBot
SentiBot
SeoSiteCheckup
Siphon
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch
SmartDownload
Snapbot
Sociscraper
Sogou web spider
SpaceBison
SpankBot
Spbot
Sqlmap
Sqlworm
Steeler
SuperBot
Surfbot
SurveyBot
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
The Intraformant
Toata
Toweyabot
Tracemyfile
True_Robot
URLy.Warning
VCI
Vacuum
VeriCiteCrawler
WEBDAV
WWW-Mechanize
WWW::Mechanize
Wallpapers
WallpapersHD
Web Pix
Web Sucker
WebCollage
WebEnhancer
WebGo IS
WebImageCollector
WebPix
WebReaper
WebSauger
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Who.is Bot
Widow
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zitebot
ZumBot
ZyBorg
adscanner
cah.io.community
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
evc-batch
instabid
magpie-crawler
polaris version
probe-image-size
scalaj-http
scan.lol
seocompany.store
siteripz
spyfu
ubermetrics-technologies.com
webpros.com
x22Mozilla