nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-25 10:09:20 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchy
Anthill
Asterias
AwarioRssBot
BBBike
BackDoorBot
BackStreet
BacklinkCrawler
Barkrowler
Bigfoot
BlackWidow
Brandprotect
Buck
BuiltBotTough
BuzzSumo
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Cloud mapping
Collector
Copier
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Digincore
Discobot
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainSigmaCrawler
Domains Project
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
Exabot
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
Fuzz
GalaxyBot
GetRight
Getintent
Gigabot
Gotit
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Harvest
Havij
Hloader
Humanlinks
IDBTE4M
IRLbot
Iblog
Image Fetch
IndeedBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iria
JetCar
JikeSpider
Joomla
JustView
Keyword Density
Larbin
Leap
Libwhisker
Likse
LinkWalker
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Ltx71
MSIECrawler
Majestic12
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Metauri
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Nessus
Net Vampire
NetSpider
NetZIP
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
Nimbostratus
Nuclei
Octopus
OnCrawl
Openvas
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
Panscient
Papa Foto
Pi-Monster
Picscout
Piepmatz
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
RealDownload
Recorder
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOkicks-Robot
SISTRIX
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
SemrushBot
Shodan
Siteimprove
Sociscraper
Sogou web spider
Sosospider
Spbot
Spinn3r
Sucuri
SuperBot
Swiftbot
T0PHackTeam
T8Abot
Teleport
Titan
Toata
Toweyabot
True_Robot
Turnitin
TwengaBot
URLy.Warning
Upflow
VeriCiteCrawler
VidibleScraper
Voltron
WISENutbot
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebBandit
WebFuck
WebImageCollector
Website Quester
Webster
Whack
Whatweb
WiseGuys Robot
Woobot
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zitebot
ZoomBot
ZumBot
archive.org_bot
arquivo-web-crawler
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
crawler4j
demandbase-bot
facebookscraper
heritrix
instabid
lwp-trivial
mediawords
page scorer
probe-image-size
satoristudio.net
scalaj-http
scan.lol
seoscanners
seostar
serpstatbot
siteripz
sogouspider
sysscan
ubermetrics-technologies.com
webprosbot
x22Mozilla