nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-15 10:09:22 +00:00

250 lines
2.5 KiB
Text

360Spider
404enemy
ADmantX
AfD-Verbotsverfahren
AiHitBot
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Aspiegel
BDCbot
BDFetch
BackStreet
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
Blow
BlowFish
BuzzSumo
CheTeam
Chlooe
Citoid
Cliqzbot
Cogentbot
Collector
Copier
Cosmos
Curious
Custo
DIIbot
DSearch
DTS Agent
Devil
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainStatsBot
Dotbot
EasyDL
Ecxi
Extractor
Extreme Picture Finder
FHscan
Firefox/7.0
Flunky
Foobot
FrontPage
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
HMView
HTMLparser
HTTrack
Haansoft
HaosouSpider
Havij
Hloader
HybridBot
IRLbot
Iblog
Indy Library
Intelliseek
InterGET
JOC Web Spider
Jbrofuzz
Jetty
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Larbin
LibWeb
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Mata Hari
Microsoft Data Access
Minefield
Mister PiX
Mr.4x3
NICErsPRO
Nameprotect
Navroad
NearSite
NetMechanic
NetZIP
Netcraft
Nettrack
Netvibes
Niki-bot
NimbleCrawler
Nimbostratus
Not
Nutch
Octopus
Offline Explorer
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Picscout
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
ProPowerBot
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankurBot
Re-re
ReGet
RealDownload
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SentiBot
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
Sitebeam
Siteimprove
Snake
Sociscraper
Sosospider
SpaceBison
SpankBot
Spbot
Sqlworm
Steeler
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
Teleport
Telesphorep
TheNomad
TightTwatBot
Titan
Toata
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
V-BOT
VB Project
VelenPublicWebCrawler
Voil
WASALive-Bot
WEBDAV
WPScan
WallpapersHD
Web Collage
Web Fuck
Web Pix
WebCollage
WebCopier
WebImageCollector
WebPix
WebSauger
WebZIP
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whatweb
Who.is Bot
Wprecon
Xaldon WebSpider
Xenu
Zade
Zauba
Zitebot
ZmEu
ZoominfoBot
ZumBot
adscanner
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
gopher
heritrix
internetVista monitor
lwp-request
muhstik-scan
pcBrowser
plumanalytics
probe-image-size
satoristudio.net
scan.lol
seobility
seocompany.store
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
siteripz
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webgains-bot
webpros.com
x09Mozilla