nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-14 08:32:11 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
AIBOT
Abonti
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Alexibot
AllSubmitter
Alligator
Anarchy99
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackStreet
BackWeb
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
Blow
Boardreader
Bolt
Brandprotect
Buck
BunnySlippers
CATExplorador
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copier
CrunchBot
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
DigitalPebble
Dirbuster
Disco
DittoSpyder
DomCopBot
DomainAppender
Domains Project
Download Wonder
Drip
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Go!Zilla
Grabber
Grafula
GrapeshotCrawler
GridBot
HTTP::Lite
HaosouSpider
Heritrix
Hloader
IDBTE4M
Iblog
Id-search
IlseBot
Image Fetch
InternetSeer
Iria
Iskanie
JetCar
JustView
Jyxobot
Kinza
LWP::Simple
Lanshanbot
LinkScan
LinkWalker
Linkdexbot
MIDown tool
MSFrontPage
MSIECrawler
Magnet
Majestic12
Mass Downloader
Masscan
Mata Hari
MauiBot
Meanpathbot
Metauri
Microsoft URL Control
Mister PiX
Mojeek
Mozlila
Name Intelligence
Nameprotect
Navroad
Nessus
NetAnts
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Ninja
Nutch
Offline Explorer
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Pimonster
Probethenet
Pump
PyCurl
RSSingBot
RankActive
RankFlex
RankingBot
Rankivabot
Reaper
Recorder
RepoMonkey
Ripper
SBIder
SMTBot
Scrapy
ScrepyBot
SemanticJuice
SeobilityBot
Shodan
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Snoopy
Sogou web spider
SpaceBison
SputnikBot
Steeler
SuperBot
SuperHTTP
Surfbot
SurveyBot
Szukacz
T8Abot
Teleport
Telesoft
The Intraformant
TheNomad
Titan
Toweyabot
Trendiction
True_Robot
Turingos
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
Upflow
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voltron
WEBDAV
Web Auto
Web Fetch
WebBandit
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
Webalta
WebmasterWorldForumBot
WebsiteQuester
Webster
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zitebot
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
cah.io.community
com.plumanalytics
crawl.sogou.com
demandbase-bot
evc-batch
gopher
lwp-trivial
meanpathbot
muhstik-scan
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
scalaj-http
scan.lol
siteripz
sogouspider
spyfu
trendiction.de