nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-07 10:09:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Apexoo
AwarioSmartBot
BBBike
BDCbot
BDFetch
BackDoorBot
Barkrowler
Battleztar Bazinga
Bigfoot
Blackboard
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CATExplorador
Calculon
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Collector
CrunchBot
CyotekWebCopy
DIIbot
Demon
Devil
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
DomCopBot
DomainStatsBot
Dragonfly
Ecxi
EirGrabber
EroCrawler
Exabot
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
FlashGet
FrontPage
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
GrabNet
Grabber
GridBot
HMView
HTTP::Lite
HTTrack
Harvest
Iblog
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jetty
Joomla
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Leap
LeechGet
LexiBot
Lightspeedsystems
LinkScan
Linkbot
LinksManager
LinqiaRSSBot
Litemage_walker
Lmspider
Ltx71
MTRobot
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Mediatoolkitbot
Metauri
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mozlila
Musobot
Nameprotect
Navroad
Nessus
NetAnts
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Nutch
OpenLinkProfiler
OrangeBot
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Picsearch
Pimonster
Pixray
PleaseCrawl
ProWebWalker
Pump
Recorder
RocketCrawler
Rogerbot
SEOprofiler
SISTRIX
Scrapy
ScreenerBot
SearchmetricsBot
SemrushBot
SentiBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
SpaceBison
Spanner
Spbot
Sqlmap
Stripper
SuperHTTP
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Toata
Toweyabot
Trendictionbot
True_Robot
Typhoeus
VB Project
Vacuum
VeriCiteCrawler
VoidEYE
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Collage
Web Fetch
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebSauger
Whack
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Zauba
Zermelo
ZoomBot
archive.org_bot
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
facebookscraper
internetVista monitor
isitwp.com
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
page scorer
pcBrowser
ripz
satoristudio.net
seoscanners
seostar
sexsearcher
sitechecker.pro
spyfu
tAkeOut
trendiction.com
webmeup-crawler
zauba.io