nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-31 10:26:37 +00:00

250 lines
2.6 KiB
Text

404checker
ALittle Client
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy99
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BackDoorBot
BackStreet
Barkrowler
Blackboard
BotALot
Brandprotect
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
Chlooe
Cloud mapping
Cocolyzebot
Collector
Cosmos
CrunchBot
DSearch
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Ebingbong
Ecxi
EroCrawler
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
FDM
Fimap
FlashGet
FyberSpider
GT::WWW
GermCrawler
Getintent
Gigablast
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Heritrix
Humanlinks
IDBTE4M
IDBot
Iblog
Id-search
Image Fetch
InfoNaviRobot
InterGET
Internet Ninja
Iria
Iskanie
JOC Web Spider
Jbrofuzz
Jorgee
Keyword Density
Lanshanbot
LeechGet
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Litemage_walker
Ltx71
MIIxpc
MJ12bot
MSIECrawler
Magnet
Mass Downloader
Mb2345Browser
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NPbot
Navroad
NearSite
Needle
Nessus
NetAnts
NetZIP
Netcraft
Nibbler
Nikto
Nutch
Octopus
Offline Explorer
OnCrawl
OpenVAS
Openfind
OrangeBot
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Panscient
Picsearch
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
RankurBot
Re-re
ReGet
RealDownload
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SentiBot
SeobilityBot
Shodan
Siphon
SiteSucker
SlySearch
Sociscraper
Sogou web spider
SpaceBison
Spanner
SputnikBot
Sqlworm
Sucuri
SuperHTTP
Swiftbot
Szukacz
TeleportPro
The Intraformant
TightTwatBot
Titan
Toata
Trendictionbot
Turnitin
TurnitinBot
URLy Warning
UnisterBot
Upflow
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebBandit
WebGo IS
WebPix
WebsiteExtractor
WebsiteQuester
WinHTTrack
WiseGuys Robot
Xenu
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
arquivo.pt
autoemailspider
check1.exe
crawl.sogou.com
crawler.feedback
demandbase-bot
heritrix
internetVista monitor
ips-agent
lwp-request
meanpathbot
mediawords
muhstik-scan
oBot
pcBrowser
plumanalytics
polaris version
ripz
seostar
sexsearcher
sitechecker.pro
sogouspider
spyfu
tAkeOut
trendiction.de
voyagerx.com
x22Mozilla
xpymep1.exe
zauba.io
zgrab