nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-24 10:09:35 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundexbot
AfD-Verbotsverfahren
Alexibot
Alligator
Apexoo
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BackStreet
BacklinkCrawler
Badass
Bandit
Barkrowler
Blackboard
BlowFish
Boardreader
BotALot
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Cegbfeieh
CensysInspect
Claritybot
Cloud mapping
Collector
CopyRightCheck
Copyscape
Craftbot
Crescent
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
Deusu
DigitalPebble
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Download Wonder
EMail Siphon
EasyDL
Ebingbong
Ecxi
Evil
Express WebPictures
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Foobot
GT::WWW
GermCrawler
Go!Zilla
GrapeFX
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Harvest
HonoluluBot
HybridBot
IDBTE4M
Iblog
Id-search
IlseBot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
Iskanie
IstellaBot
Jbrofuzz
JetCar
JustView
Lanshanbot
Leap
LeechFTP
Lftp
LibWeb
Libwhisker
Likse
LinkextractorPro
LinkpadBot
Litemage_walker
Ltx71
MTRobot
Majestic-SEO
Mass Downloader
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mojeek
Mojolicious
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Nessus
Net Vampire
NetAnts
NetLyzer
Netvibes
Nibbler
Niki-bot
Nikto
Ninja
Nmap
Not
Nutch
OpenVAS
Openfind
OrangeBot
OutclicksBot
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Panscient
Pavuk
Picscout
Piepmatz
PleaseCrawl
Pockey
Pump
PxBroker
QueryN Metasearch
RankingBot2
Re-re
ReGet
RedesScrapy
SEOkicks
SEOkicks-Robot
SISTRIX
ScoutJet
Scrapy
Screaming
Searchestate
Seekport
SemanticJuice
Semrush
SeobilityBot
Shodan
Siphon
Site Sucker
SiteSnagger
SiteSucker
Sitebeam
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Spbot
Spinn3r
Sqlmap
Sqlworm
Steeler
Sucker
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Telesphoreo
The Intraformant
TightTwatBot
Toata
Toweyabot
Trendiction
Turingos
URLy Warning
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WISENutbot
WWWOFFLE
Web Auto
Web Fetch
Web Fuck
Web Sauger
WebEnhancer
WebGo IS
WebLeacher
WebStripper
WebSucker
WebWhacker
Webshag
Website Quester
Who.is Bot
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zeus
Zitebot
ZumBot
autoemailspider
coccocbot
crawl.sogou.com
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
instabid
ips-agent
isitwp.com
linkdexbot
lwp-trivial
netEstate NE Crawler
page scorer
pcBrowser
polaris version
probe-image-size
scalaj-http
seobility
seostar
serpstatbot
sitechecker.pro
tAkeOut
webmeup-crawler
zauba.io
zgrab