nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-04 08:29:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
ASPSeek
Abonti
Aboundex
AiHitBot
Aipbot
Alexibot
Anarchy99
Anthill
Apexoo
Aspiegel
Asterias
Attach
AwarioRssBot
BBBike
BackWeb
Badass
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Blow
Boardreader
Brandprotect
Brandwatch
Bullseye
CODE87
CSHttp
Calculon
CazoodleBot
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Crescent
DBLBot
DIIbot
DatabaseDriverMysqli
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
Drip
Ebingbong
Ecxi
Extractor
FDM
Flunky
Freeuploader
FrontPage
FyberSpider
GT::WWW
GalaxyBot
Genieo
Getintent
Gigablast
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grabber
GrapeshotCrawler
Haansoft
Harvest
HybridBot
IRLbot
Intelliseek
Internet Ninja
Iria
Iskanie
JamesBOT
Jbrofuzz
Jetty
JustView
Kenjin Spider
Kozmosbot
LexiBot
LibWeb
Libwhisker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MIDown tool
MJ12bot
MSFrontPage
MTRobot
Mail.RU_Bot
MarkWatch
Masscan
Mata Hari
Mediatoolkitbot
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
Navroad
NearSite
Nessus
Net Vampire
NetLyzer
NetSpider
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Ninja
Nmap
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Picsearch
ProPowerBot
Probethenet
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
SMTBot
Scanbot
ScoutJet
Screaming
ScrepyBot
Semrush
SemrushBot
Site Sucker
SiteExplorer
SiteLockSpider
SmartDownload
Snake
Snapbot
SpaceBison
Spammen
SpankBot
Spanner
Sqlworm
Steeler
Sucker
SuperBot
SurveyBot
Swiftbot
Szukacz
T8Abot
The Intraformant
TightTwatBot
Trendictionbot
Turnitin
TwengaBot
Twice
Typhoeus
URLy.Warning
Vacuum
Vagabondo
VeriCiteCrawler
VoidEYE
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebReaper
WebStripper
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whacker
Whatweb
WinHTTrack
Woobot
Zauba
Zeus
Zitebot
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
eCatch
evc-batch
facebookscraper
instabid
ips-agent
lwp-request
lwp-trivial
netEstate NE Crawler
plumanalytics
polaris version
probe-image-size
s1z.ru
scalaj-http
seobility
seoscanners
sitechecker.pro
sp_auditbot
trendiction.de
voyagerx.com
x09Mozilla