nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-14 22:07:15 +00:00

250 lines
2.6 KiB
Text

ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
Anarchie
Anarchy99
Aspiegel
Atomseobot
AwarioRssBot
AwarioSmartBot
BLEXBot
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Bandit
BatchFTP
BetaBot
Bitacle
BlackWidow
Blackboard
Boardreader
Bolt
Buck
BunnySlippers
BuzzSumo
CCBot
CODE87
CheeseBot
ChinaClaw
Chlooe
Citoid
Collector
CopyRightCheck
Cosmos
Crawling at Home Project
DBLBot
DSearch
Demon
Deusu
Digincore
DigitalPebble
Discoverybot
DittoSpyder
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
EroCrawler
Evil
ExtLinksBot
Extractor
FemtosearchBot
FlashGet
Foobot
FyberSpider
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetRight
Getintent
Go-Ahead-Got-It
GoZilla
Gotit
GrapeFX
HTTP::Lite
Haansoft
Havij
Heritrix
Hloader
IDBTE4M
Iblog
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
Intelliseek
InternetSeer
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
LeechGet
Libwhisker
LieBaoFast
Likse
LinkWalker
Lipperhey Spider
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Mozlila
Msrabot
Musobot
Needle
NetZIP
Nibbler
Niki-bot
Ninja
Nmap
Not
Nutch
Octopus
OnCrawl
OpenLinkProfiler
Openvas
OrangeBot
OutclicksBot
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Pavuk
Pi-Monster
Picsearch
Piepmatz
PleaseCrawl
ProPowerBot
ProWebWalker
Pu_iN
Quick-Crawler
RankActive
RankFlex
RankingBot2
Rankivabot
RankurBot
Ripper
SEOkicks
SEOkicks-Robot
SISTRIX
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SeoSiteCheckup
Shodan
Sitebeam
Sitevigil
Snapbot
Sogou web spider
Spammen
Sucker
Szukacz
Teleport
TeleportPro
Telesoft
The Intraformant
Titan
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
Typhoeus
Vacuum
Voil
Voltron
WPScan
WWW::Mechanize
WWWOFFLE
Web Auto
Web Fuck
Web Pix
Web Sauger
WebCopier
WebFuck
WebGo IS
WebImageCollector
WebSauger
WebZIP
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Whack
Widow
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zermelo
Zeus
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
adscanner
clark-crawler
coccocbot
com.plumanalytics
crawl.sogou.com
dataforseo.com
domainsproject.org
facebookscraper
heritrix
ips-agent
linkdexbot
muhstik-scan
netEstate NE Crawler
page scorer
polaris version
ripz
s1z.ru
scalaj-http
seocompany.store
seostar
sysscan
trendiction.de
x09Mozilla