nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-29 22:07:21 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ASPSeek
AiHitBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anthill
Apexoo
AwarioSmartBot
BLEXBot
BackDoorBot
Bandit
BetaBot
Bigfoot
Black Hole
Blackboard
Blow
Bolt
Brandprotect
BuiltBotTough
CATExplorador
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cocolyzebot
Copier
CopyRightCheck
Crawling at Home Project
CrunchBot
Custo
DBLBot
DatabaseDriverMysqli
Digincore
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
Domains Project
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
Gigabot
GoZilla
GrabNet
Grafula
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
IDBot
Id-search
IndeedBot
InfoTekies
Intelliseek
InternetSeer
Iskanie
JamesBOT
JetCar
Jetty
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
LeechFTP
LeechGet
Lftp
Likse
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Magnet
Majestic SEO
Majestic12
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Mojolicious
Msrabot
Nameprotect
Navroad
Needle
NetSpider
NetZIP
NextGenSearchBot
Niki-bot
Ninja
Nmap
Not
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeBot
OutfoxBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Papa Foto
PeoplePal
Pixray
PleaseCrawl
Pockey
Probethenet
Pu_iN
PxBroker
RSSingBot
RankFlex
Rankivabot
ReGet
RebelMouse
RepoMonkey
Ripper
SEOkicks-Robot
SEOprofiler
SEOstats
Scanbot
ScrepyBot
SeobilityBot
Seomoz
Shodan
Siphon
SiteSnagger
Siteimprove
SmartDownload
Snoopy
Sogou web spider
Sosospider
Spammen
Spinn3r
Sqlworm
Sqworm
Stripper
SurveyBot
T0PHackTeam
TeleportPro
Telesphoreo
Telesphorep
Thumbor
Titan
Tracemyfile
True_Robot
Turingos
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
V-BOT
VCI
Vagabondo
VidibleScraper
Virusdie
Voil
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Auto
Web Fetch
Web Fuck
WebBandit
WebCopier
WebFetch
WebFuck
WebLeacher
WebSauger
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Who.is Bot
WiseGuys Robot
Wprecon
Xenu
Zermelo
Zeus
ZoominfoBot
adscanner
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
evc-batch
instabid
internetVista monitor
ips-agent
lwp-request
lwp-trivial
magpie-crawler
netEstate NE Crawler
pcBrowser
satoristudio.net
scan.lol
seoscanners
sexsearcher
webgains-bot
zgrab