nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-24 10:09:45 +00:00

250 lines
2.6 KiB
Text

ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anthill
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BackDoorBot
BacklinkCrawler
Battleztar Bazinga
BetaBot
Blow
Bolt
BotALot
Brandprotect
BunnySlippers
BuzzSumo
CCBot
CODE87
Cegbfeieh
CherryPicker
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
CyotekWebCopy
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
Discobot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
Drip
EMail Siphon
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
Extractor
Fimap
Flunky
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Gigabot
GoZilla
Grafula
GridBot
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Havij
HonoluluBot
HybridBot
IDBTE4M
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
IstellaBot
JamesBOT
Jbrofuzz
Jetty
Kenjin Spider
Keybot Translation-Search-Machine
LeechFTP
LexiBot
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Magnet
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Navroad
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Nmap
OnCrawl
Openfind
OrangeBot
OrangeSpider
PHPCrawl
Page Analyzer
Panscient
Papa Foto
Picscout
Picsearch
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot2
RankurBot
Re-re
ReGet
Recorder
RedesScrapy
Ripper
SISTRIX
SalesIntelligent
Scrapy
ScreenerBot
Semrush
SentiBot
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteSucker
Sitebeam
Snake
Snapbot
Snoopy
Sosospider
Sottopop
Spammen
Sucker
Sucuri
Surfbot
Suzuran
T0PHackTeam
Telesphoreo
TheNomad
Thumbor
Titan
Toata
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Collage
Web Fuck
Web Pix
Web Sauger
WebEnhancer
WebFetch
WebFuck
WebPix
WebWhacker
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker
Whatweb
Widow
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
coccocbot
demandbase-bot
domainsproject.org
eCatch
ips-agent
isitwp.com
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
polaris version
ripz
satoristudio.net
scan.lol
seobility
seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro
ubermetrics-technologies.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io