nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-25 22:07:23 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AhrefsBot
Alexibot
Anarchy99
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
BetaBot
Bigfoot
Bitacle
Blow
Brandprotect
Buck
Buddy
BuiltBotTough
Bullseye
CCBot
CheTeam
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Curious
Custo
CyotekWebCopy
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
Dirbuster
Disco
Discobot
DnyzBot
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
Drip
EMail Wolf
EirGrabber
Evil
Extreme Picture Finder
EyeNetIE
FHscan
Firefox/7.0
Foobot
Freeuploader
FrontPage
GalaxyBot
Gigabot
Go!Zilla
GoZilla
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTMLparser
Haansoft
Harvest
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot
Id-search
IndeedBot
Intelliseek
Internet Ninja
Iria
Iskanie
JOC Web Spider
JamesBOT
JikeSpider
Jorgee
Keybot Translation-Search-Machine
Kinza
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Lightspeedsystems
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
Mata Hari
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Moblie Safari
Mozlila
Mr.4x3
Msrabot
Musobot
Navroad
Nessus
NetAnts
NetSpider
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Nmap
Offline Explorer
OnCrawl
Openvas
PageAnalyzer
PageGrabber
Pandalytics
Pavuk
PeoplePal
Picscout
Piepmatz
Pixray
PleaseCrawl
Pockey
ProPowerBot
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RealDownload
RocketCrawler
Rogerbot
SEOprofiler
ScoutJet
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeoSiteCheckup
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Siteimprove
Sitevigil
Snake
Snoopy
SocialRankIOBot
Sqlmap
Stripper
SurveyBot
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Trendiction
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
Vagabondo
VelenPublicWebCrawler
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Fuck
Web Pix
WebFetch
WebLeacher
WebReaper
WebStripper
WebZIP
Webshag
Website Quester
WebsiteQuester
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
autoemailspider
cah.io.community
clark-crawler
com.plumanalytics
crawl.sogou.com
dataforseo.com
eCatch
facebookscraper
instabid
ips-agent
iubenda-radar
lwp-request
meanpathbot
mediawords
oBot
page scorer
pcBrowser
plumanalytics
polaris version
s1z.ru
satoristudio.net
scalaj-http
seobility
spyfu
ubermetrics-technologies.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io
zgrab