nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-11 22:06:56 +00:00

250 lines
2.5 KiB
Text

80legs
AIBOT
ALittle Client
ASPSeek
Aboundexbot
Alexibot
Alligator
Anarchie
Anarchy
Apexoo
AwarioSmartBot
BDFetch
BackStreet
BackWeb
BatchFTP
Bigfoot
Bitacle
Blow
BlowFish
BotALot
Brandwatch
Buck
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CODE87
CSHttp
Calculon
CherryPicker
Chlooe
Cogentbot
CopyRightCheck
Copyscape
Craftbot
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Demon
Deusu
DigitalPebble
Dirbuster
Disco
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
Domains Project
Dotbot
ECCP/1.0
EMail Wolf
Ecxi
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
FDM
Fimap
Firefox/7.0
FlashGet
Flunky
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
GrapeFX
GridBot
HaosouSpider
Harvest
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
IlseBot
Image Sucker
IndeedBot
Iria
Iskanie
JennyBot
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
Lanshanbot
Larbin
Leap
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey
Litemage_walker
MIIxpc
MarkMonitor
MauiBot
Meanpathbot
Mediatoolkitbot
Minefield
Moblie Safari
Mojeek
MolokaiBot
Mozlila
Musobot
NICErsPRO
Name Intelligence
Navroad
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
Netvibes
Nibbler
Niki-bot
Ninja
Nmap
Not
Nuclei
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PageScorer
Pandalytics
Papa Foto
Petalbot
Picscout
PictureFinder
Pockey
Probethenet
Psbot
PyCurl
RSSingBot
RankActive
RankActiveLinkBot
RankurBot
Ripper
SBIder
SEOkicks
SEOprofiler
ScanAlert
Scrapy
ScrepyBot
Searchestate
Seekport
Semrush
SentiBot
SeoSiteCheckup
Site Sucker
SiteLockSpider
SiteSucker
Sitebeam
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Spammen
SputnikBot
Sqlworm
Steeler
Stripper
Sucker
SuperHTTP
SurveyBot
Telesphorep
Toata
Toweyabot
Tracemyfile
Twice
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Pix
Web Sauger
WebCollage
WebCopier
WebEnhancer
WebFuck
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Wonderbot
Xaldon WebSpider
Xenu
YoudaoBot
ZyBorg
archive.org_bot
arquivo.pt
cognitiveseo
demandbase-bot
gopher
instabid
iubenda-radar
linkdexbot
muhstik-scan
oBot
seobility
sitechecker.pro
sogouspider
spyfu
sysscan
trendiction.com
webpros.com
webprosbot