nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-17 10:09:39 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ALittle Client
Aboundexbot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Anthill
Apexoo
Attach
AwarioRssBot
BDCbot
BLEXBot
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BlackWidow
Blackboard
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
Buck
CATExplorador
CCBot
Calculon
Cegbfeieh
Copier
CopyRightCheck
Craftbot
DBLBot
DSearch
DataCha0s
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Drip
ECCP/1.0
EasyDL
Ecxi
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
Grafula
HEADMasterSEO
HTMLparser
HTTrack
Harvest
Havij
Heritrix
Hloader
Humanlinks
Iblog
Id-search
IndeedBot
Indy Library
InfoTekies
Internet Ninja
JOC Web Spider
Jbrofuzz
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
Larbin
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MIDown tool
MIIxpc
MQQBrowser
Mag-Net
Magnet
Majestic SEO
Mass Downloader
MauiBot
Mb2345Browser
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
NPbot
Name Intelligence
Nessus
Net Vampire
NetLyzer
Netcraft
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Nmap
Nutch
Offline Navigator
OnCrawl
Openfind
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PeoplePal
Petalbot
Pixray
PleaseCrawl
Pockey
ProWebWalker
Psbot
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
Re-re
RebelMouse
RepoMonkey
Ripper
RocketCrawler
SISTRIX
SalesIntelligent
ScanAlert
Screaming
ScrepyBot
Searchestate
Seekport
SemanticJuice
Siphon
SiteLockSpider
Siteimprove
Snoopy
Sociscraper
Sosospider
SpaceBison
Spammen
SpankBot
SputnikBot
Sqworm
SuperBot
SuperHTTP
Surfbot
T8Abot
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
True_Robot
Turingos
TurnitinBot
Twice
UnisterBot
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
VoidEYE
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
Web Collage
Web Enhancer
Web Pix
WebBandit
WebCopier
WebFuck
WebReaper
WebSauger
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Zade
Zermelo
Zitebot
ZmEu
ZyBorg
arquivo.pt
backlink-check
cah.io.community
clark-crawler
crawl.sogou.com
crawler4j
domainsproject.org
facebookscraper
gopher
isitwp.com
iubenda-radar
muhstik-scan
netEstate NE Crawler
probe-image-size
s1z.ru
scan.lol
seoscanners
seostar
siteripz
trendiction.de
ubermetrics-technologies.com
webgains-bot
x09Mozilla
xpymep1.exe
zgrab