nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-26 22:07:04 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ASPSeek
Abonti
Acunetix
AhrefsBot
AiHitBot
Alexibot
Alligator
Anarchy
Anthill
Apexoo
AwarioRssBot
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
BlackWidow
Blackboard
Blow
Brandprotect
Buck
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CODE87
CheeseBot
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Collector
Cosmos
Curious
CyotekWebCopy
DBLBot
DSearch
Deusu
Devil
Digincore
Disco
Discoverybot
DnBCrawler-Analytics
Download Wonder
Dragonfly
EMail Siphon
EasyDL
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
FDM
FlashGet
Flunky
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GetRight
Getintent
GridBot
HTMLparser
HTTP::Lite
Harvest
Heritrix
HonoluluBot
IDBot
IRLbot
Image Fetch
Image Sucker
Intelliseek
InterGET
Internet Ninja
Iria
IstellaBot
Jbrofuzz
JetCar
JikeSpider
Joomla
Jorgee
Keybot Translation-Search-Machine
Keyword Density
Kinza
Lanshanbot
LeechGet
LibWeb
LieBaoFast
Likse
LinkScan
LinkWalker
LinksManager
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
Mass Downloader
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
Musobot
NPbot
Needle
Net Vampire
NetAnts
NetLyzer
NetZIP
NextGenSearchBot
Nibbler
Nimbostratus
Nmap
Not
Nutch
Offline Explorer
OpenVAS
Openfind
OrangeSpider
OutclicksBot
PECL::HTTP
PageGrabber
Pandalytics
Panscient
Papa Foto
Picscout
Piepmatz
Pockey
RSSingBot
RankFlex
Re-re
RealDownload
Recorder
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
Scrapy
ScreenerBot
ScrepyBot
Seekport
SemanticJuice
Semrush
SeobilityBot
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SlySearch
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
SputnikBot
Stripper
Sucker
Sucuri
Surfbot
Suzuran
Szukacz
T8Abot
Teleport
TeleportPro
Telesoft
Tracemyfile
Trendiction
Trendictionbot
Turingos
Twice
URLy.Warning
Vagabondo
VidibleScraper
Virusdie
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Enhancer
WebAuto
WebSauger
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zermelo
ZmEu
ZyBorg
adscanner
autoemailspider
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seoscanners
serpstatbot
sitechecker.pro
siteripz
sogouspider
webgains-bot
x22Mozilla