nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-07 07:18:28 +00:00

250 lines
2.5 KiB
Text

404checker
404enemy
ADmantX
AIBOT
Aboundex
AhrefsBot
AiHitBot
Alexibot
AlphaBot
Anarchy
Anthill
Aspiegel
AwarioSmartBot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
Barkrowler
Bigfoot
Black Hole
BlackWidow
Blow
BotALot
Brandprotect
Brandwatch
Buck
CATExplorador
CCBot
CSHttp
CensysInspect
Cliqzbot
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crescent
Curious
CyotekWebCopy
DSearch
DatabaseDriverMysqli
Digincore
DigitalPebble
Discoverybot
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Dragonfly
Drip
EMail Siphon
EMail Wolf
Ecxi
ExtLinksBot
Extractor
ExtractorPro
Ezooms
FDM
Fimap
Firefox/7.0
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Grabber
GridBot
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IRLbot
InfoTekies
Intelliseek
InterGET
Internet Ninja
JennyBot
JetCar
Jetty
Joomla
JustView
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
Lightspeedsystems
LinkScan
Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MTRobot
Mag-Net
Mail.RU_Bot
MarkWatch
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Minefield
Mister PiX
Moblie Safari
Mr.4x3
Musobot
NearSite
Net Vampire
NetAnts
Netcraft
Nettrack
Netvibes
Nibbler
NimbleCrawler
Ninja
Nuclei
Nutch
Octopus
Offline Explorer
Openfind
Openvas
OrangeBot
OutfoxBot
Pandalytics
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picscout
Pimonster
Psbot
PyCurl
Quick-Crawler
RSSingBot
Rankivabot
Re-re
ReGet
RebelMouse
Ripper
RocketCrawler
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
Screaming
ScreenerBot
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Spanner
Steeler
Sucker
SuperBot
SuperHTTP
SurveyBot
Swiftbot
T0PHackTeam
TeleportPro
Telesphorep
The Intraformant
TightTwatBot
Toata
Toweyabot
Tracemyfile
True_Robot
TurnitinBot
URLy Warning
URLy.Warning
Upflow
VB Project
Vacuum
VelenPublicWebCrawler
VoidEYE
Voil
Voltron
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebAuto
WebBandit
WebCopier
WebImageCollector
WebPix
WebReaper
WebZIP
Website Quester
WebsiteExtractor
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xenu
ZoomBot
ZoominfoBot
ZyBorg
clark-crawler
crawl.sogou.com
eCatch
magpie-crawler
muhstik-scan
page scorer
plumanalytics
s1z.ru
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
sexsearcher
webmeup-crawler
webprosbot
x22Mozilla
zgrab