nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-13 10:10:06 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
AIBOT
ALittle Client
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Atomseobot
Attach
AwarioSmartBot
BackStreet
Badass
Barkrowler
Blackboard
BlowFish
Bolt
BotALot
Brandprotect
Bullseye
Calculon
CazoodleBot
CheTeam
ChinaClaw
Cliqzbot
Cloud mapping
Copier
Copyscape
Cosmos
Craftbot
Crescent
CrunchBot
CyotekWebCopy
DIIbot
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DomainCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
EroCrawler
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FrontPage
GermCrawler
GetWeb
Getintent
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
Havij
Hloader
IRLbot
Id-search
Image Fetch
IndeedBot
Intelliseek
Iskanie
JOC Web Spider
JamesBOT
JikeSpider
Jorgee
Jyxobot
Kinza
Lanshanbot
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkScan
Linkbot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
MauiBot
MegaIndex.ru
Metauri
Minefield
Mister PiX
Mozlila
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Net Vampire
NetAnts
NetLyzer
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Offline Explorer
Offline Navigator
Openfind
Page Analyzer
Panscient
Papa Foto
Petalbot
Picsearch
PictureFinder
Pimonster
Pixray
ProWebWalker
Psbot
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
Re-re
ReGet
RebelMouse
Rogerbot
SBIder
SEOlyticsCrawler
Scanbot
Screaming
ScreenerBot
SentiBot
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
SlySearch
Snoopy
SocialRankIOBot
Sottopop
Spanner
Spbot
SputnikBot
Sqlworm
Sqworm
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
The Intraformant
TheNomad
Thumbor
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
Twice
Typhoeus
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
Voltron
WISENutbot
WPScan
WWW-Collector-E
Wallpapers/3.0
Web Auto
Web Collage
Web Fuck
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebPix
WebReaper
WebZIP
Webster
Whacker
Widow
WinHTTrack
WiseGuys Robot
Woobot
Zermelo
Zeus
Zitebot
ZoomBot
ZyBorg
adscanner
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
demandbase-bot
evc-batch
instabid
internetVista monitor
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
oBot
page scorer
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seocompany.store
seoscanners
seostar
siteripz
sysscan
tAkeOut
ubermetrics-technologies.com
x22Mozilla