nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-30 10:09:09 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
Abonti
Aboundex
Aboundexbot
Alexibot
Alligator
AlphaBot
Anthill
Asterias
Attach
BLEXBot
BacklinkCrawler
Bandit
Battleztar Bazinga
Bigfoot
BlackWidow
BlowFish
Bolt
Buddy
BuiltBotTough
BunnySlippers
CATExplorador
ChinaClaw
Claritybot
Cliqzbot
Cogentbot
Collector
CopyRightCheck
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Demon
Deusu
DigitalPebble
Dispatch
DnyzBot
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
Extractor
FemtosearchBot
Freeuploader
Fuzz
GalaxyBot
GetRight
GetWeb
Gigabot
Go!Zilla
Gotit
GrapeFX
HEADMasterSEO
HMView
Haansoft
HaosouSpider
Harvest
IDBTE4M
IDBot
IlseBot
InfoNaviRobot
InfoTekies
InterGET
JOC Web Spider
JamesBOT
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Larbin
Leap
LeechGet
LexiBot
LibWeb
Linkbot
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mister PiX
Mojeek
Mozlila
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad
NearSite
Nessus
Net Vampire
NetLyzer
NetSpider
NetZIP
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nutch
Offline Explorer
OnCrawl
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Panscient
Pavuk
PeoplePal
Petalbot
PictureFinder
Pixray
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
Pump
PxBroker
PyCurl
Quick-Crawler
RankActive
RankingBot
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
RepoMonkey
Rogerbot
SEOkicks
SEOstats
SMTBot
Scanbot
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SentiBot
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitevigil
SmartDownload
Snapbot
Sosospider
Spbot
Spinn3r
Sqworm
Sucuri
SuperHTTP
Szukacz
Teleport
TeleportPro
Telesoft
The Intraformant
Thumbor
Titan
TwengaBot
Upflow
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WBSearchBot
WEBDAV
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Sauger
Web Sucker
WebAuto
WebCollage
WebGo IS
WebLeacher
WebReaper
WebStripper
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Whack
Who.is Bot
WiseGuys Robot
Wprecon
Zauba
Zermelo
Zeus
ZmEu
ZoominfoBot
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler4j
demandbase-bot
gopher
instabid
ips-agent
isitwp.com
magpie-crawler
meanpathbot
oBot
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru
sysscan
tAkeOut
trendiction.de
voyagerx.com
x22Mozilla