nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-18 10:09:48 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
ASPSeek
Abonti
Aboundex
AiHitBot
AlphaBot
Anarchie
Anarchy
Ankit
Aspiegel
Attach
BDFetch
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
BlackWidow
BotALot
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CCBot
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
CrazyWebCrawler
Crescent
CrunchBot
Demon
Deusu
DigitalPebble
Disco
Discobot
Dispatch
DomainCrawler
DomainStatsBot
ECCP/1.0
EMail Siphon
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
FDM
FemtosearchBot
FlashGet
Foobot
Fuzz
FyberSpider
GalaxyBot
GetWeb
Gigabot
Grabber
Grafula
GrapeshotCrawler
GridBot
HTTP::Lite
HaosouSpider
Harvest
Havij
Hloader
Id-search
Indy Library
Internet Ninja
JOC Web Spider
JamesBOT
JennyBot
Jetty
Joomla
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
LinkextractorPro
LinksManager
Lipperhey
Litemage_walker
Ltx71
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
Mass Downloader
MeanPath Bot
Meanpathbot
Microsoft Data Access
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NICErsPRO
Navroad
NearSite
Net Vampire
NetLyzer
NetSpider
Netcraft
Nettrack
NimbleCrawler
Offline Explorer
Offline Navigator
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
Page Analyzer
PageScorer
PageThing.com
PeoplePal
Petalbot
Pi-Monster
Piepmatz
Pixray
Pockey
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
Re-re
ReGet
RealDownload
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
Seomoz
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snapbot
Sogou web spider
SpaceBison
SpankBot
Spanner
Spbot
SputnikBot
Sucuri
SuperHTTP
T0PHackTeam
Telesoft
TheNomad
TightTwatBot
Trendictionbot
True_Robot
Turingos
V-BOT
Vagabondo
Virusdie
VoidEYE
Voil
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
WeSEE
Web Auto
Web Sucker
WebAuto
WebBandit
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebPix
WebReaper
WebSauger
WebWhacker
WebZIP
Website Quester
WebsiteQuester
Who.is Bot
WiseGuys Robot
Wotbox
Wprecon
Xenu
Zade
Zeus
ZmEu
ZoomBot
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
coccocbot-web
cognitiveseo
crawler4j
demandbase-bot
domainsproject.org
facebookscraper
heritrix
internetVista monitor
ips-agent
lwp-request
mediawords
muhstik-scan
oBot
pcBrowser
plumanalytics
ripz
s1z.ru
scan.lol
seoscanners
seostar
siteripz
spyfu
trendiction.de
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe