nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-13 22:07:02 +00:00

250 lines
2.6 KiB
Text

360Spider
ASPSeek
Acunetix
AiHitBot
AlphaBot
Anarchie
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Badass
Bandit
Barkrowler
Bigfoot
Bitacle
Black Hole
Blackboard
Boardreader
BotALot
Brandprotect
BuzzSumo
CATExplorador
CheTeam
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Collector
CopyRightCheck
Curious
DTS Agent
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Evil
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
Fimap
FlashGet
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GetWeb
Go-Ahead-Got-It
GrabNet
Grabber
GrapeFX
HEADMasterSEO
HMView
Havij
Heritrix
Hloader
IlseBot
Image Fetch
IndeedBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
Jbrofuzz
Jorgee
JustView
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LinkScan
LinkextractorPro
LinksManager
LinqiaScrapeBot
MFC_Tear_Sample
MIIxpc
MSFrontPage
Mag-Net
Magnet
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Msrabot
NPbot
Name Intelligence
NearSite
Needle
NetAnts
NetLyzer
NetZIP
Netcraft
Netvibes
Niki-bot
Nimbostratus
Nmap
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
PeoplePal
Petalbot
Picsearch
Piepmatz
Pimonster
Probethenet
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Re-re
RocketCrawler
SEOkicks
SEOprofiler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
SeobilityBot
Siteimprove
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spammen
Spanner
Spbot
Sqlmap
Sqworm
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T8Abot
Telesphoreo
Thumbor
TightTwatBot
Trendiction
TurnitinBot
Twice
UnisterBot
Upflow
V-BOT
VB Project
VCI
Vacuum
Voil
Voltron
WWW::Mechanize
Wallpapers
WallpapersHD
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebReaper
WebSauger
WebSucker
WebWhacker
WebZIP
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wprecon
YoudaoBot
Zauba
Zitebot
ZmEu
ZoominfoBot
archive.org_bot
arquivo-web-crawler
check1.exe
clark-crawler
com.plumanalytics
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
facebookscraper
heritrix
isitwp.com
lwp-request
lwp-trivial
mediawords
polaris version
scalaj-http
seocompany.store
siteripz
spyfu
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla
x22Mozilla
zauba.io