nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-22 10:10:19 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
Abonti
Aboundex
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anthill
Asterias
BBBike
BDCbot
BDFetch
BackWeb
Backlink-Ceck
Bandit
BetaBot
Black Hole
Blow
Brandwatch
Buck
Buddy
CATExplorador
CSHttp
CensysInspect
CherryPicker
Cocolyzebot
Collector
Craftbot
CrunchBot
Custo
CyotekWebCopy
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
Dispatch
DnyzBot
DomainStatsBot
Domains Project
EMail Siphon
EMail Wolf
Ebingbong
Extractor
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Fyrebot
G-i-g-a-b-o-t
GetWeb
Getintent
Gigabot
Go!Zilla
GoZilla
Gotit
GrabNet
HTTP::Lite
HaosouSpider
Harvest
HonoluluBot
Humanlinks
IDBTE4M
IDBot
Iblog
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
InternetSeer
Iria
IstellaBot
JetCar
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
LibWeb
Libwhisker
LinkWalker
LinkpadBot
LinksManager
LinqiaScrapeBot
Litemage_walker
MSFrontPage
Magnet
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Minefield
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Musobot
Name Intelligence
Nameprotect
NearSite
NetAnts
NetLyzer
NetSpider
Nettrack
Netvibes
Nimbostratus
Nmap
Not
Nutch
OpenLinkProfiler
Openvas
OrangeSpider
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
Picscout
Picsearch
ProWebWalker
Pump
PyCurl
RSSingBot
RankActive
RankFlex
RankingBot
Rankivabot
RealDownload
Recorder
SEOkicks
SEOkicks-Robot
SEOprofiler
SalesIntelligent
ScanAlert
Screaming
ScrepyBot
SearchmetricsBot
SemrushBot
Siphon
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Snapbot
SocialRankIOBot
Spammen
Spanner
Steeler
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphorep
Thumbor
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
URLy.Warning
V-BOT
VB Project
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Collage
Web Fetch
Web Pix
WebCopier
WebFetch
WebFuck
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
WebZIP
WebsiteExtractor
Webster
Whacker
WinHTTrack
WiseGuys Robot
Wprecon
Xenu
YoudaoBot
Zermelo
Zeus
ZmEu
ZoomBot
ZoominfoBot
arquivo-web-crawler
clark-crawler
coccocbot
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
instabid
internetVista monitor
ips-agent
lwp-trivial
magpie-crawler
meanpathbot
mediawords
oBot
pcBrowser
ripz
scan.lol
seocompany.store
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.de
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zauba.io
zgrab