nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-25 10:09:23 +00:00

250 lines
2.7 KiB
Text

404checker
404enemy
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Anarchy99
Ankit
Anthill
Apexoo
Aspiegel
BDFetch
BackWeb
Badass
BetaBot
Black Hole
BlackWidow
BlowFish
Brandprotect
CherryPicker
ChinaClaw
Citoid
Claritybot
Cliqzbot
Collector
Copier
Crawling at Home Project
Curious
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
Deusu
Devil
DigitalPebble
Discobot
DittoSpyder
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
ECCP/1.0
Ebingbong
EirGrabber
Evil
Express WebPictures
Extractor
FemtosearchBot
Flunky
GalaxyBot
Genieo
GetWeb
Go!Zilla
GoZilla
Gotit
Grabber
Grafula
GridBot
HEADMasterSEO
HMView
Havij
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IRLbot
Iblog
Image Fetch
Indy Library
InfoTekies
InterGET
Internet Ninja
JOC Web Spider
JetCar
Jetty
JikeSpider
Joomla
JustView
Keybot Translation-Search-Machine
Keyword Density
LeechGet
Lftp
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Magnet
Majestic12
Mass Downloader
Mata Hari
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Name Intelligence
NetLyzer
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nimbostratus
Offline Explorer
Offline Navigator
OnCrawl
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Petalbot
Pi-Monster
Picscout
PictureFinder
Pimonster
ProWebWalker
Pu_iN
Pump
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
ReGet
RebelMouse
Recorder
RedesScrapy
RocketCrawler
SBIder
SEOlyticsCrawler
Semrush
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sitebeam
Siteimprove
Snake
Snapbot
Sosospider
SpaceBison
Spbot
Spinn3r
Sqlmap
Stripper
SuperHTTP
Swiftbot
Szukacz
T8Abot
Teleport
Telesoft
Telesphoreo
Titan
Toata
Trendiction
TurnitinBot
URLy Warning
Upflow
VB Project
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Pix
WebAuto
WebBandit
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebStripper
WebSucker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteQuester
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Zade
Zauba
Zitebot
ZoominfoBot
arquivo.pt
autoemailspider
coccocbot
cognitiveseo
crawler.feedback
evc-batch
facebookscraper
gopher
internetVista monitor
ips-agent
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
page scorer
polaris version
ripz
scan.lol
seoscanners
sexsearcher
siteripz
spyfu
ubermetrics-technologies.com
x09Mozilla
x22Mozilla
zgrab