nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-29 22:07:17 +00:00

250 lines
2.6 KiB
Text

360Spider
ADmantX
AIBOT
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anthill
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
Battleztar Bazinga
Bigfoot
Buck
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CCBot
Calculon
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Cogentbot
Collector
Craftbot
Crescent
Custo
DSearch
DTS Agent
DatabaseDriverMysqli
DigitalPebble
Disco
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainSigmaCrawler
Dotbot
EMail Wolf
Ebingbong
Exabot
Express WebPictures
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Fimap
Firefox/7.0
Freeuploader
FrontPage
Fuzz
Fyrebot
GetRight
Go-Ahead-Got-It
GrabNet
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Harvest
HonoluluBot
HybridBot
IDBTE4M
Id-search
IndeedBot
InfoTekies
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LeechGet
LibWeb
Likse
Ltx71
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Majestic SEO
MarkMonitor
MarkWatch
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Metauri
Mister PiX
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NICErsPRO
NPbot
NearSite
Nessus
NetAnts
NetMechanic
Nettrack
Niki-bot
Nimbostratus
Nuclei
Offline Navigator
Openfind
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Panscient
Pavuk
PeoplePal
Petalbot
Piepmatz
Pixray
PleaseCrawl
Pockey
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
Reaper
RebelMouse
Recorder
RedesScrapy
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
ScoutJet
Screaming
Searchestate
SemanticJuice
SemrushBot
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spbot
Sqlmap
Stripper
Sucker
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
Teleport
Telesphoreo
Toweyabot
Trendiction
Turnitin
TwengaBot
Twice
UnisterBot
VelenPublicWebCrawler
VidibleScraper
Voltron
WISENutbot
WWW-Mechanize
WeSEE
Web Auto
Web Fuck
WebCollage
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
WebsiteQuester
Webster
Whack
Whacker
WiseGuys Robot
Woobot
Xenu
Zade
Zermelo
Zeus
Zitebot
ZoominfoBot
arquivo.pt
clark-crawler
coccocbot
crawl.sogou.com
demandbase-bot
domainsproject.org
evc-batch
heritrix
isitwp.com
iubenda-radar
linkdexbot
lwp-trivial
muhstik-scan
seocompany.store
seostar
serpstatbot
sexsearcher
sp_auditbot
spyfu
tAkeOut
trendiction.de
voyagerx.com
webpros.com
webprosbot
x22Mozilla
zauba.io