nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-18 10:07:15 +00:00

100 lines
1 KiB
Text

Abonti
AlphaBot
Apexoo
AwarioRssBot
AwarioSmartBot
BLEXBot
Backlink-Ceck
BetaBot
Blow
BuiltBotTough
BuzzSumo
CCBot
CSHttp
Custo
DSearch
Demon
Digincore
DomainAppender
DomainCrawler
ECCP/1.0
Ecxi
EirGrabber
Exabot
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
Fuzz
GoZilla
GrapeFX
HTTrack
Hloader
JetCar
JustView
Jyxobot
Keyword Density
Kozmosbot
Ltx71
MFC_Tear_Sample
Majestic SEO
Mediatoolkitbot
NPbot
Name Intelligence
Nameprotect
NearSite
Ninja
Not
OrangeBot
POE-Component-Client-HTTP
Pimonster
PleaseCrawl
ProWebWalker
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
Ripper
SEOstats
ScoutJet
Semrush
Seomoz
SiteSnagger
Sitevigil
Snapbot
Sottopop
Spanner
Spinn3r
SurveyBot
T0PHackTeam
Telesphoreo
TurnitinBot
Upflow
Vacuum
WASALive-Bot
Web Fuck
WebBandit
WebZIP
Whacker
Wprecon
Xaldon WebSpider
Zermelo
arquivo.pt
clark-crawler
coccocbot
crawler4j
facebookscraper
heritrix
isitwp.com
lwp-request
meanpathbot
oBot
scalaj-http
seocompany.store
serpstatbot
sitechecker.pro
sysscan
voyagerx.com
x09Mozilla
zauba.io