nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-16 10:09:32 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ASPSeek
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Ankit
Anthill
Attach
AwarioRssBot
BDFetch
BackWeb
Backlink-Ceck
Badass
Bandit
Bigfoot
BlackWidow
Blackboard
Blow
Bolt
Brandprotect
Brandwatch
Buck
BuiltWith
CODE87
Cegbfeieh
CherryPicker
Chlooe
Cliqzbot
CopyRightCheck
CrazyWebCrawler
CrunchBot
Custo
DBLBot
DSearch
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
EroCrawler
Evil
Exabot
Extractor
Extreme Picture Finder
FDM
FHscan
Firefox/7.0
FrontPage
G-i-g-a-b-o-t
GoZilla
GrabNet
Grafula
HMView
HTTrack
Harvest
Havij
IRLbot
IlseBot
IndeedBot
Intelliseek
Internet Ninja
IstellaBot
JOC Web Spider
JikeSpider
Joomla
Jorgee
JustView
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
Leap
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MIIxpc
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Minefield
Moblie Safari
Mojeek
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
NPbot
Nameprotect
Needle
NetAnts
NetMechanic
Netvibes
NimbleCrawler
Nuclei
Offline Explorer
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
Page Analyzer
PageScorer
Picscout
PleaseCrawl
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
Recorder
RepoMonkey
Rogerbot
SBIder
SEOkicks-Robot
SEOlyticsCrawler
Scanbot
Scrapy
ScrepyBot
Searchestate
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
SiteLockSpider
SiteSucker
Sociscraper
Sogou web spider
SpankBot
Spbot
Spinn3r
Steeler
SuperBot
T0PHackTeam
Telesoft
TheNomad
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Typhoeus
Upflow
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WISENutbot
WWWOFFLE
WallpapersHD
Web Collage
Web Fuck
Web Pix
Web Sucker
WebCollage
WebFetch
WebImageCollector
WebPix
WebReaper
WebSauger
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Webster
Whacker
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Wprecon
Zitebot
ZmEu
ZoominfoBot
ZumBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
crawler.feedback
dataforseo.com
domainsproject.org
facebookscraper
heritrix
internetVista monitor
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
pcBrowser
plumanalytics
s1z.ru
scan.lol
seobility
seocompany.store
seostar
serpstatbot
sp_auditbot
spyfu
sysscan
ubermetrics-technologies.com
webprosbot
x09Mozilla
zauba.io
zgrab