nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-06 22:09:54 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
Aboundexbot
AiHitBot
Aipbot
AlphaBot
Anarchy
Anarchy99
Aspiegel
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
BackWeb
Badass
Black Hole
BlackWidow
Blackboard
Blow
BlowFish
Bolt
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
CSHttp
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CyotekWebCopy
DSearch
Demon
Deusu
Devil
Discobot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
EMail Wolf
Ebingbong
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
Foobot
Freeuploader
Fuzz
Fyrebot
GT::WWW
Gotit
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Havij
HonoluluBot
Humanlinks
HybridBot
IDBot
IRLbot
Id-search
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
JOC Web Spider
JamesBOT
Jetty
Jorgee
JustView
Jyxobot
Kenjin Spider
Kinza
LWP::Simple
Larbin
Lftp
Libwhisker
LieBaoFast
Likse
LinkScan
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Ltx71
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
Mass Downloader
Masscan
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
NPbot
Navroad
Needle
Net Vampire
NetAnts
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Not
Nuclei
Nutch
Octopus
OnCrawl
OpenVAS
Openfind
OrangeBot
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
Picsearch
PictureFinder
Pimonster
Pockey
Pu_iN
PyCurl
Quick-Crawler
RankingBot
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
SEOkicks-Robot
SEOprofiler
SEOstats
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SeobilityBot
Siphon
SiteCheckerBotCrawler
Sitebeam
Sitevigil
SmartDownload
SocialRankIOBot
Spammen
Sqlworm
Stripper
Surfbot
Swiftbot
Szukacz
Teleport
TeleportPro
Thumbor
Toweyabot
Tracemyfile
TurnitinBot
Twice
URLy.Warning
V-BOT
VelenPublicWebCrawler
Voil
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Fuck
Web Pix
Web Sucker
WebAuto
WebCopier
WebWhacker
Website Quester
WebsiteQuester
Webster
Whack
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zermelo
ZmEu
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
com.plumanalytics
crawl.sogou.com
dataforseo.com
instabid
mediawords
pcBrowser
plumanalytics
ripz
seocompany.store
seoscanners
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com