nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-15 22:07:19 +00:00

250 lines
2.6 KiB
Text

404checker
ASPSeek
Abonti
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
Badass
BetaBot
Bigfoot
Blow
Boardreader
Brandprotect
BuiltBotTough
Bullseye
BunnySlippers
CATExplorador
CODE87
CSHttp
CensysInspect
CherryPicker
Chlooe
Claritybot
Cliqzbot
Copier
Cosmos
CrazyWebCrawler
Crescent
Curious
DIIbot
DataCha0s
Demon
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
EasyDL
EroCrawler
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Fimap
Firefox/7.0
FyberSpider
Fyrebot
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Go!Zilla
GoZilla
GrapeFX
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Heritrix
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
IlseBot
Image Fetch
Indy Library
InfoTekies
Iskanie
JOC Web Spider
JikeSpider
Larbin
Leap
LeechGet
LexiBot
Lftp
LibWeb
LinkScan
Linkdexbot
LinksManager
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NPbot
Nameprotect
Net Vampire
NetLyzer
Niki-bot
Nikto
Ninja
Nmap
Not
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OutfoxBot
PHPCrawl
PageAnalyzer
PageGrabber
Pavuk
PeoplePal
Pi-Monster
PleaseCrawl
ProPowerBot
Quick-Crawler
RSSingBot
RankActive
RankingBot
Rankivabot
RankurBot
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Screaming
ScreenerBot
Seekport
Siphon
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
SlySearch
Snapbot
Sosospider
SpaceBison
Spammen
Spinn3r
Steeler
SuperBot
Surfbot
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Trendictionbot
Turingos
Turnitin
Twice
URLy Warning
Vacuum
VelenPublicWebCrawler
Voil
WASALive-Bot
WBSearchBot
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Pix
WebAuto
WebImageCollector
WebLeacher
WebSucker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Webster
Wonderbot
Woobot
Wotbox
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
adscanner
arquivo.pt
coccocbot-web
cognitiveseo
crawler4j
dataforseo.com
instabid
iubenda-radar
lwp-trivial
meanpathbot
mediawords
oBot
plumanalytics
polaris version
satoristudio.net
scan.lol
seocompany.store
seoscanners
seostar
sexsearcher
sogouspider
ubermetrics-technologies.com
zauba.io
zgrab