nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-09 22:07:23 +00:00

250 lines
2.7 KiB
Text

404enemy
80legs
AIBOT
ALittle Client
Abonti
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Asterias
AwarioRssBot
AwarioSmartBot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Barkrowler
Blackboard
BlowFish
Bolt
BotALot
BuiltBotTough
CODE87
CSHttp
CazoodleBot
Cegbfeieh
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Copier
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
DSearch
DTS Agent
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
EirGrabber
EroCrawler
ExtractorPro
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Freeuploader
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Havij
Heritrix
HybridBot
IDBot
IndeedBot
Intelliseek
Internet Ninja
Iria
JOC Web Spider
Jbrofuzz
Jorgee
Kenjin Spider
LWP::Simple
Lanshanbot
Larbin
LeechGet
LexiBot
Lightspeedsystems
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MQQBrowser
Magnet
Majestic12
MarkMonitor
Mass Downloader
Masscan
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
Name Intelligence
Nameprotect
Needle
NetLyzer
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Nikto
Ninja
Nmap
Nutch
Octopus
Offline Navigator
OpenVAS
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Petalbot
Pi-Monster
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Psbot
PxBroker
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
ReGet
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SISTRIX
Scrapy
ScreenerBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot
SputnikBot
Sqlmap
Sqlworm
Sqworm
SuperHTTP
Suzuran
T8Abot
Teleport
TheNomad
Trendiction
Trendictionbot
True_Robot
TwengaBot
Twice
Typhoeus
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VoidEYE
Voil
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers/3.0
Web Collage
Web Fetch
Web Fuck
Web Sucker
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebStripper
WebSucker
Webalta
Webshag
Website Quester
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Zade
Zermelo
Zitebot
ZumBot
ZyBorg
arquivo-web-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
dataforseo.com
facebookscraper
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
meanpathbot
mediawords
pcBrowser
seoscanners
sexsearcher
spyfu
tAkeOut
trendiction.com
trendiction.de
webmeup-crawler
webprosbot
x22Mozilla
xpymep1.exe