nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-04 08:03:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Anarchy99
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
Badass
Barkrowler
BetaBot
Bigfoot
Bitacle
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CODE87
CSHttp
CheTeam
ChinaClaw
Cloud mapping
Cogentbot
Collector
Crawling at Home Project
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
Download Wonder
Dragonfly
Drip
EMail Wolf
EirGrabber
ExtLinksBot
Extreme Picture Finder
Ezooms
FHscan
Firefox/7.0
Flunky
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
Getintent
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
HTTP::Lite
HTTrack
Havij
Heritrix
Hloader
Id-search
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
Iskanie
JOC Web Spider
Jbrofuzz
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
Leap
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Likse
LinkWalker
LinkpadBot
LinqiaRSSBot
MJ12bot
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
MeanPath Bot
Metauri
Microsoft URL Control
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Name Intelligence
NetAnts
NetLyzer
NetMechanic
NetSpider
Netcraft
Nikto
Nimbostratus
Ninja
OnCrawl
Openfind
OrangeBot
OutfoxBot
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Panscient
PeoplePal
Petalbot
Pi-Monster
Picsearch
Pimonster
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot2
Rankivabot
ReGet
RealDownload
RebelMouse
RepoMonkey
Rogerbot
SEOkicks
SEOlyticsCrawler
SISTRIX
Scanbot
ScoutJet
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Seomoz
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
SlySearch
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
Spbot
Sqlworm
Steeler
Sucker
SuperBot
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
TeleportPro
Telesphorep
Thumbor
Titan
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
Typhoeus
URLy Warning
V-BOT
VB Project
Vacuum
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WPScan
WWW::Mechanize
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebCollage
WebFuck
WebWhacker
WebZIP
WebsiteExtractor
WebsiteQuester
Whatweb
Widow
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
check1.exe
clark-crawler
cognitiveseo
dataforseo.com
evc-batch
gopher
heritrix
instabid
internetVista monitor
isitwp.com
lwp-trivial
mediawords
muhstik-scan
page scorer
satoristudio.net
scan.lol
seocompany.store
seoscanners
serpstatbot
sitechecker.pro
spyfu
sysscan
tAkeOut
trendiction.com
x22Mozilla