nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-22 22:07:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
AhrefsBot
AllSubmitter
Anarchie
Anarchy
Anarchy99
Apexoo
BBBike
BDFetch
BLEXBot
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Bigfoot
Black Hole
Blow
Bolt
BotALot
Brandwatch
BuiltWith
BuzzSumo
CATExplorador
CCBot
CODE87
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Citoid
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Cosmos
Craftbot
Curious
CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
DigitalPebble
Disco
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
Evil
Exabot
Express WebPictures
FHscan
Fimap
Foobot
Freeuploader
FrontPage
GalaxyBot
GetWeb
Getintent
Gigabot
GoZilla
GrabNet
Grabber
Grafula
GridBot
HTMLparser
HaosouSpider
Heritrix
IDBTE4M
IDBot
IRLbot
Id-search
IlseBot
Indy Library
InfoNaviRobot
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
LNSpiderguy
Larbin
Leap
LeechFTP
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Ltx71
MIIxpc
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Masscan
MeanPath Bot
MicroMessenger
Microsoft URL Control
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
Navroad
Nessus
Net Vampire
NetAnts
NetMechanic
Netvibes
NimbleCrawler
Nuclei
Nutch
Octopus
OpenLinkProfiler
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Panscient
Papa Foto
PeoplePal
Pi-Monster
Picsearch
Pixray
Pockey
Pump
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
ReGet
Reaper
RebelMouse
Ripper
SMTBot
ScanAlert
ScreenerBot
Searchestate
SearchmetricsBot
SiteCheckerBotCrawler
SiteSnagger
Sitevigil
Sogou web spider
Spanner
Sqlmap
Steeler
Sucker
Suzuran
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
Toata
Toweyabot
Turnitin
TurnitinBot
Typhoeus
URLy Warning
Upflow
VB Project
VCI
VeriCiteCrawler
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Auto
Web Enhancer
Web Pix
Web Sucker
WebImageCollector
WebPix
WebReaper
WebZIP
Website Quester
WebsiteQuester
Webster
Whacker
Whatweb
WinHTTrack
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
Zade
Zermelo
Zeus
ZoomBot
ZumBot
ZyBorg
archive.org_bot
cah.io.community
check1.exe
clark-crawler
com.plumanalytics
crawler4j
demandbase-bot
evc-batch
facebookscraper
heritrix
linkdexbot
lwp-trivial
magpie-crawler
mediawords
muhstik-scan
probe-image-size
satoristudio.net
seocompany.store
sp_auditbot
spyfu
sysscan
tAkeOut
trendiction.com
webmeup-crawler
webpros.com
x22Mozilla
zgrab