nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-02 22:06:57 +00:00

250 lines
2.5 KiB
Text

404enemy
ADmantX
AIBOT
AllSubmitter
Alligator
Ankit
Anthill
Apexoo
BDFetch
BackStreet
Backlink-Ceck
Bandit
Bitacle
Black Hole
Brandprotect
Buck
Buddy
BuzzSumo
CATExplorador
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
Claritybot
Cocolyzebot
Cogentbot
Collector
Copier
Copyscape
Cosmos
Craftbot
Crescent
DTS Agent
Devil
DigitalPebble
Disco
Discoverybot
DnyzBot
DomainCrawler
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
Express WebPictures
Extractor
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Fimap
Firefox/7.0
FyberSpider
G-i-g-a-b-o-t
GermCrawler
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
HEADMasterSEO
HaosouSpider
Havij
Heritrix
HonoluluBot
HybridBot
IRLbot
Id-search
IndeedBot
Indy Library
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iria
Jbrofuzz
JennyBot
Jetty
JikeSpider
Joomla
Jyxobot
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Lanshanbot
Larbin
Leap
LeechFTP
LeechGet
LexiBot
LibWeb
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
MarkMonitor
MarkWatch
MauiBot
Minefield
Mister PiX
Mojeek
NICErsPRO
NPbot
Navroad
NetMechanic
NetSpider
Netvibes
Nikto
Not
Offline Explorer
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
PictureFinder
Piepmatz
Pimonster
Pockey
PyCurl
QueryN Metasearch
RankFlex
Rankivabot
ReGet
Recorder
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScoutJet
Scrapy
Semrush
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
Siteimprove
SmartDownload
Snoopy
Sociscraper
Sottopop
Spammen
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucker
SuperBot
SuperHTTP
T8Abot
Teleport
Telesphorep
The Intraformant
TightTwatBot
Titan
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
V-BOT
VidibleScraper
Virusdie
Voltron
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
Web Auto
Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteQuester
Whack
Whacker
WinHTTrack
Woobot
Wotbox
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZyBorg
archive.org_bot
backlink-check
demandbase-bot
domainsproject.org
evc-batch
gopher
isitwp.com
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
plumanalytics
satoristudio.net
scan.lol
seoscanners
sp_auditbot
voyagerx.com
webmeup-crawler
webpros.com
zauba.io