nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-22 10:09:22 +00:00

250 lines
2.6 KiB
Text

ASPSeek
Aboundex
AiHitBot
Aipbot
AllSubmitter
Anarchie
Ankit
Apexoo
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackWeb
Backlink-Ceck
Bandit
Barkrowler
Black Hole
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CSHttp
CheTeam
ChinaClaw
Chlooe
Citoid
Cogentbot
Collector
Craftbot
Crawling at Home Project
Crescent
Custo
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
Demon
Digincore
DigitalPebble
Dispatch
DittoSpyder
DomCopBot
DomainAppender
Download Wonder
Drip
EMail Wolf
EasyDL
Ebingbong
EroCrawler
Express WebPictures
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
FlashGet
Flunky
Freeuploader
GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
Gotit
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTMLparser
HTTrack
Hloader
HybridBot
IDBTE4M
IRLbot
Id-search
Image Fetch
Intelliseek
Internet Ninja
Iria
IstellaBot
JamesBOT
Jbrofuzz
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot
LeechGet
Lightspeedsystems
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MSFrontPage
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
Mediatoolkitbot
Microsoft URL Control
Minefield
Mister PiX
Mozlila
Msrabot
Musobot
NearSite
Net Vampire
Netcraft
Nettrack
Nibbler
Nikto
NimbleCrawler
OpenLinkProfiler
OpenVAS
Openvas
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Panscient
Papa Foto
PeoplePal
Piepmatz
Pimonster
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot2
Re-re
RealDownload
Reaper
RepoMonkey
SBIder
SEOkicks
SEOstats
SISTRIX
SMTBot
ScanAlert
ScoutJet
Scrapy
ScreenerBot
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Siphon
SiteExplorer
SiteSnagger
Siteimprove
SlySearch
Snake
Snapbot
Sogou web spider
Sosospider
Sottopop
SpaceBison
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqworm
SuperHTTP
Surfbot
Suzuran
Szukacz
Telesphorep
TheNomad
Thumbor
TightTwatBot
True_Robot
Turingos
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
Vacuum
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voltron
WASALive-Bot
WISENutbot
WPScan
WWWOFFLE
Wallpapers
Web Collage
Web Sucker
WebCollage
WebCopier
WebFuck
WebLeacher
Webalta
Website Quester
WebsiteExtractor
Whacker
Woobot
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
Zeus
ZyBorg
arquivo.pt
cah.io.community
check1.exe
coccocbot
com.plumanalytics
crawler4j
demandbase-bot
eCatch
linkdexbot
lwp-request
magpie-crawler
mediawords
muhstik-scan
oBot
ripz
scan.lol
seobility
seoscanners
sexsearcher
sitechecker.pro
siteripz
sogouspider
tAkeOut
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab