nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-25 10:10:44 +00:00

250 lines
2.5 KiB
Text

80legs
ADmantX
AIBOT
Abonti
Aboundex
Alexibot
AllSubmitter
Anarchy
Anarchy99
Ankit
Anthill
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackWeb
BacklinkCrawler
Battleztar Bazinga
Bitacle
Black Hole
Bolt
BotALot
Buddy
BuiltBotTough
CCBot
CODE87
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
DSearch
DTS Agent
Digincore
Dirbuster
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
Dragonfly
EasyDL
Ecxi
Evil
FDM
Firefox/7.0
Freeuploader
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GetWeb
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
Grafula
GridBot
HEADMasterSEO
HMView
Haansoft
HaosouSpider
Harvest
Havij
Hloader
IDBTE4M
IRLbot
Id-search
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
JamesBOT
JennyBot
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
Leap
LeechFTP
LeechGet
Lftp
LibWeb
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MIDown tool
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Majestic SEO
Masscan
Mb2345Browser
Meanpathbot
Metauri
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
NICErsPRO
NPbot
Name Intelligence
Navroad
Nessus
NetAnts
NetLyzer
Netcraft
NextGenSearchBot
NimbleCrawler
Nimbostratus
Ninja
Not
Nutch
Octopus
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
Openvas
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Papa Foto
Picsearch
PictureFinder
ProPowerBot
Pu_iN
Pump
PxBroker
PyCurl
QueryN Metasearch
RankingBot
RankurBot
Re-re
ReGet
Reaper
RebelMouse
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOprofiler
SEOstats
ScreenerBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteLockSpider
SiteSnagger
Siteimprove
Sitevigil
SmartDownload
Snapbot
Snoopy
Sosospider
SpaceBison
Spammen
SpankBot
Spbot
SputnikBot
Sucker
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
Teleport
TightTwatBot
Toata
Tracemyfile
Trendiction
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voltron
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Auto
Web Fetch
Web Sucker
WebBandit
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebStripper
Website Quester
WebsiteQuester
Whack
Whatweb
Who.is Bot
Wonderbot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
Zauba
Zermelo
Zeus
ZoomBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
com.plumanalytics
crawler4j
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
heritrix
oBot
plumanalytics
scan.lol
seocompany.store
sexsearcher
sogouspider
tAkeOut
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
x09Mozilla
x22Mozilla