nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-23 10:09:21 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
Alexibot
Anarchy99
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
Bitacle
Blackboard
BlowFish
Bolt
BotALot
Buck
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Chlooe
Cliqzbot
Cogentbot
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
Curious
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Dirbuster
Disco
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EroCrawler
Express WebPictures
ExtLinksBot
EyeNetIE
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Freeuploader
FyberSpider
GermCrawler
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
Haansoft
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
Iblog
Image Fetch
InterGET
InternetSeer
Iria
JamesBOT
JikeSpider
Kenjin Spider
Lanshanbot
Leap
LeechFTP
LeechGet
LexiBot
LieBaoFast
Likse
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MauiBot
Meanpathbot
Metauri
MicroMessenger
Mister PiX
Moblie Safari
Navroad
NearSite
Needle
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Ninja
Nuclei
Octopus
OrangeSpider
PECL::HTTP
PageScorer
Pixray
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
Quick-Crawler
Rankivabot
RankurBot
Re-re
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
SEOkicks
SEOstats
SalesIntelligent
Scanbot
Scrapy
Searchestate
SearchmetricsBot
SentiBot
Shodan
Siphon
SiteSucker
Siteimprove
SlySearch
Snake
Snapbot
Snoopy
Sosospider
Spanner
SputnikBot
Sqlmap
Sqworm
Steeler
Sucker
Sucuri
SurveyBot
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
Titan
Tracemyfile
Trendictionbot
Turingos
Twice
UnisterBot
Upflow
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Web Pix
Web Sauger
WebAuto
WebBandit
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebStripper
WebSucker
WebWhacker
Webalta
Webster
Whacker
Whatweb
Widow
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
YoudaoBot
Zermelo
ZoominfoBot
adscanner
autoemailspider
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
crawl.sogou.com
eCatch
heritrix
instabid
lwp-request
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
probe-image-size
satoristudio.net
scalaj-http
serpstatbot
sitechecker.pro
siteripz
sogouspider
spyfu
voyagerx.com
webpros.com
xpymep1.exe
zauba.io