nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-12 22:07:24 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
ALittle Client
Aboundexbot
AiHitBot
Alexibot
Anarchie
Ankit
Anthill
Asterias
Attach
AwarioRssBot
BDCbot
Backlink-Ceck
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Blow
Bolt
BotALot
Brandwatch
Buddy
Bullseye
BuzzSumo
CODE87
CheTeam
CherryPicker
Chlooe
Citoid
Claritybot
Cocolyzebot
Collector
Copier
Craftbot
CrazyWebCrawler
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DatabaseDriverMysqli
Demon
Devil
Disco
Discobot
DnBCrawler-Analytics
DnyzBot
DomainCrawler
Download Wonder
Dragonfly
Drip
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Fimap
FlashGet
Foobot
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GermCrawler
GetRight
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
HTTP::Lite
HTTrack
Heritrix
HonoluluBot
IRLbot
Id-search
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
Iskanie
IstellaBot
Jetty
JikeSpider
Jorgee
Kenjin Spider
Kinza
Kozmosbot
Larbin
Leap
LexiBot
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Majestic-SEO
Majestic12
Masscan
Mata Hari
Mb2345Browser
Minefield
Mojeek
Mr.4x3
Name Intelligence
Net Vampire
NetAnts
NetLyzer
NetZIP
Netcraft
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nmap
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeBot
OrangeSpider
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pandalytics
Panscient
Pavuk
PictureFinder
ProPowerBot
ProWebWalker
Probethenet
Psbot
Quick-Crawler
RankingBot2
Rankivabot
Re-re
ReGet
RedesScrapy
Rogerbot
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
ScanAlert
Scanbot
Scrapy
ScrepyBot
Searchestate
SearchmetricsBot
SentiBot
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
Snapbot
Sogou web spider
Spammen
SpankBot
Spinn3r
Szukacz
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Tracemyfile
Turingos
TurnitinBot
TwengaBot
Twice
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Pix
Web Sauger
WebBandit
WebCopier
WebImageCollector
WebLeacher
WebsiteExtractor
WebsiteQuester
Webster
Who.is Bot
Widow
WinHTTrack
Wotbox
Wprecon
Xenu
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
ZyBorg
adscanner
archive.org_bot
autoemailspider
clark-crawler
cognitiveseo
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
instabid
magpie-crawler
mediawords
netEstate NE Crawler
seobility
seocompany.store
seoscanners
sexsearcher
spyfu
sysscan
tAkeOut
trendiction.de
webmeup-crawler
zgrab