nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-29 22:07:12 +00:00

250 lines
2.5 KiB
Text

AIBOT
ALittle Client
ASPSeek
Aboundex
AhrefsBot
AiHitBot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy99
Ankit
Aspiegel
AwarioRssBot
BBBike
BDFetch
BackWeb
Badass
Bigfoot
BlackWidow
Blackboard
Blow
BlowFish
Bolt
Brandprotect
Brandwatch
Buck
Buddy
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CODE87
Cegbfeieh
Citoid
Claritybot
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrunchBot
Custo
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainCrawler
Dragonfly
Drip
ECCP/1.0
EasyDL
EroCrawler
Extreme Picture Finder
Ezooms
FemtosearchBot
Flunky
Foobot
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HMView
Haansoft
Harvest
Havij
Hloader
IDBTE4M
IDBot
IlseBot
Image Fetch
Indy Library
Internet Ninja
Iskanie
Jetty
JikeSpider
Joomla
Jorgee
JustView
Kinza
Larbin
Lftp
Libwhisker
LieBaoFast
Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MQQBrowser
MTRobot
Magnet
Majestic SEO
Majestic12
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
MegaIndex.ru
Metauri
Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
Musobot
NICErsPRO
Name Intelligence
NearSite
Net Vampire
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nmap
Not
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OrangeBot
OutclicksBot
PageAnalyzer
PageScorer
Petalbot
Pimonster
PleaseCrawl
Probethenet
Psbot
Pu_iN
PxBroker
RankActive
RankFlex
Rankivabot
Re-re
Reaper
Recorder
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
ScanAlert
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
SiteExplorer
SiteSucker
Sociscraper
Sogou web spider
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
Sqworm
Steeler
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Teleport
The Intraformant
Titan
Toata
Toweyabot
True_Robot
TwengaBot
Typhoeus
Upflow
VelenPublicWebCrawler
VoidEYE
Voil
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
Web Auto
Web Pix
Web Sauger
WebBandit
WebCollage
WebEnhancer
WebFuck
WebLeacher
WebPix
WebSucker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whacker
Whatweb
Widow
WinHTTrack
Wonderbot
Wprecon
Xenu
Zermelo
ZmEu
ZoominfoBot
ZumBot
adscanner
archive.org_bot
backlink-check
check1.exe
crawler.feedback
domainsproject.org
eCatch
evc-batch
facebookscraper
ips-agent
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
page scorer
satoristudio.net
seoscanners
seostar
sexsearcher
sogouspider
sysscan
trendiction.com
trendiction.de
voyagerx.com
webpros.com
zauba.io
zgrab