nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-30 22:07:21 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
Aboundex
AiHitBot
Aipbot
Anarchy
Anarchy99
Ankit
Anthill
AwarioRssBot
BBBike
BLEXBot
BackDoorBot
BackWeb
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
Blow
BotALot
Brandwatch
Buddy
BuzzSumo
CCBot
CSHttp
CheTeam
Claritybot
Cocolyzebot
Cogentbot
Collector
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
DSearch
DataCha0s
Disco
Discobot
DnBCrawler-Analytics
DomCopBot
DomainAppender
Dotbot
Dragonfly
EMail Siphon
Exabot
Extractor
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
FlashGet
Flunky
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight
Go-Ahead-Got-It
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
Havij
IDBTE4M
Iblog
Id-search
Intelliseek
Iskanie
JOC Web Spider
Kinza
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LexiBot
Likse
LinkScan
Linkbot
LinksManager
Lipperhey
MSIECrawler
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Microsoft Data Access
Minefield
Mister PiX
Mojeek
Mozlila
Mr.4x3
Msrabot
Musobot
Name Intelligence
Nameprotect
Net Vampire
NetLyzer
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Nimbostratus
Nuclei
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Pimonster
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pu_iN
Quick-Crawler
RankActive
Rankivabot
RankurBot
RedesScrapy
RepoMonkey
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
ScrepyBot
Searchestate
SearchmetricsBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteExplorer
SiteSucker
SlySearch
Snapbot
Snoopy
Sosospider
Sottopop
SpaceBison
Spinn3r
Sqworm
Steeler
Stripper
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Telesphoreo
The Intraformant
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
Typhoeus
URLy.Warning
Upflow
V-BOT
VCI
Vagabondo
VeriCiteCrawler
VoidEYE
WBSearchBot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebFetch
WebLeacher
WebPix
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Webster
Whatweb
Widow
Woobot
Wprecon
YoudaoBot
Zermelo
ZyBorg
adscanner
arquivo.pt
autoemailspider
crawler.feedback
crawler4j
demandbase-bot
heritrix
ips-agent
isitwp.com
oBot
plumanalytics
polaris version
ripz
satoristudio.net
scan.lol
seobility
seocompany.store
seoscanners
seostar
serpstatbot
sitechecker.pro
siteripz
spyfu
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
xpymep1.exe
zgrab