nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-08 22:07:10 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
AIBOT
ASPSeek
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
Alligator
Ankit
Apexoo
Attach
AwarioSmartBot
BDFetch
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Bigfoot
BlackWidow
Blackboard
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
Buddy
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CSHttp
Cegbfeieh
CherryPicker
ChinaClaw
Citoid
Claritybot
Cliqzbot
Collector
Copier
Craftbot
Crawling at Home Project
Custo
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Dirbuster
Disco
Dispatch
DomCopBot
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
EasyDL
Ebingbong
EroCrawler
Evil
Exabot
Extractor
Extreme Picture Finder
Foobot
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
Getintent
Go!Zilla
Go-Ahead-Got-It
GrapeshotCrawler
HTMLparser
Haansoft
HaosouSpider
Heritrix
HonoluluBot
IRLbot
InfoNaviRobot
InfoTekies
Intelliseek
Iria
Iskanie
Jbrofuzz
JetCar
Jyxobot
Kenjin Spider
Kinza
Lanshanbot
Larbin
LeechFTP
LeechGet
Libwhisker
LieBaoFast
LinkWalker
LinkextractorPro
LinqiaRSSBot
Ltx71
MFC_Tear_Sample
MIIxpc
Majestic12
MarkMonitor
Mass Downloader
MauiBot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mr.4x3
Musobot
NICErsPRO
NearSite
Net Vampire
NetAnts
NetSpider
Netcraft
Nettrack
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Nmap
Not
Nutch
Octopus
Offline Navigator
OpenVAS
Openfind
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Pavuk
PeoplePal
PictureFinder
Piepmatz
Pixray
Pockey
ProPowerBot
Probethenet
PxBroker
RSSingBot
RankActive
RankingBot2
Re-re
ReGet
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
SBIder
SEOkicks
SEOlyticsCrawler
Screaming
ScreenerBot
Searchestate
SemanticJuice
Semrush
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SlySearch
Snoopy
Spammen
SpankBot
Sqlmap
Sqlworm
Sucuri
SuperHTTP
Suzuran
TheNomad
Thumbor
Trendiction
True_Robot
Turingos
URLy Warning
URLy.Warning
UnisterBot
Upflow
VidibleScraper
Voltron
WBSearchBot
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebEnhancer
WebImageCollector
WebReaper
WebsiteExtractor
Webster
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Zeus
ZumBot
ZyBorg
archive.org_bot
autoemailspider
backlink-check
com.plumanalytics
crawl.sogou.com
evc-batch
facebookscraper
heritrix
ips-agent
isitwp.com
iubenda-radar
magpie-crawler
meanpathbot
oBot
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
serpstatbot
sitechecker.pro
spyfu
tAkeOut
voyagerx.com
x09Mozilla