nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-21 22:07:16 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
Abonti
Acunetix
Aipbot
Alligator
Anarchie
Ankit
Anthill
Atomseobot
Attach
AwarioRssBot
BDCbot
BDFetch
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Black Hole
Blackboard
Boardreader
BotALot
BuiltBotTough
BunnySlippers
BuzzSumo
CSHttp
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Citoid
Cloud mapping
Cogentbot
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
Custo
DSearch
Demon
Digincore
DigitalPebble
Dirbuster
Discobot
DnBCrawler-Analytics
DnyzBot
DomainStatsBot
Domains Project
Dragonfly
EMail Wolf
EasyDL
ExtLinksBot
ExtractorPro
EyeNetIE
FDM
FHscan
Fimap
Flunky
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetWeb
Gotit
GrabNet
Grafula
GrapeFX
HTTP::Lite
HTTrack
Havij
Hloader
HonoluluBot
IDBTE4M
IDBot
Id-search
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
JOC Web Spider
JustView
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
Leap
LeechGet
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Linkbot
MIIxpc
MQQBrowser
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Mata Hari
MauiBot
MeanPath Bot
Metauri
Minefield
Mozlila
Msrabot
Nameprotect
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netcraft
NextGenSearchBot
Nibbler
Nmap
Not
Offline Explorer
OpenVAS
OrangeBot
OutfoxBot
PageScorer
PageThing.com
Panscient
Pi-Monster
Pixray
PleaseCrawl
Pump
PxBroker
QueryN Metasearch
RSSingBot
RankActive
RankurBot
ReGet
RealDownload
Reaper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SISTRIX
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Screaming
SearchmetricsBot
SemanticJuice
Semrush
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
Spanner
Spbot
SputnikBot
Sqworm
Steeler
Stripper
Sucuri
SuperBot
Swiftbot
TeleportPro
Telesoft
Telesphorep
Thumbor
TightTwatBot
Toata
Trendictionbot
True_Robot
Twice
UnisterBot
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
Voil
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Sucker
WebAuto
WebFetch
WebGo IS
WebLeacher
WebReaper
WebSauger
WebStripper
WebsiteQuester
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Zade
Zermelo
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
coccocbot
cognitiveseo
domainsproject.org
heritrix
magpie-crawler
mediawords
plumanalytics
s1z.ru
satoristudio.net
scan.lol
seocompany.store
seostar
sexsearcher
sitechecker.pro
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla