nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-04 22:07:32 +00:00

250 lines
2.5 KiB
Text

80legs
ASPSeek
Aboundexbot
Acunetix
Alexibot
AllSubmitter
Alligator
AlphaBot
Anarchie
Apexoo
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BlackWidow
Blackboard
Blow
Buddy
BunnySlippers
BuzzSumo
CCBot
CODE87
Calculon
Cegbfeieh
Citoid
Cliqzbot
Collector
Copier
Copyscape
Curious
DIIbot
DatabaseDriverMysqli
Deusu
Digincore
Discoverybot
DnyzBot
DomCopBot
DomainSigmaCrawler
Domains Project
ECCP/1.0
EMail Siphon
EMail Wolf
Express WebPictures
Ezooms
FHscan
Fimap
Firefox/7.0
FlashGet
Flunky
FrontPage
FyberSpider
Fyrebot
Genieo
GetRight
GetWeb
Getintent
Gigabot
GoZilla
Gotit
Grabber
Grafula
GrapeFX
HMView
HTMLparser
Haansoft
Havij
HonoluluBot
Humanlinks
IRLbot
Image Sucker
Intelliseek
InterGET
Internet Ninja
Iskanie
JetCar
Jetty
Joomla
Jorgee
Keybot Translation-Search-Machine
Kinza
LWP::Simple
Lanshanbot
Larbin
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
Ltx71
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Msrabot
Musobot
Needle
Nessus
NetMechanic
Netvibes
Nmap
Nutch
OnCrawl
OpenVAS
Openfind
Openvas
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Petalbot
Pimonster
Pixray
Pockey
ProWebWalker
Psbot
Pu_iN
PyCurl
QueryN Metasearch
RankFlex
Rankivabot
ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
Sitevigil
Snoopy
Sociscraper
Sogou web spider
Sosospider
Spammen
Spanner
Spbot
SputnikBot
Sqlmap
Sqworm
Sucuri
SuperBot
Surfbot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Telesoft
TheNomad
Thumbor
Toweyabot
Trendiction
Turingos
TurnitinBot
Twice
URLy Warning
UnisterBot
V-BOT
VoidEYE
WISENutbot
WPScan
WWW::Mechanize
Web Fetch
Web Pix
Web Sucker
WebAuto
WebFetch
WebLeacher
WebPix
WebZIP
WebsiteExtractor
Webster
Whack
Whatweb
WinHTTrack
Woobot
Xenu
Zauba
Zermelo
Zeus
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
cah.io.community
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
facebookscraper
gopher
internetVista monitor
ips-agent
iubenda-radar
lwp-trivial
mediawords
muhstik-scan
plumanalytics
polaris version
ripz
s1z.ru
scalaj-http
seobility
serpstatbot
sexsearcher
siteripz
sogouspider
sp_auditbot
spyfu
voyagerx.com
webpros.com
webprosbot
x09Mozilla
xpymep1.exe