nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-14 22:08:21 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
ASPSeek
Aboundex
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy99
Ankit
Apexoo
AwarioSmartBot
BDCbot
Black Hole
BlackWidow
Blow
BotALot
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
CODE87
Cegbfeieh
CensysInspect
Chlooe
Cocolyzebot
Cogentbot
Crescent
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DomainCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
EroCrawler
EyeNetIE
FDM
FemtosearchBot
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetRight
Getintent
GrabNet
Grabber
GrapeFX
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Hloader
IDBot
Id-search
IndeedBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iria
JikeSpider
Keyword Density
LNSpiderguy
Leap
Lftp
Libwhisker
Lightspeedsystems
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
Masscan
Mb2345Browser
MeanPath Bot
MicroMessenger
Mister PiX
Mojeek
Mojolicious
Mozlila
Mr.4x3
NICErsPRO
Navroad
Net Vampire
NetAnts
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Nmap
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
Papa Foto
Pavuk
PeoplePal
Picsearch
Piepmatz
PleaseCrawl
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
ReGet
RealDownload
RebelMouse
Recorder
SEOkicks
SEOlyticsCrawler
SISTRIX
ScanAlert
Scanbot
ScoutJet
ScreenerBot
SemrushBot
Seomoz
Shodan
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
SlySearch
Snake
SocialRankIOBot
Sottopop
Spammen
Spanner
Sqlmap
Sqworm
SuperBot
Szukacz
TeleportPro
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turingos
Twice
Typhoeus
V-BOT
VB Project
Vacuum
VeriCiteCrawler
Voltron
WBSearchBot
Wallpapers
WallpapersHD
Web Auto
Web Fuck
WebEnhancer
WebFetch
WebImageCollector
WebReaper
WebSauger
WebSucker
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zitebot
ZmEu
ZoomBot
ZumBot
ZyBorg
archive.org_bot
autoemailspider
cah.io.community
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
crawl.sogou.com
crawler.feedback
dataforseo.com
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
heritrix
internetVista monitor
isitwp.com
mediawords
plumanalytics
s1z.ru
scalaj-http
seobility
siteripz
spyfu
sysscan
tAkeOut
voyagerx.com
webprosbot
xpymep1.exe
zgrab