nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-13 10:09:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
ADmantX
AIBOT
ASPSeek
Abonti
Aboundex
AlphaBot
Anarchy
Ankit
Anthill
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
Battleztar Bazinga
Bigfoot
Blow
BlowFish
Boardreader
Brandprotect
Buck
Buddy
BuiltBotTough
BuzzSumo
Cegbfeieh
Claritybot
Cogentbot
Collector
CopyRightCheck
Copyscape
CrazyWebCrawler
Crescent
Curious
DSearch
DataCha0s
Demon
Deusu
Dirbuster
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainSigmaCrawler
Dragonfly
Drip
EMail Siphon
EMail Wolf
EroCrawler
Evil
Express WebPictures
Firefox/7.0
FrontPage
Fuzz
Fyrebot
GalaxyBot
GermCrawler
Gigabot
Go-Ahead-Got-It
Grabber
Grafula
GridBot
Haansoft
Harvest
Heritrix
Hloader
Humanlinks
Image Fetch
Image Sucker
IndeedBot
InfoTekies
InterGET
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
JetCar
Jorgee
JustView
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LieBaoFast
Likse
LinkScan
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MTRobot
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
Mata Hari
MeanPath Bot
Microsoft Data Access
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
NearSite
Needle
Nessus
NetAnts
NetSpider
Netvibes
Nikto
Nmap
Not
Nutch
Octopus
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Papa Foto
Pavuk
PeoplePal
Picsearch
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Quick-Crawler
RankActiveLinkBot
Re-re
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
RocketCrawler
SEOlyticsCrawler
SEOstats
SISTRIX
SearchmetricsBot
Semrush
Shodan
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Snoopy
Sogou web spider
Sosospider
Spammen
Steeler
Sucker
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
T8Abot
Teleport
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Trendiction
Turingos
TwengaBot
Twice
Typhoeus
VB Project
VeriCiteCrawler
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Sauger
WebBandit
WebCollage
WebEnhancer
WebPix
WebStripper
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whacker
WiseGuys Robot
Wonderbot
Zauba
Zermelo
Zeus
ZmEu
ZoominfoBot
archive.org_bot
arquivo.pt
crawl.sogou.com
dataforseo.com
demandbase-bot
eCatch
gopher
isitwp.com
iubenda-radar
lwp-trivial
magpie-crawler
muhstik-scan
oBot
pcBrowser
s1z.ru
scan.lol
seobility
seocompany.store
seostar
sexsearcher
siteripz
sp_auditbot
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com