nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-21 22:07:16 +00:00

250 lines
2.6 KiB
Text

80legs
Abonti
Acunetix
AiHitBot
Alexibot
Anarchie
Anarchy
Apexoo
BBBike
BDCbot
BackStreet
BacklinkCrawler
Badass
Bandit
BatchFTP
Bigfoot
BlackWidow
Blackboard
Blow
Buck
BuiltWith
BuzzSumo
CCBot
CODE87
CherryPicker
Chlooe
Citoid
Cliqzbot
Cloud mapping
Copier
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DBLBot
DataCha0s
Demon
Deusu
Dirbuster
Disco
Discobot
Dispatch
DomainSigmaCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
GridBot
HTTrack
Haansoft
Heritrix
Humanlinks
HybridBot
Image Fetch
IndeedBot
Indy Library
Intelliseek
InterGET
Internet Ninja
JennyBot
Jetty
Keybot Translation-Search-Machine
Larbin
Leap
Lftp
LibWeb
LieBaoFast
LinksManager
LinqiaRSSBot
Lmspider
MIDown tool
MJ12bot
MSFrontPage
Magnet
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
MeanPath Bot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
NPbot
Nameprotect
Navroad
Nessus
Net Vampire
NetMechanic
NetZIP
Netcraft
Nettrack
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nmap
Not
Nuclei
Nutch
Octopus
Openvas
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Papa Foto
PeoplePal
Piepmatz
Pimonster
Pixray
Pockey
Psbot
Pump
QueryN Metasearch
RSSingBot
RankActive
RankingBot
RankingBot2
Rankivabot
Re-re
Reaper
RebelMouse
RedesScrapy
Ripper
SBIder
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
ScanAlert
ScoutJet
Seekport
SemanticJuice
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitevigil
SmartDownload
Snoopy
Sogou web spider
Sottopop
Spammen
Spbot
Sqlworm
SuperBot
Surfbot
Suzuran
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
The Intraformant
Thumbor
Toata
Toweyabot
TwengaBot
V-BOT
Vacuum
VelenPublicWebCrawler
Virusdie
VoidEYE
WASALive-Bot
WWW-Collector-E
Web Collage
Web Fuck
WebAuto
WebCollage
WebLeacher
WebSauger
WebWhacker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
WinHTTrack
Wotbox
Xenu
Zade
Zeus
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
domainsproject.org
heritrix
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
mediawords
plumanalytics
probe-image-size
ripz
s1z.ru
scan.lol
seocompany.store
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webprosbot