nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-23 22:07:09 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ALittle Client
ASPSeek
Abonti
Aboundex
AhrefsBot
AiHitBot
Alligator
Anarchie
Anarchy
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
Backlink-Ceck
BacklinkCrawler
Barkrowler
Bigfoot
Black Hole
Blackboard
Blow
BlowFish
Bolt
BotALot
BuiltBotTough
Bullseye
CODE87
Calculon
CazoodleBot
CheTeam
CheeseBot
Chlooe
Cliqzbot
Cogentbot
Collector
Copyscape
Crawling at Home Project
Crescent
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
Digincore
DigitalPebble
Discobot
Dispatch
DnyzBot
DomainStatsBot
Drip
EMail Siphon
EasyDL
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FHscan
FemtosearchBot
FlashGet
Freeuploader
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Grabber
Grafula
GrapeshotCrawler
HTMLparser
HTTrack
Haansoft
Havij
Iblog
Id-search
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
Iria
JamesBOT
JetCar
Jetty
Joomla
JustView
Kenjin Spider
Kozmosbot
LeechFTP
LeechGet
LibWeb
Likse
LinkWalker
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
Mail.RU_Bot
Mass Downloader
Masscan
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Nessus
Net Vampire
NetSpider
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Nutch
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Papa Foto
Petalbot
Pi-Monster
Piepmatz
Pimonster
ProPowerBot
ProWebWalker
Probethenet
Psbot
RankFlex
RankurBot
Reaper
RepoMonkey
SBIder
SEOprofiler
SISTRIX
SalesIntelligent
ScoutJet
Searchestate
SemrushBot
SeobilityBot
Siphon
SiteSnagger
SlySearch
Sociscraper
Sogou web spider
Spanner
Spinn3r
Stripper
SuperHTTP
Suzuran
Swiftbot
TeleportPro
Telesphorep
The Intraformant
Trendiction
True_Robot
Turingos
TurnitinBot
Typhoeus
UnisterBot
VB Project
VelenPublicWebCrawler
Virusdie
Voil
Voltron
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Fetch
Web Pix
Web Sauger
WebCollage
WebCopier
WebFetch
WebReaper
Webalta
Webster
Whacker
Xaldon_WebSpider
Zade
Zauba
Zermelo
ZmEu
ZoomBot
ZoominfoBot
ZyBorg
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
coccocbot-web
crawl.sogou.com
demandbase-bot
eCatch
facebookscraper
gopher
internetVista monitor
isitwp.com
lwp-request
magpie-crawler
meanpathbot
muhstik-scan
page scorer
plumanalytics
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seostar
serpstatbot
siteripz
spyfu
tAkeOut
voyagerx.com
x09Mozilla
xpymep1.exe
zauba.io