nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-20 22:07:06 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
AIBOT
ASPSeek
Abonti
Alligator
AlphaBot
Anthill
Attach
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
BackStreet
BatchFTP
BetaBot
BlackWidow
BlowFish
Brandwatch
CATExplorador
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Copyscape
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Digincore
DigitalPebble
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Dragonfly
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
Evil
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Freeuploader
FrontPage
Fuzz
FyberSpider
GT::WWW
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
Grabber
HTMLparser
HTTrack
Haansoft
Harvest
Havij
IDBTE4M
IDBot
Image Sucker
IndeedBot
IstellaBot
JOC Web Spider
JennyBot
JetCar
Jetty
Jyxobot
Keyword Density
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
Likse
Linkbot
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MQQBrowser
MSFrontPage
MarkMonitor
Masscan
Mata Hari
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Mojolicious
Mozlila
Msrabot
Musobot
NPbot
Navroad
Needle
Net Vampire
NetAnts
NextGenSearchBot
Nibbler
Nimbostratus
Ninja
Nuclei
Octopus
OrangeSpider
PECL::HTTP
Pandalytics
Pi-Monster
Picsearch
Piepmatz
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Pump
RankurBot
ReGet
Reaper
Recorder
RocketCrawler
Rogerbot
SEOkicks
SMTBot
Scanbot
ScoutJet
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemanticJuice
SentiBot
SiteExplorer
SiteSnagger
SiteSucker
Snake
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Steeler
SuperHTTP
Szukacz
TeleportPro
Telesoft
TheNomad
Thumbor
Trendiction
Trendictionbot
Turingos
TurnitinBot
URLy Warning
VB Project
VCI
Virusdie
Voil
Voltron
WBSearchBot
WISENutbot
WWW-Collector-E
WWW-Mechanize
WeSEE
Web Collage
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
Webalta
Website Quester
Whack
Whacker
Who.is Bot
WinHTTrack
Wprecon
Xaldon_WebSpider
Xenu
Zade
Zermelo
Zeus
ZmEu
ZoomBot
adscanner
archive.org_bot
cah.io.community
check1.exe
coccocbot-web
com.plumanalytics
crawler.feedback
domainsproject.org
eCatch
evc-batch
heritrix
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
netEstate NE Crawler
polaris version
ripz
sexsearcher
siteripz
sogouspider
sysscan
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
x09Mozilla
zauba.io