nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-25 12:50:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Alligator
Anarchy99
Anthill
Atomseobot
AwarioSmartBot
BDCbot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
BatchFTP
BetaBot
Blackboard
BlowFish
Bolt
Buddy
CATExplorador
CazoodleBot
CheeseBot
CherryPicker
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Collector
Copier
Copyscape
Crescent
DIIbot
DTS Agent
DataCha0s
Deusu
Devil
DigitalPebble
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Wolf
Exabot
Express WebPictures
Extreme Picture Finder
Ezooms
FemtosearchBot
Flunky
GermCrawler
Go!Zilla
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
HaosouSpider
Harvest
Heritrix
HybridBot
IDBot
IRLbot
IlseBot
InfoTekies
Intelliseek
Iria
Iskanie
JamesBOT
JikeSpider
LWP::Simple
Lanshanbot
LexiBot
LibWeb
Lightspeedsystems
Likse
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Minefield
Mister PiX
Moblie Safari
Mozlila
Musobot
NPbot
Nameprotect
Navroad
Nessus
Net Vampire
Nettrack
NextGenSearchBot
Nikto
Octopus
Openfind
OrangeBot
OutclicksBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pu_iN
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RebelMouse
Recorder
SEOkicks-Robot
SEOstats
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Screaming
SemrushBot
SentiBot
SeoSiteCheckup
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
Snake
Sogou web spider
Sosospider
Sqlmap
Steeler
Sucker
Sucuri
Surfbot
SurveyBot
T8Abot
TeleportPro
The Intraformant
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
Turnitin
TwengaBot
Twice
URLy Warning
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW::Mechanize
WallpapersHD
Web Collage
Web Fuck
Web Pix
Web Sauger
WebCopier
WebEnhancer
WebGo IS
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
Website Quester
WebsiteQuester
Webster
Whacker
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
coccocbot
com.plumanalytics
crawler.feedback
demandbase-bot
eCatch
gopher
internetVista monitor
ips-agent
iubenda-radar
lwp-trivial
muhstik-scan
polaris version
ripz
scalaj-http
seocompany.store
seoscanners
sexsearcher
trendiction.com
webpros.com
webprosbot
x09Mozilla