nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-07 22:07:34 +00:00

250 lines
2.6 KiB
Text

ALittle Client
ASPSeek
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Alligator
Anarchie
Anarchy
Anthill
Apexoo
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BDFetch
BLEXBot
Backlink-Ceck
Badass
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Blackboard
BlowFish
BotALot
Brandprotect
BuiltWith
Bullseye
CATExplorador
CODE87
CensysInspect
CheTeam
Chlooe
Citoid
Cliqzbot
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
Curious
DBLBot
Deusu
Digincore
DigitalPebble
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
Dotbot
Dragonfly
EasyDL
EirGrabber
EroCrawler
Exabot
Express WebPictures
ExtractorPro
EyeNetIE
Ezooms
FDM
FemtosearchBot
FlashGet
Flunky
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Getintent
Gigabot
GoZilla
GrapeFX
HMView
HTMLparser
IDBot
Iblog
Id-search
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
Iria
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
Jetty
Jorgee
Jyxobot
Larbin
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic-SEO
Masscan
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NPbot
Name Intelligence
NetAnts
NetSpider
Nettrack
Nibbler
Nikto
Nimbostratus
Nuclei
Octopus
Offline Explorer
OnCrawl
Openvas
OutfoxBot
PageGrabber
PageScorer
Pavuk
PictureFinder
Piepmatz
ProWebWalker
Pu_iN
Pump
PyCurl
RankActive
RankingBot
RankingBot2
RankurBot
ReGet
RealDownload
Ripper
Rogerbot
SBIder
SEOkicks-Robot
SISTRIX
Scanbot
Screaming
ScreenerBot
ScrepyBot
Semrush
SeoSiteCheckup
Siphon
Site Sucker
SiteExplorer
Sitebeam
Sitevigil
SmartDownload
Snapbot
Snoopy
Sottopop
Spammen
Spanner
Spbot
Spinn3r
Steeler
Sucuri
Surfbot
Telesoft
Telesphorep
Thumbor
True_Robot
Turingos
Typhoeus
URLy.Warning
Upflow
VB Project
Vacuum
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
Web Fuck
WebAuto
WebBandit
WebCollage
WebCopier
WebImageCollector
WebLeacher
WebSauger
Webalta
WebsiteExtractor
Who.is Bot
Woobot
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
Zermelo
Zeus
ZmEu
ZumBot
archive.org_bot
arquivo.pt
cah.io.community
check1.exe
clark-crawler
coccocbot
crawl.sogou.com
dataforseo.com
demandbase-bot
facebookscraper
gopher
instabid
internetVista monitor
ips-agent
magpie-crawler
oBot
pcBrowser
polaris version
probe-image-size
ripz
s1z.ru
seobility
seoscanners
sexsearcher
sysscan
trendiction.de
ubermetrics-technologies.com
x09Mozilla