nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-07 22:07:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchy99
Aspiegel
Atomseobot
Attach
AwarioRssBot
BBBike
BDCbot
BDFetch
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
Battleztar Bazinga
Blackboard
BlowFish
Brandwatch
Buck
BuzzSumo
CCBot
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
DSearch
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Wolf
Ecxi
EroCrawler
Evil
Exabot
Express WebPictures
EyeNetIE
FHscan
Flunky
Foobot
FrontPage
Fyrebot
GetRight
Gigabot
GoZilla
GrabNet
Grafula
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Heritrix
HybridBot
IDBTE4M
IndeedBot
InfoTekies
Intelliseek
Internet Ninja
IstellaBot
JOC Web Spider
JustView
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MIIxpc
Mag-Net
Mail.RU_Bot
MarkMonitor
MarkWatch
Mata Hari
Meanpathbot
Microsoft Data Access
Mister PiX
Mojolicious
Mr.4x3
Msrabot
Musobot
NPbot
Name Intelligence
Nameprotect
Needle
Nessus
Net Vampire
NetMechanic
NetZIP
Netcraft
Nibbler
Niki-bot
Nikto
Ninja
Not
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
PageGrabber
PageThing.com
Panscient
Picscout
Picsearch
PictureFinder
Piepmatz
Pockey
Psbot
RSSingBot
RankActive
Rankivabot
RankurBot
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
Site Sucker
SiteSnagger
Siteimprove
SmartDownload
Snoopy
Sociscraper
Sosospider
Spbot
SputnikBot
Sqlmap
Sqlworm
Sucker
SuperHTTP
Suzuran
Szukacz
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
VCI
Vagabondo
Virusdie
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers
WallpapersHD
Web Auto
Web Fuck
Web Sucker
WebAuto
WebPix
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Widow
Woobot
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZumBot
arquivo.pt
backlink-check
check1.exe
coccocbot
crawl.sogou.com
crawler4j
gopher
isitwp.com
lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
satoristudio.net
scan.lol
seocompany.store
seostar
serpstatbot
sitechecker.pro
sysscan
webmeup-crawler
x22Mozilla