nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-23 22:07:07 +00:00

250 lines
2.6 KiB
Text

360Spider
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator
Anthill
Aspiegel
AwarioSmartBot
BDFetch
Badass
Bigfoot
Black Hole
BlowFish
Boardreader
Bolt
BotALot
Bullseye
BunnySlippers
Cegbfeieh
Cloud mapping
Copier
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
Custo
DBLBot
DataCha0s
Demon
DigitalPebble
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Exabot
Extreme Picture Finder
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Heritrix
IDBTE4M
Iblog
Id-search
Image Fetch
InfoTekies
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Joomla
JustView
Kenjin Spider
Keyword Density
LWP::Simple
Lanshanbot
LeechGet
Lftp
LibWeb
LinkScan
LinkextractorPro
LinqiaRSSBot
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Magnet
Majestic-SEO
Mass Downloader
Masscan
Mb2345Browser
Mister PiX
Mr.4x3
Name Intelligence
Navroad
NetLyzer
NetSpider
NetZIP
Nettrack
Netvibes
Ninja
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
PeoplePal
Petalbot
Pi-Monster
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pump
QueryN Metasearch
RankingBot2
Re-re
RealDownload
Recorder
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOprofiler
ScanAlert
ScoutJet
ScreenerBot
Searchestate
SemanticJuice
SentiBot
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteExplorer
SiteSnagger
Siteimprove
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Spammen
SpankBot
Spanner
Spbot
Sqlmap
Stripper
Sucuri
SurveyBot
Suzuran
Swiftbot
Szukacz
Teleport
TeleportPro
The Intraformant
TheNomad
Thumbor
Toata
Tracemyfile
Trendiction
True_Robot
Turnitin
Typhoeus
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WPScan
WWW-Mechanize
Wallpapers
WeSEE
Web Auto
Web Collage
Web Fetch
Web Pix
WebFuck
WebGo IS
WebLeacher
Webshag
WebsiteQuester
Whack
Whacker
WinHTTrack
Wprecon
Xaldon_WebSpider
Xenu
Zauba
Zermelo
ZyBorg
arquivo.pt
backlink-check
cah.io.community
clark-crawler
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
internetVista monitor
meanpathbot
netEstate NE Crawler
oBot
page scorer
pcBrowser
plumanalytics
probe-image-size
seocompany.store
seostar
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
webpros.com
webprosbot
zgrab