nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-02 10:09:39 +00:00

250 lines
2.5 KiB
Text

404checker
404enemy
Aboundex
Acunetix
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Ankit
Asterias
AwarioRssBot
BBBike
BDCbot
BDFetch
BackStreet
Badass
BatchFTP
Battleztar Bazinga
BetaBot
Blow
BotALot
Buck
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CSHttp
Cegbfeieh
CensysInspect
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Copyscape
DBLBot
DIIbot
Demon
Deusu
Digincore
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Drip
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
EirGrabber
EroCrawler
Exabot
Extractor
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
FlashGet
Foobot
Freeuploader
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grafula
GridBot
HMView
Haansoft
HonoluluBot
HybridBot
Iblog
IlseBot
Image Sucker
IndeedBot
InfoTekies
Internet Ninja
InternetSeer
Iria
Iskanie
JOC Web Spider
JamesBOT
Jetty
JikeSpider
Joomla
JustView
Kinza
Kozmosbot
LNSpiderguy
LeechFTP
Lftp
Libwhisker
Likse
LinkWalker
LinksManager
Lipperhey Spider
MIIxpc
Mag-Net
Majestic SEO
MarkMonitor
Mata Hari
MauiBot
Metauri
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojeek
Mozlila
Mr.4x3
NICErsPRO
Needle
NetAnts
NetLyzer
NetZIP
Niki-bot
Nimbostratus
Ninja
Nutch
OrangeBot
PECL::HTTP
PageGrabber
PageThing.com
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
Pimonster
Pump
PxBroker
QueryN Metasearch
Rankivabot
RebelMouse
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SalesIntelligent
ScanAlert
Screaming
Searchestate
Semrush
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteSnagger
Siteimprove
SmartDownload
Snoopy
SocialRankIOBot
Sosospider
Spammen
SpankBot
Spanner
SputnikBot
Sqlmap
Sqworm
Stripper
SuperHTTP
Surfbot
Swiftbot
T0PHackTeam
Teleport
Telesoft
Telesphorep
TheNomad
Titan
Tracemyfile
Trendiction
Trendictionbot
Twice
URLy Warning
Upflow
V-BOT
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
VoidEYE
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Fetch
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebBandit
WebFetch
WebFuck
WebReaper
WebSauger
WebSucker
Webshag
Whacker
Who.is Bot
WinHTTrack
Xaldon WebSpider
Zitebot
ZmEu
ZoomBot
archive.org_bot
autoemailspider
cah.io.community
clark-crawler
crawl.sogou.com
demandbase-bot
domainsproject.org
facebookscraper
gopher
ips-agent
isitwp.com
linkdexbot
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
pcBrowser
plumanalytics
s1z.ru
scalaj-http
scan.lol
seocompany.store
serpstatbot
sexsearcher
siteripz
sogouspider
sp_auditbot
tAkeOut
trendiction.de
webmeup-crawler
webprosbot
x09Mozilla
zauba.io