nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-18 22:07:18 +00:00

250 lines
2.6 KiB
Text

404enemy
ASPSeek
Abonti
Aboundexbot
Acunetix
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy
Apexoo
AwarioRssBot
AwarioSmartBot
BLEXBot
BackStreet
BacklinkCrawler
Badass
BetaBot
Bitacle
BlackWidow
Blow
BlowFish
Boardreader
Bolt
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CCBot
CODE87
CensysInspect
CherryPicker
Citoid
Claritybot
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Devil
Discobot
Discoverybot
Dispatch
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
EMail Wolf
EasyDL
Ecxi
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Foobot
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
Go!Zilla
Gotit
HTMLparser
Haansoft
HaosouSpider
Havij
Heritrix
HybridBot
IDBTE4M
Id-search
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
JamesBOT
JennyBot
JikeSpider
JustView
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
LeechGet
Lftp
LibWeb
Libwhisker
Likse
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MSIECrawler
MTRobot
Mag-Net
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MolokaiBot
Mozlila
Mr.4x3
Navroad
NetAnts
NetMechanic
Nibbler
Niki-bot
Nmap
Not
Nutch
OpenLinkProfiler
Openvas
OrangeBot
PECL::HTTP
PageScorer
Pandalytics
Panscient
Papa Foto
Petalbot
Pi-Monster
PleaseCrawl
ProWebWalker
Probethenet
Pump
RSSingBot
RankActive
Re-re
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
Rogerbot
SEOlyticsCrawler
SISTRIX
Scanbot
ScrepyBot
Seekport
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
Sitebeam
Siteimprove
SmartDownload
Snapbot
Sociscraper
Sogou web spider
Sosospider
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Sucker
SuperHTTP
Swiftbot
Teleport
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Toata
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
V-BOT
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Pix
WebBandit
WebEnhancer
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whacker
Widow
Xaldon WebSpider
YoudaoBot
ZmEu
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
coccocbot
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
lwp-trivial
magpie-crawler
mediawords
netEstate NE Crawler
oBot
plumanalytics
s1z.ru
scalaj-http
scan.lol
spyfu
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zauba.io