nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-01 22:07:33 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
80legs
ALittle Client
ASPSeek
Aboundexbot
AiHitBot
Anarchy
Anthill
Attach
AwarioSmartBot
BBBike
BackStreet
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
BlowFish
Boardreader
Bolt
BotALot
Buck
Buddy
BuiltBotTough
BuiltWith
CODE87
CSHttp
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Citoid
Claritybot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
Custo
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Dirbuster
Disco
Dispatch
DnyzBot
Domains Project
Dotbot
EMail Siphon
EasyDL
Ebingbong
EroCrawler
Exabot
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
Fuzz
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla
GoZilla
Grafula
GrapeFX
HMView
HTMLparser
HaosouSpider
Heritrix
Hloader
HonoluluBot
Humanlinks
HybridBot
IRLbot
Iblog
Id-search
IlseBot
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
JOC Web Spider
JamesBOT
JetCar
Jetty
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
LexiBot
Lftp
LibWeb
Lightspeedsystems
Linkbot
LinkextractorPro
Lmspider
MIDown tool
MTRobot
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MeanPath Bot
Mediatoolkitbot
Mr.4x3
Musobot
Netcraft
Nettrack
Niki-bot
NimbleCrawler
Nmap
Not
Nutch
OnCrawl
Openfind
OutfoxBot
PHPCrawl
PageGrabber
Pandalytics
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
ProPowerBot
Probethenet
Psbot
Pump
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
Rankivabot
RebelMouse
SEOkicks
SEOkicks-Robot
SEOprofiler
Scanbot
ScoutJet
Screaming
Searchestate
SearchmetricsBot
Seekport
SeoSiteCheckup
Sitebeam
Sitevigil
SmartDownload
Snake
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
Spammen
Spanner
Sqlworm
Steeler
Sucker
Sucuri
Telesphorep
Titan
Toata
Toweyabot
Trendiction
True_Robot
Turingos
TurnitinBot
Twice
URLy Warning
UnisterBot
VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
WBSearchBot
WEBDAV
Wallpapers
WeSEE
Web Collage
WebAuto
WebBandit
WebCollage
WebCopier
WebLeacher
WebPix
WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zauba
Zeus
ZyBorg
adscanner
cah.io.community
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
iubenda-radar
linkdexbot
lwp-request
mediawords
netEstate NE Crawler
oBot
plumanalytics
ripz
scan.lol
seocompany.store
sitechecker.pro
sogouspider
sp_auditbot
sysscan
ubermetrics-technologies.com
webpros.com
webprosbot
x22Mozilla
xpymep1.exe