nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-25 22:07:30 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ASPSeek
Abonti
Aboundex
Aipbot
Anarchy
Asterias
Atomseobot
Attach
BBBike
Badass
Battleztar Bazinga
BlackWidow
Blackboard
Blow
BlowFish
Boardreader
Bolt
BotALot
Bullseye
CSHttp
CazoodleBot
CheeseBot
ChinaClaw
Citoid
Claritybot
Cloud mapping
Cogentbot
Copyscape
Cosmos
Crawling at Home Project
Curious
Custo
CyotekWebCopy
DSearch
Demon
Digincore
DigitalPebble
Disco
DittoSpyder
DomainAppender
Domains Project
Dotbot
Drip
EroCrawler
Exabot
Express WebPictures
FDM
Firefox/7.0
FlashGet
Freeuploader
FrontPage
G-i-g-a-b-o-t
GetRight
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
GrapeFX
HTMLparser
Harvest
Havij
Heritrix
Hloader
IDBTE4M
IRLbot
Id-search
Image Fetch
InfoNaviRobot
Intelliseek
InternetSeer
Iskanie
JOC Web Spider
Jbrofuzz
JetCar
Jetty
JikeSpider
Keybot Translation-Search-Machine
LNSpiderguy
Larbin
LeechGet
Lftp
Libwhisker
Likse
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
Magnet
Mail.RU_Bot
Mass Downloader
MauiBot
MegaIndex.ru
Moblie Safari
MolokaiBot
Mr.4x3
Msrabot
Musobot
NPbot
Nameprotect
Navroad
Net Vampire
NetAnts
NetLyzer
NetSpider
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Not
Nuclei
Nutch
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageThing.com
Pavuk
PeoplePal
Petalbot
Piepmatz
Pockey
ProWebWalker
Psbot
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
Re-re
ReGet
Reaper
Rogerbot
SEOkicks
SEOprofiler
SMTBot
ScanAlert
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteSnagger
SlySearch
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spanner
SputnikBot
Sqlworm
SuperBot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Telesoft
TightTwatBot
Titan
Toata
Tracemyfile
Trendiction
True_Robot
TwengaBot
Typhoeus
URLy Warning
UnisterBot
V-BOT
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
WallpapersHD
Web Auto
Web Fetch
Web Fuck
Web Sucker
WebBandit
WebCollage
WebCopier
WebFetch
WebGo IS
WebLeacher
WebReaper
WebSauger
WebStripper
WebWhacker
WebZIP
Who.is Bot
Widow
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba
ZmEu
ZoomBot
ZyBorg
adscanner
backlink-check
cah.io.community
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
domainsproject.org
ips-agent
isitwp.com
linkdexbot
magpie-crawler
muhstik-scan
oBot
plumanalytics
s1z.ru
satoristudio.net
sexsearcher
sogouspider
sp_auditbot
sysscan
webmeup-crawler