nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-18 22:07:04 +00:00

250 lines
2.7 KiB
Text

360Spider
404enemy
ADmantX
ASPSeek
Aboundex
AfD-Verbotsverfahren
Aipbot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Anthill
Asterias
Atomseobot
BBBike
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
BatchFTP
BetaBot
Bitacle
BlackWidow
Bolt
BotALot
Brandprotect
Brandwatch
BuiltBotTough
CODE87
CSHttp
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
Copier
CopyRightCheck
Crawling at Home Project
Crescent
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
DigitalPebble
DittoSpyder
DomCopBot
DomainCrawler
Dotbot
ECCP/1.0
EroCrawler
Exabot
Express WebPictures
Extractor
ExtractorPro
Ezooms
FDM
Fimap
Freeuploader
FrontPage
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetRight
Gigabot
Go!Zilla
Grafula
HEADMasterSEO
HTMLparser
HTTP::Lite
Heritrix
Hloader
HonoluluBot
IDBTE4M
IRLbot
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
JOC Web Spider
JamesBOT
Jetty
Jorgee
Jyxobot
LWP::Simple
Leap
Libwhisker
LieBaoFast
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Lmspider
Ltx71
MQQBrowser
Mag-Net
Mail.RU_Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mr.4x3
Msrabot
Name Intelligence
Navroad
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Nmap
Octopus
Offline Navigator
OutclicksBot
PECL::HTTP
PageGrabber
Panscient
Papa Foto
Pi-Monster
Picscout
PictureFinder
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankurBot
Re-re
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SMTBot
Scanbot
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SeoSiteCheckup
Siphon
Site Sucker
Sitevigil
SlySearch
Snapbot
SocialRankIOBot
Sottopop
SpankBot
Spanner
Spinn3r
SputnikBot
Sqworm
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
Teleport
The Intraformant
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
TwengaBot
Twice
URLy.Warning
Upflow
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WallpapersHD
Web Sauger
Web Sucker
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebSauger
WebWhacker
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
Who.is Bot
Widow
Woobot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zitebot
ZmEu
ZoominfoBot
archive.org_bot
arquivo.pt
cah.io.community
clark-crawler
com.plumanalytics
crawler.feedback
dataforseo.com
domainsproject.org
eCatch
facebookscraper
meanpathbot
netEstate NE Crawler
page scorer
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
sitechecker.pro
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io