nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-24 22:07:06 +00:00

250 lines
2.5 KiB
Text

80legs
AIBOT
ALittle Client
Abonti
Aboundex
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Ankit
Apexoo
AwarioRssBot
BBBike
BDCbot
BLEXBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bigfoot
Black Hole
BlackWidow
Boardreader
Bolt
BotALot
Brandwatch
Buddy
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cocolyzebot
Cosmos
Crawling at Home Project
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
Deusu
Devil
DigitalPebble
Disco
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Dotbot
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ecxi
EirGrabber
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
Fimap
FlashGet
Fuzz
GetWeb
Getintent
Gigabot
Go!Zilla
Gotit
GrabNet
Grabber
HaosouSpider
Havij
Heritrix
Humanlinks
IDBot
Iblog
Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InterGET
InternetSeer
Iria
JOC Web Spider
JamesBOT
Jbrofuzz
Joomla
JustView
Jyxobot
Kinza
LWP::Simple
Leap
LeechFTP
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MIDown tool
MSFrontPage
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Masscan
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft URL Control
Mister PiX
Mojolicious
Mozlila
Nameprotect
Navroad
NearSite
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NextGenSearchBot
Nibbler
NimbleCrawler
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OutfoxBot
PageGrabber
PageScorer
Pandalytics
Petalbot
Picscout
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
Probethenet
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
RepoMonkey
RocketCrawler
Rogerbot
SEOprofiler
ScanAlert
ScoutJet
ScreenerBot
Searchestate
Semrush
SeoSiteCheckup
Shodan
Siphon
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sociscraper
SpaceBison
Spbot
Sqlmap
Sqlworm
Stripper
Sucker
SurveyBot
Suzuran
Szukacz
T8Abot
Telesoft
Thumbor
Toweyabot
Tracemyfile
True_Robot
Turingos
Turnitin
TwengaBot
URLy Warning
V-BOT
Vacuum
Voltron
WISENutbot
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Fetch
Web Sucker
WebCopier
WebFuck
WebGo IS
WebLeacher
WebPix
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whatweb
Widow
YoudaoBot
Zeus
Zitebot
ZoomBot
ZoominfoBot
ZumBot
arquivo.pt
backlink-check
cah.io.community
check1.exe
crawl.sogou.com
eCatch
instabid
internetVista monitor
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
polaris version
probe-image-size
scalaj-http
scan.lol
sexsearcher
siteripz
sogouspider
sysscan
tAkeOut
trendiction.de
webmeup-crawler