nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-27 22:07:14 +00:00

250 lines
2.6 KiB
Text

80legs
ASPSeek
Aboundexbot
AhrefsBot
AiHitBot
Alligator
Anarchy
Anarchy99
Apexoo
Asterias
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
BetaBot
Bigfoot
Bitacle
BlackWidow
BlowFish
Bolt
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
Cloud mapping
Collector
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Custo
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
DigitalPebble
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Drip
EMail Wolf
Ecxi
EirGrabber
ExtLinksBot
EyeNetIE
Ezooms
Firefox/7.0
FlashGet
FrontPage
Fuzz
FyberSpider
GT::WWW
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeshotCrawler
HTTrack
Havij
Id-search
IndeedBot
Intelliseek
JamesBOT
Joomla
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kozmosbot
Lanshanbot
Larbin
LeechGet
LexiBot
Lftp
Lightspeedsystems
Likse
LinksManager
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Majestic12
MarkMonitor
Masscan
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Minefield
Mojeek
Mojolicious
MolokaiBot
Msrabot
NPbot
Nameprotect
NearSite
NetAnts
NetMechanic
NetSpider
NetZIP
Netvibes
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Ninja
Not
Nutch
Offline Navigator
OpenVAS
OrangeBot
OutfoxBot
Page Analyzer
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Probethenet
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankFlex
ReGet
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SalesIntelligent
Scanbot
ScoutJet
Searchestate
Seekport
SeoSiteCheckup
SeobilityBot
SiteCheckerBotCrawler
SiteSnagger
Sitebeam
Sitevigil
Sociscraper
Sottopop
SpaceBison
SpankBot
Spinn3r
SputnikBot
Sqlworm
Sqworm
SuperBot
Suzuran
Szukacz
T0PHackTeam
Teleport
TeleportPro
TheNomad
Thumbor
Toata
Toweyabot
Trendiction
Turingos
Turnitin
TwengaBot
Twice
Typhoeus
UnisterBot
VeriCiteCrawler
Virusdie
VoidEYE
WBSearchBot
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
WebAuto
WebBandit
WebFetch
WebFuck
WebLeacher
WebPix
WebSauger
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Whatweb
Widow
Wonderbot
Wprecon
Xaldon_WebSpider
Zade
Zauba
ZmEu
ZoomBot
ZumBot
adscanner
cognitiveseo
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
heritrix
iubenda-radar
linkdexbot
lwp-trivial
muhstik-scan
oBot
polaris version
probe-image-size
satoristudio.net
scalaj-http
seocompany.store
seoscanners
siteripz
sp_auditbot
sysscan
trendiction.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe