nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-03 10:09:38 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
Aboundex
Alexibot
Anarchie
Ankit
Apexoo
Atomseobot
AwarioRssBot
BBBike
BDFetch
BLEXBot
BackStreet
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
BlackWidow
Bolt
Buck
BuiltBotTough
CATExplorador
Calculon
Cegbfeieh
CensysInspect
CheTeam
Claritybot
Cliqzbot
Cogentbot
Copier
Cosmos
Crawling at Home Project
Crescent
CrunchBot
DBLBot
DTS Agent
DatabaseDriverMysqli
DigitalPebble
Discobot
Dispatch
DomCopBot
Domains Project
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
Getintent
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
Humanlinks
IDBTE4M
IDBot
Id-search
Indy Library
InterGET
InternetSeer
JOC Web Spider
JamesBOT
JikeSpider
JustView
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MIIxpc
MSFrontPage
MSIECrawler
MarkMonitor
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Minefield
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot
NearSite
NetLyzer
NetMechanic
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Nutch
Octopus
Offline Navigator
OpenLinkProfiler
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
Pimonster
Pixray
ProWebWalker
Pump
RSSingBot
RankActiveLinkBot
RankFlex
Rankivabot
Reaper
RebelMouse
RedesScrapy
Ripper
SBIder
SEOkicks
SMTBot
ScanAlert
SearchmetricsBot
SemanticJuice
SentiBot
Seomoz
Siphon
SiteExplorer
SiteSnagger
Siteimprove
Sottopop
SpaceBison
SputnikBot
Sqlmap
Steeler
Stripper
SuperHTTP
SurveyBot
Suzuran
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
Telesphorep
TightTwatBot
Turingos
Turnitin
TwengaBot
Twice
URLy Warning
URLy.Warning
UnisterBot
VB Project
VCI
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voil
WASALive-Bot
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Enhancer
Web Fetch
Web Sucker
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebReaper
WebSucker
Webalta
WebsiteQuester
Webster
Whack
Whacker
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Zermelo
Zeus
ZoominfoBot
archive.org_bot
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
dataforseo.com
eCatch
facebookscraper
heritrix
internetVista monitor
ips-agent
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
s1z.ru
scalaj-http
scan.lol
siteripz
spyfu
trendiction.de
webpros.com
zgrab