nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-16 22:07:08 +00:00

250 lines
2.6 KiB
Text

ASPSeek
Abonti
AiHitBot
Aipbot
AllSubmitter
Anarchy99
Anthill
Aspiegel
Attach
BBBike
BDFetch
BackDoorBot
Backlink-Ceck
Barkrowler
BlowFish
Boardreader
Bolt
Brandwatch
Buddy
BuiltBotTough
CCBot
CSHttp
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cocolyzebot
Collector
Craftbot
CrazyWebCrawler
CrunchBot
DIIbot
DSearch
DataCha0s
Deusu
Digincore
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Drip
Ebingbong
Ecxi
EirGrabber
Evil
ExtLinksBot
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetWeb
GoZilla
GrabNet
Grabber
GrapeFX
HEADMasterSEO
HMView
HTTrack
Havij
Hloader
HonoluluBot
IDBot
Image Fetch
Indy Library
InfoNaviRobot
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Kinza
LNSpiderguy
Lanshanbot
Larbin
LeechGet
Lightspeedsystems
LinkScan
Linkbot
Litemage_walker
Lmspider
Ltx71
MIDown tool
MIIxpc
Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch
MauiBot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Mojolicious
MolokaiBot
Mozlila
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Net Vampire
NetLyzer
Netcraft
NextGenSearchBot
NimbleCrawler
Nimbostratus
Ninja
Octopus
Offline Explorer
OpenVAS
Openfind
OrangeSpider
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Pavuk
Petalbot
Picscout
Picsearch
Pimonster
PleaseCrawl
Probethenet
Pump
RankActive
RankingBot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SlySearch
Snapbot
Sottopop
SpaceBison
Spammen
SputnikBot
Stripper
Sucker
Sucuri
Suzuran
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
The Intraformant
TheNomad
Tracemyfile
Trendiction
Turnitin
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
VCI
VoidEYE
Voltron
WASALive-Bot
WEBDAV
WWW-Mechanize
WWW::Mechanize
Wallpapers
WallpapersHD
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sauger
WebAuto
WebSauger
WebStripper
WebSucker
WebWhacker
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
Wonderbot
Zade
ZoomBot
ZoominfoBot
archive.org_bot
arquivo.pt
check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
dataforseo.com
demandbase-bot
gopher
instabid
ips-agent
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
ripz
scalaj-http
scan.lol
seobility
seostar
sexsearcher
siteripz
sp_auditbot
spyfu
trendiction.de
webgains-bot
webmeup-crawler
webpros.com