nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-09 10:07:14 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Aboundexbot
AiHitBot
Attach
BetaBot
Bitacle
BlackWidow
Blow
Bullseye
Bytespider
CCBot
CensysInspect
CheTeam
CherryPicker
CopyRightCheck
Curious
DatabaseDriverMysqli
DigitalPebble
Disco
DittoSpyder
DnBCrawler-Analytics
Download Wonder
Drip
EMail Siphon
ExtLinksBot
FDM
Flunky
GPTBot
GT::WWW
Genieo
Go!Zilla
Grabber
HEADMasterSEO
Image Fetch
Indy Library
InfoNaviRobot
InterGET
InternetSeer
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Lanshanbot
Leap
Lftp
LibWeb
LinkWalker
LinqiaRSSBot
Lipperhey Spider
Mail.RU_Bot
Majestic-SEO
Mass Downloader
MauiBot
Mister PiX
Mr.4x3
Name Intelligence
Nameprotect
Net Vampire
Netcraft
Openvas
OutclicksBot
POE-Component-Client-HTTP
PageGrabber
Papa Foto
Picsearch
RankurBot
SEOprofiler
SMTBot
ScoutJet
SearchmetricsBot
SeoSiteCheckup
SlySearch
SocialRankIOBot
Spbot
Steeler
Stripper
Teleport
Turingos
Turnitin
VelenPublicWebCrawler
VeriCiteCrawler
Voil
Wallpapers
WebAuto
WebLeacher
WebSucker
WebsiteExtractor
Whacker
Wonderbot
Zauba
Zitebot
ZoominfoBot
backlink-check
cah.io.community
demandbase-bot
ips-agent
iubenda-radar
serpstatbot
sogouspider
webgains-bot
webmeup-crawler