nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-10 22:04:48 +00:00

100 lines
1.1 KiB
Text

404enemy
AhrefsBot
Alligator
BBBike
BacklinkCrawler
Blackboard
Bytespider
ChatGPT-User
CheTeam
Claritybot
Cosmos
CrazyWebCrawler
CyotekWebCopy
DBLBot
DomainAppender
Download Wonder
EyeNetIE
Fimap
Firefox/7.0
Flunky
Foobot
FrontPage
FyberSpider
Gigabot
GrapeshotCrawler
HTMLparser
HTTrack
IndeedBot
InfoNaviRobot
Information Security Team InfraSec Scanner
Jorgee
Likse
LinkextractorPro
LinksManager
LinqiaScrapeBot
MSFrontPage
MSIECrawler
Majestic12
Mb2345Browser
Moblie Safari
NearSite
NetSpider
Nikto
OpenVAS
Openvas
OrangeBot
OrangeSpider
PageScorer
Piepmatz
RankingBot
RankingBot2
Rankivabot
Re-re
Reaper
RebelMouse
SBIder
ScrepyBot
SemrushBot
Seomoz
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
Sogou web spider
Sosospider
Spanner
Sqworm
Sucker
SurveyBot
Telesoft
TwengaBot
URLy.Warning
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WWW::Mechanize
Wallpapers/3.0
Web Fetch
WebCollage
WebCopier
WebPix
Who.is Bot
Xaldon WebSpider
ZoomBot
ZoominfoBot
ZyBorg
autoemailspider
clark-crawler
gopher
ips-agent
isitwp.com
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
webpros.com
x09Mozilla