nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-16 11:30:05 +00:00

100 lines
1 KiB
Text

ALittle Client
Aboundexbot
AfD-Verbotsverfahren
Alexibot
Anarchy
Ankit
AwarioRssBot
Badass
Barkrowler
BetaBot
Bitacle
Blow
CopyRightCheck
Curious
DTS Agent
Deusu
Devil
DigitalPebble
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Ecxi
Exabot
Ezooms
FemtosearchBot
Fimap
GT::WWW
GalaxyBot
Grabber
Haansoft
Harvest
InfoNaviRobot
Iskanie
JikeSpider
Kinza
Lanshanbot
Libwhisker
Litemage_walker
Ltx71
MQQBrowser
Mail.RU_Bot
Microsoft Data Access
Moblie Safari
NPbot
Nameprotect
Net Vampire
NetMechanic
Netvibes
Offline Explorer
Openvas
OrangeBot
Picscout
PictureFinder
Pimonster
Psbot
RankActive
ReGet
SBIder
SMTBot
ScanAlert
Scrapy
SearchmetricsBot
Seekport
SemrushBot
Seomoz
Siphon
SiteCheckerBotCrawler
Spanner
Spinn3r
T0PHackTeam
Teleport
TightTwatBot
Toata
TwengaBot
VCI
VelenPublicWebCrawler
VidibleScraper
Virusdie
WWW::Mechanize
WebsiteExtractor
Whatweb
Woobot
Xenu
Zitebot
ZoominfoBot
adscanner
autoemailspider
heritrix
isitwp.com
openai.com
page scorer
pcBrowser
probe-image-size
seoscanners
seostar
trendiction.com
trendiction.de
voyagerx.com
zgrab