nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-06-23 10:07:36 +00:00

100 lines
1 KiB
Text

ALittle Client
Aboundex
AhrefsBot
AllSubmitter
Anarchie
Anthill
Aspiegel
AwarioSmartBot
Backlink-Ceck
BetaBot
Bigfoot
Boardreader
Brandwatch
Buddy
CheTeam
Chlooe
Curious
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
DomainAppender
Evil
ExtLinksBot
Extreme Picture Finder
Fyrebot
GalaxyBot
Genieo
GrapeFX
IDBTE4M
Jetty
JustView
Jyxobot
Leap
LinkpadBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MTRobot
Mail.RU_Bot
MarkWatch
MicroMessenger
Microsoft URL Control
Musobot
Needle
NetLyzer
NetSpider
Netcraft
Nettrack
PageThing.com
Pixray
PyCurl
RocketCrawler
Scanbot
ScrepyBot
SearchmetricsBot
Siteimprove
SmartDownload
Snapbot
Sosospider
SpaceBison
Spanner
Spinn3r
Steeler
Sucker
Swiftbot
The Intraformant
Trendictionbot
TurnitinBot
V-BOT
VCI
Voil
WWW-Mechanize
WeSEE
Web Sucker
WebGo IS
WebPix
WebStripper
WebWhacker
WebmasterWorldForumBot
WinHTTrack
Woobot
Wprecon
Xenu
Zitebot
ZyBorg
check1.exe
crawler.feedback
crawler4j
facebookscraper
lwp-request
polaris version
probe-image-size
s1z.ru
seoscanners
siteripz
trendiction.de
voyagerx.com