nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-03 10:12:44 +00:00

100 lines
1 KiB
Text

360Spider
ADmantX
AhrefsBot
Aipbot
Anarchy
BackStreet
Backlink-Ceck
BatchFTP
Blow
Bolt
Bytespider
CSHttp
Cogentbot
Demon
DnyzBot
Domains Project
Dragonfly
EMail Siphon
Evil
Express WebPictures
EyeNetIE
Ezooms
Foobot
Getintent
Gigabot
GrapeshotCrawler
HEADMasterSEO
HTTrack
HaosouSpider
Harvest
Iblog
ImagesiftBot
IndeedBot
InfraSec Scanner
InterGET
IstellaBot
JOC Web Spider
JetCar
JustView
Kozmosbot
LinksManager
Ltx71
MSIECrawler
Mag-Net
Metauri
Mojolicious
Mozlila
Musobot
NICErsPRO
NetAnts
NetSpider
Netcraft
Nuclei
Page Analyzer
Petalbot
Pi-Monster
Picsearch
Pimonster
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
PxBroker
ReGet
SMTBot
Scanbot
SeekportBot
Siphon
SiteLockSpider
SiteSnagger
SocialRankIOBot
Sociscraper
Spinn3r
Sqworm
Suzuran
Swiftbot
Szukacz
Telesphoreo
Titan
Tracemyfile
URLy Warning
Voil
WWW-Mechanize
Web Fetch
WebFetch
WebGo IS
Webalta
Xaldon_WebSpider
Zitebot
backlink-check
cah.io.community
ips-agent
netEstate NE Crawler
oBot
page scorer
pcBrowser
serpstatbot
siteripz
webmeup-crawler
xpymep1.exe