vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 19:50:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.07.3222 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-07-11 22:07:10 +00:00
parent 8bfba19346
commit e3c376b33d
47 changed files with 109250 additions and 109260 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3221 #### Version: V4.2022.07.3222
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.07.3221 #### Version: V4.2022.07.3222
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.07.3221 #### Version: V4.2022.07.3222
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13522
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.07.3221 #### Version: V4.2022.07.3222
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

13526
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13526
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

13526
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

13526
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3221 3222

13526
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

13526
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.91.45 0; 20.7.191.172 0;

13526
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

13526
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.91.45 0; 20.7.191.172 0;

13526
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
137.117.91.45 0; 20.7.191.172 0;

13526
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 1; 10.1.0.14 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Domains Project Ankit
EirGrabber Brandwatch
Grafula CheeseBot
Joomla Picsearch
LeechGet SiteExplorer
Mag-Net TightTwatBot
PECL::HTTP Virusdie
Page Analyzer WWWOFFLE
isitwp.com Webalta
probe-image-size facebookscraper

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404checker
404enemy
ADmantX ADmantX
AIBOT
ALittle Client
Abonti Abonti
Aboundex Acunetix
Aboundexbot Aipbot
Alexibot Alexibot
Anarchie AlphaBot
Apexoo
Asterias Asterias
Atomseobot AwarioSmartBot
BBBike BBBike
BDCbot BDCbot
BDFetch
BLEXBot BLEXBot
BacklinkCrawler BackDoorBot
Badass Badass
Bandit
BatchFTP
Bitacle Bitacle
Buddy Blow
Boardreader
Bolt
Brandprotect
BuiltWith BuiltWith
BuzzSumo CATExplorador
CSHttp Calculon
CazoodleBot CheTeam
CensysInspect
CheeseBot CheeseBot
CherryPicker
ChinaClaw
Citoid Citoid
Cliqzbot
Cogentbot
Copyscape Copyscape
Crawling at Home Project Custo
CrazyWebCrawler DBLBot
Curious
CyotekWebCopy
DIIbot
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Disco Disco
DnyzBot DittoSpyder
DomCopBot DomCopBot
DomainCrawler
DomainStatsBot
Domains Project Domains Project
Dotbot
Download Wonder Download Wonder
Drip
EMail Wolf
EasyDL EasyDL
Ebingbong
Ecxi
EirGrabber EirGrabber
ExtLinksBot Exabot
Extractor Extractor
Extreme Picture Finder EyeNetIE
Ezooms
FDM FDM
Firefox/7.0 FemtosearchBot
Freeuploader FlashGet
GT::WWW Flunky
Foobot
FrontPage
Fyrebot
GalaxyBot GalaxyBot
Genieo
GetRight
GetWeb GetWeb
Getintent Go!Zilla
Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla Grabber
GrabNet GrapeshotCrawler
GrapeFX GridBot
HTTP::Lite HEADMasterSEO
HTTrack
Haansoft Haansoft
HaosouSpider
Harvest
Hloader Hloader
Humanlinks
HybridBot
IDBTE4M IDBTE4M
IDBot IDBot
Id-search Id-search
IlseBot
Image Fetch
Image Sucker
InfoTekies InfoTekies
Intelliseek
Internet Ninja
InternetSeer InternetSeer
Iskanie Iskanie
IstellaBot
JamesBOT JamesBOT
Jetty Jbrofuzz
Jorgee JennyBot
Kenjin Spider JustView
LWP::Simple Keybot Translation-Search-Machine
Kinza
Kozmosbot
Lanshanbot
LeechFTP LeechFTP
Lftp LinkScan
LibWeb
LinkWalker
Linkbot
LinksManager LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 MFC_Tear_Sample
MIDown tool MJ12bot
MIIxpc
MQQBrowser
Mag-Net
Magnet
Majestic SEO Majestic SEO
Majestic-SEO MarkMonitor
Masscan Mass Downloader
Mata Hari
MauiBot
Mediatoolkitbot
Microsoft URL Control Microsoft URL Control
Minefield Minefield
Morfeus Fucking Scanner
Mozlila Mozlila
NICErsPRO Mr.4x3
Navroad Msrabot
NetMechanic NPbot
NetSpider Nameprotect
Net Vampire
NetAnts
NetLyzer
NetZIP NetZIP
Netvibes NextGenSearchBot
Niki-bot Nikto
NimbleCrawler
Not
Nutch
Octopus Octopus
Offline Explorer
Offline Navigator
OnCrawl OnCrawl
OpenVAS OpenVAS
PECL::HTTP Openvas
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer
PageScorer PageScorer
Pandalytics PageThing.com
Panscient Panscient
Pi-Monster Pavuk
PeoplePal
Picsearch
Pimonster Pimonster
Pixray Pixray
PleaseCrawl PleaseCrawl
ProWebWalker Probethenet
Psbot RankActiveLinkBot
Pu_iN RankurBot
Pump RealDownload
PxBroker
PyCurl
RSSingBot
RankingBot
RankingBot2
RepoMonkey RepoMonkey
Ripper RocketCrawler
SBIder SBIder
SEOkicks
SEOkicks-Robot
SEOstats SEOstats
SISTRIX
SMTBot SMTBot
ScanAlert SalesIntelligent
SemanticJuice ScoutJet
SeobilityBot Screaming
Searchestate
SearchmetricsBot
Seekport
Semrush
SeoSiteCheckup
Seomoz Seomoz
Shodan SiteCheckerBotCrawler
SiteExplorer SiteLockSpider
SiteSucker SiteSnagger
SmartDownload Sitebeam
Snake Siteimprove
Snapbot Sitevigil
SlySearch
Snoopy Snoopy
SocialRankIOBot SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider Sosospider
Sottopop SpaceBison
Spammen SpankBot
Spinn3r
Sqlmap Sqlmap
Steeler Sqworm
T8Abot SuperBot
Teleport Surfbot
Telesoft Swiftbot
TheNomad TeleportPro
Thumbor Titan
TightTwatBot Toata
Tracemyfile Toweyabot
Trendictionbot Trendiction
True_Robot
Turingos Turingos
Twice Turnitin
Typhoeus
URLy Warning
URLy.Warning URLy.Warning
UnisterBot
Upflow Upflow
VB Project V-BOT
Vacuum Vacuum
Vagabondo VelenPublicWebCrawler
VidibleScraper
Virusdie Virusdie
VoidEYE VoidEYE
Voltron
WEBDAV WEBDAV
WPScan WPScan
WWW-Collector-E
WWW::Mechanize WWW::Mechanize
Wallpapers WallpapersHD
WeSEE Web Collage
Web Fetch
Web Fuck Web Fuck
Web Sucker Web Pix
WebAuto WebAuto
WebBandit WebBandit
WebCollage WebCollage
WebEnhancer
WebFetch WebFetch
WebGo IS
WebImageCollector WebImageCollector
WebLeacher
WebPix WebPix
WebSauger WebWhacker
WebZIP WebZIP
Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Whacker WiseGuys Robot
Whatweb Wonderbot
WinHTTrack
Woobot Woobot
Xaldon WebSpider Zade
Zermelo Zermelo
Zitebot Zeus
ZoominfoBot ZmEu
adscanner
archive.org_bot archive.org_bot
backlink-check arquivo.pt
autoemailspider
cah.io.community cah.io.community
clark-crawler check1.exe
cognitiveseo com.plumanalytics
crawl.sogou.com
crawler4j crawler4j
dataforseo.com
demandbase-bot
eCatch
evc-batch evc-batch
facebookscraper facebookscraper
linkdexbot gopher
lwp-trivial instabid
isitwp.com
iubenda-radar
meanpathbot meanpathbot
mediawords mediawords
netEstate NE Crawler netEstate NE Crawler
polaris version oBot
pcBrowser
plumanalytics
probe-image-size probe-image-size
ripz ripz
scalaj-http scalaj-http
scan.lol scan.lol
seoscanners seocompany.store
sexsearcher sexsearcher
sitechecker.pro
siteripz siteripz
sogouspider
spyfu spyfu
sysscan
tAkeOut tAkeOut
trendiction.com ubermetrics-technologies.com
trendiction.de voyagerx.com
webgains-bot
webpros.com webpros.com
webprosbot x22Mozilla
xpymep1.exe
zgrab

302
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider
404enemy 404enemy
80legs AIBOT
Abonti Abonti
Aboundex
Aboundexbot Aboundexbot
AfD-Verbotsverfahren AlphaBot
Alligator Anarchy99
Anarchie Anthill
Anarchy Atomseobot
Apexoo
Attach Attach
BBBike AwarioRssBot
AwarioSmartBot
BDFetch BDFetch
BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Barkrowler BacklinkCrawler
BatchFTP BatchFTP
Battleztar Bazinga BetaBot
Bitacle
Black Hole
BlackWidow BlackWidow
Boardreader
BotALot BotALot
Brandwatch Brandwatch
CCBot Buddy
Calculon CATExplorador
CazoodleBot
CensysInspect
CheTeam CheTeam
CheeseBot
CherryPicker CherryPicker
ChinaClaw Cliqzbot
Chlooe Cosmos
Claritybot
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent
Curious Curious
DBLBot Custo
DTS Agent CyotekWebCopy
DatabaseDriverMysqli DSearch
Demon
Deusu
Devil Devil
DigitalPebble Dispatch
Disco DnyzBot
DittoSpyder DomainCrawler
DnBCrawler-Analytics DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Domains Project
Download Wonder Download Wonder
Dragonfly Dragonfly
Drip
ECCP/1.0
EMail Siphon EMail Siphon
EMail Wolf
EasyDL EasyDL
Ebingbong
Ecxi
EirGrabber EirGrabber
Exabot EroCrawler
ExtLinksBot
Extractor
EyeNetIE EyeNetIE
FHscan FHscan
FrontPage FemtosearchBot
GT::WWW Fimap
GetRight Flunky
Foobot
G-i-g-a-b-o-t
Genieo
GetWeb GetWeb
Getintent
Gigabot
Go-Ahead-Got-It Go-Ahead-Got-It
Gotit GrabNet
Grabber Grabber
Grafula HEADMasterSEO
GrapeshotCrawler HMView
GridBot HTTP::Lite
Haansoft HTTrack
HaosouSpider HaosouSpider
Harvest Harvest
Hloader Havij
Humanlinks Heritrix
IDBTE4M IDBTE4M
Id-search IDBot
IlseBot IlseBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InterGET
Iria Iria
JOC Web Spider JamesBOT
JetCar
JikeSpider JikeSpider
Jorgee Jorgee
JustView Kenjin Spider
LWP::Simple Keyword Density
Kinza
Kozmosbot
LeechFTP
Lftp Lftp
Likse LibWeb
Ltx71 Lightspeedsystems
MJ12bot LinkScan
MQQBrowser Linkbot
Lipperhey
Lmspider
MIDown tool
Mail.RU_Bot Mail.RU_Bot
Mass Downloader MarkWatch
Masscan
Mata Hari Mata Hari
Mediatoolkitbot Mb2345Browser
Metauri Meanpathbot
MicroMessenger
Microsoft Data Access Microsoft Data Access
Microsoft URL Control Moblie Safari
Minefield MolokaiBot
Mister PiX Mr.4x3
Mojolicious Name Intelligence
Mozlila Needle
Nameprotect
Nessus Nessus
NetLyzer
NetSpider NetSpider
Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Ninja
Niki-bot
NimbleCrawler
Octopus Octopus
Offline Explorer OpenLinkProfiler
Openfind OrangeSpider
OutclicksBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer
PageScorer PageScorer
PageThing.com Petalbot
Papa Foto
Pi-Monster Pi-Monster
Picscout Picscout
Picsearch PleaseCrawl
PictureFinder
Pimonster
ProPowerBot ProPowerBot
Psbot Psbot
PyCurl Pump
Quick-Crawler
RankActive RankActive
RankFlex RankFlex
RankingBot
RankingBot2
Rankivabot Rankivabot
RankurBot ReGet
Re-re RebelMouse
RealDownload Recorder
RedesScrapy RedesScrapy
Ripper RepoMonkey
RocketCrawler RocketCrawler
SMTBot SBIder
SalesIntelligent SEOkicks
ScanAlert SEOlyticsCrawler
Scanbot SEOstats
Scrapy ScoutJet
Screaming Screaming
ScreenerBot
ScrepyBot ScrepyBot
SearchmetricsBot
SemanticJuice SemanticJuice
Semrush SeoSiteCheckup
SemrushBot
SeobilityBot SeobilityBot
Seomoz
Shodan Shodan
Site Sucker SiteExplorer
SiteSnagger SiteLockSpider
SiteSucker SiteSucker
Sitebeam Sitebeam
Snapbot Snake
Snoopy Snoopy
SocialRankIOBot Sogou web spider
Sociscraper Sosospider
SpaceBison Sottopop
Spammen
SpankBot SpankBot
Sqlworm Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
Sucker Sucker
SuperBot Sucuri
SuperHTTP
Surfbot Surfbot
SurveyBot
Suzuran Suzuran
T0PHackTeam
Teleport Teleport
TeleportPro Telesphorep
Telesoft
The Intraformant
TheNomad
Thumbor Thumbor
TightTwatBot TightTwatBot
Titan
Toata
Toweyabot Toweyabot
Tracemyfile Tracemyfile
Trendictionbot
True_Robot True_Robot
Turingos
Turnitin Turnitin
TwengaBot
Typhoeus Typhoeus
URLy Warning
URLy.Warning
UnisterBot UnisterBot
Upflow
VCI VCI
Vagabondo
VoidEYE
Voil Voil
WISENutbot Voltron
WASALive-Bot
WPScan WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize WWW::Mechanize
Wallpapers WWWOFFLE
WeSEE WeSEE
Web Auto
Web Fetch
Web Pix Web Pix
Web Sucker WebAuto
WebImageCollector WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebLeacher WebLeacher
WebPix
WebReaper WebReaper
WebSauger WebStripper
WebWhacker WebSucker
Website Quester Webalta
WebsiteExtractor Webshag
WebsiteQuester Webster
Widow Whacker
WiseGuys Robot Who.is Bot
Woobot WinHTTrack
Xenu Xaldon WebSpider
Xaldon_WebSpider
Zermelo Zermelo
Zeus Zitebot
ZmEu archive.org_bot
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt arquivo.pt
cah.io.community autoemailspider
check1.exe check1.exe
cognitiveseo coccocbot
crawler4j crawl.sogou.com
dataforseo.com
demandbase-bot demandbase-bot
domainsproject.org
evc-batch evc-batch
facebookscraper instabid
meanpathbot lwp-request
mediawords mediawords
muhstik-scan
netEstate NE Crawler netEstate NE Crawler
oBot
pcBrowser
probe-image-size
ripz
s1z.ru s1z.ru
satoristudio.net
scan.lol scan.lol
seobility seobility
seocompany.store seocompany.store
seostar sitechecker.pro
serpstatbot
siteripz
sogouspider sogouspider
sp_auditbot sp_auditbot
tAkeOut trendiction.com
trendiction.de
webgains-bot webgains-bot
webmeup-crawler
webpros.com webpros.com
webprosbot x22Mozilla
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
100searchengines.com akita.kz
amehdaily.com colehaanoutlet.store
brimstonehillfortress.org factorynightclub.com
clubfashionista.com igadgetsworld.com
enginebay.ru marinetraffic.com
javrip.net paydayonlinecom.com
mobile.ok.ru popmarker.com
offtime.ru shopwme.ru
piccshare.com stardevine.com
xtremeeagles.net startufa.ru

910
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
1-99seo.com 03p.info
123movies.love 0912701309f8ce.com
1j7740kd.website 0lovespells0.blogspot.com
1kdailyprofit.me 100searchengines.com
28n2gl3wfyb0.ru 101lesbian.xyz
2ads.co.uk 11235813.webzdarma.cz
4kepics.com 1314dh.com
4rent.ru 1bet.com
7yue.org 4k-player.pl
999webdesign.com 57883.net
DomainStatsBot 5kstore.com
a.pr-cy.ru 8lufu.com
a14download.com 8si.ru
aarbur.com 991mostfm.co.id
adanih.com aa14ab57a3339c4064bd9ae6fad7495b5f.com
add-add.men aa9d046aab36af4ff182f097f840430d51.com
addtoadd.men aab94f698f36684c5a852a2ef272e031bb.com
adelly.bg aad1f4acb0a373420d9b0c4202d38d94fa.com
adidas.frwebs.fr abcdefh.xyz
adminshop.com adconscious.com
adrunnr.com adimmix.com
adtiger.tk adsref.men
airmaxshoes-2016.com adultwebhosting.info
advancedmassagebysara.com
advokat-grodno.by
aktobe.xkaz.org
all4invest.info all4invest.info
allbizne.co.ua
allkrim.com allkrim.com
alloysteel.ru allwomen.info
amazon-seo-service.com animebox.com.ua
analytics-ads.xyz anniemation.com
anti-virus-removal.info anti-virus-removal.info
apibetweenlinesn-a.akamaihd.net apccargo.com
apiwebwebgetcom-a.akamaihd.net apiitsthirteende-a.akamaihd.net
apple.com-webbrowsing-security.review apimossnetinfo-a.akamaihd.net
appmsr.org apishops.ru
aquarium-pro.ru approvedlocal.co.za
arenanews.com.ua apxeo.info
arpelsreplica.xyz arkkivoltti.net
arraty.altervista.org arvut.org
artpicso.com asscenihotosidea.blogspot.com
asiengirls.net astana.xxxkaz.org
asmxsatadriverin.aircus.com audiofree.ru
asseenontvonline.ru aviav.org
automatic-seo.com avitocars.ru
automobile-spec.com avtovolop.ru
autoplate.info ayeartoforget.com
autovideobroadcast.com backgroundpictures.net
availit.weebly.com balook.com
avtochehli.by best-coupon-offer.com
ayakino.net best-seo-offer.com
azbaseimages.net bestbuy.ca
balkanfarma.org bestmouthwash.club
bankofthewext.com
baoxaydung.com.vn
bdsmgalls.net
beachtoday.ru
beauty-clinic.ru
beauty-things.com
becuo.com
best-games.today
bestfortraders.com
bestpriceninja.com
bestssaker.com bestssaker.com
bget.ru bezlimitko.xyz
bgviagrachrx.com beztuberkuleza.ru
bio-japan.net bif-ru.info
bio.trade-jp.net bigames.online
birzha-truda.eu biglistofwebsites.com
bizfly.info bingo8888.com
biznesluxe.ru bio-optomarket.ru
biznesrealnost.ru bizcheapjerseyswholesalechina.com
blackcurranthumidifiers.site bobba.dzaba.com
bookmark4you.com boeuklad.com
braintobe.win bongiornos.info
brateg.xyz bonzbuddy.com
breastaugmentation.co.za book-bets.com
bristolhostel.com boole.onlinewebshop.net
budilneg.xyz brendbutik.ru
bugshoot.cn briomotor.co
burn-fat.ga brus.city
bus-offer.com bscodecs.com
buscarfoto.com buckspar.gq
buttons-for-website.com businesn.men
buzzonclick.com cacheimages.com
buzzzg.men callmd5map.com
bvlgariring.xyz calvet.altervista.org
bzero1jewelry.net candiceloves.us
cand.jp canzoni.ru
candlehandmade.com capacitacionyaprendizaje.com
candy-glam-hp.com carson.getenjoyment.net
candycrushshop.com cartierlovebracelet.xyz
canrioloadm.gq cartierring.xyz
cartierreplica.pw cashonads.com
casablancamanor.co.za cezartabac.ro
castingbank.ru chatroulette.video
cbcseward.com cheapmoncler.xyz
chatroulette.online chelnytruck.ru
checkpagerank.net chinacheapelitejerseys.com
children-learningreading.info
chocolateslim-en-france.com
choosecuisine.com choosecuisine.com
cialgenisrx.com cinemaflix.website
cicaki.net claytransformations.info
clippingphotoindia.com cleanpcnow.com
clmforexeu.com cmd.kz
club-lukojl.ru com-onlinesupport.host
club-samodelkin.ru compliance-barak.top
co.lumb.co compliance-brian.xyz
com-cleaner.systems
comeondog.info
compliance-brian.top
compliance-don.top
compliance-mary.top compliance-mary.top
concealthyself.com compliance-nelson.top
contentsexpress.com concordexoticrentals.com
cookielawblog.wordpress.com coolwallpapers4k.info
crackzplanet.com coop-gamers.ru
credit-respect.ru copblock.org
creditmoney.com.ua counciltally.com
crirussian.ru counter.yadro.ru
culmimg.pw counterbot.com
cyse.tk cpabegins.ru
czeshop.info cpajunkies.com
dailyfinancefix.com creatives.adbetclickin.pink
de.zapmeta.com customcollegeessays.net
dikqlyremy.info cutt.us
dktr.ru daptravel.com
data.vtc.pw
ddlmega.net
deda-moroza-zakaz.ru
delayreferat.ru
delitime.info
design-ideas.info
design-lands.ru
devochki.top
digitalassetmanagement.site
dimaka.info
discovertreasure-a.akamaihd.net
djekxa.ru
domination.ml domination.ml
dostavimvdom.ru dominterior.org
domznaniy.ru
dosugrostov.site dosugrostov.site
doublepimp.com
downloadmefiranaratb1972.xpg.com.br downloadmefiranaratb1972.xpg.com.br
doxyporno.com dptaughtme.com
druzhininevgeniy63.blogspot.com drev.biz
dverimegapolis.ru dscaas.website
e-c.al dumuelave.xyz
e2click.com earl-brown.info
easync.io ebonyporn.site
ednorxmed.com ec-file.info
edwinkonijn.com.au
eets.net eets.net
ege-essay.ru ege-russian.ru
ekto.ee ekobata.ru
elektir.ru electricwheelchairsarea.com
elektrischezi.canalblog.com electro-prom.com
empathica.com elektrozigarette2.wordpressy.pl
empis.magix.net elexies.info
enthuse.computernetworksonline.com elitesportsadvisor.com
eonpal.com enews.tech
essay-edu.biz engines-usa.com
eorogo.top
escort-russian.com
escortplius.com
etur.ru
evehemming.blogspot.com.au
evrotekhservis.ru
excaliburfilms.com
excitacion.info excitacion.info
ezofest.sk expertnaya-ocenka.ru
face.hostingx.eu ezigarettekaufen.myblog.de
ezigarettenkaufen1.pagina.gr
ezigarettenshop2.postbit.com
f0815.de
falcoware.com
falllow.gq
falopicm.pw falopicm.pw
fast-torrent.ru familienzahnaerzte.com
feel-planet.com family1st.ca
findpics.pw favoritemoney.ru
flashahead.info fearcrow.com
flipper.top ferretsoft.com
floridamhca.org ff30236ddef1465f88547e760973d70a.com
formulaantiuban.com filmi-onlain.info
forpostlock.ru finansov.info
forsex.info fitnesspiks.com
flooringinstallation-edmonton.com
forex.osobye.ru
forums.d2jsp.org
foxydeal.com
freefoto.ca freefoto.ca
freeuploader.ml
fuckbuddybestgilf.info
fuckmill.com
fyl.com.ru
g.starmoe.xyz
g7m.pl
gael-s.ru gael-s.ru
galleryawesome.com gambarkataku.co
gameonasia.com gameplexcity.com
gamingspark.com
geile-lelly.eu geile-lelly.eu
glavtral.ru genericlowlatencyasiodriverhq.aircus.com
goblacked.com getlaid-xxxhookupdirect.com
goodprotein.ru getlamborghini.ga
gopixdatabase.com girlsfuckdick.com
graphid.com gktt.ru
gratis-sexkontakte.com globatur.ru
gribkovye-zabolevaniya.com gloverid.site
gribokstop.com goldandcard.ru
groupmoney.ru gomusix.com
googlemare.com
googlepositions.com
grtyi.com
gsou.cf
gunsvicceadadebt.tk gunsvicceadadebt.tk
hahashka.ru gwebtools.com.br
hasfun.com hamptonoaks.ca
hauleddes.com hannasolution.ru
hdpixion.com hazardky.net
headpharmacy.com hchha.com
healthcarestore.info hermesreplica.win
homik.pw highspeed5.net
hotgirlhdwallpaper.com highstairs-a.akamaihd.net
houdom.net home-task.com
hptwaakw.blog.fc2.com homeandhealth.ru
husky-shop.cz hotdl.in
hyipmanager.in hotelcrocenzi.sm
hystersister.com hotloans.ru
i4track.net hplaserjetpdriver8y.pen.io
iamsport.org hubbble.com
imgata.com hydropump.su
indiasourcemart.in hyhj.info
innodgfdriverhm.aircus.com ideawheel.com
ipchicken.com immobiliaremassaro.com
ipornox.xxx impisr.ru
iqoption-bin.com in-tandem.co
iskalko.ru infostatsvc.com
infowarcraft.ru
instabid.tech
istizanidineacontrolledsubstance.blogspot.com
istripper.com
iwantmyfreecash.com iwantmyfreecash.com
iwanttodeliver.com izoll.ru
izhevsk.zrus.org jbl-charge.info
jacago.com jennyfire.ru
javatex.co.id jo24news.com
jerseywholesalebizchina.com jongose.ninja
jobmarket.com.ua jose.mulinohouse.co
kaliningrad.zrus.org kamorel.com
kamagragelusa.net kandidos.com
kaz.kz kasino-money.pw
keywordspay.com kazka.ru
keywordteam.net kerei.ru
kinobaks.com ketoanhanoi.info
kinotorka.ru keywordbasket.com
kirov.zrus.org keywords-monitoring-your-success.com
kletkimehan.ru kidd.reunionwatch.com
kol-energo.ru komputernaya-pomosh-moscow.ru
konkursov.net
konkursowo-24.pl
konpax.com konpax.com
koral.se kraljeva-sutjeska.com
kovrenok.ru kredit-blog.ru
krasnodar.ru kutikomi.net
kw21.org kwzf.net
labplus.ru la-fa.ru
labvis.host.sk
ladsblue.com ladsblue.com
lancheck.net lanasshop.ru
landscaping.center landscaping.center
larchik.net laudit.ru
larger.io letolove.ru
lashstudia.ru letslowbefast.site
lasvegaslockandsafe.com lifebyleese.com
law-check-eight.xyz limtu.ifmo.ru
lawyers.cafe liquimondo.com
lechenie-gemorroya.com littleberry.ru
lida-ru.com localmatchbook.com
life-instyle.com locationdesaison.com
linkpulse.com lookingglassemb.com
lion.bolegapakistan.com louboutinshoes.xyz
livejasmin.com luchshie-topcasino.ru
lkbennettstore.online mafa-free.com
lolnex.us mafcards.ru
losangeles-ads.com magazin-pics.ru
lost-alpha.ru
lostaruban.com
lsex.xyz
lsp-awak-perikanan.com
luckyday.world
luckyshop.net.ua
m-google.xyz
mabdoola.blogspot.com
mainhp.net mainhp.net
malwareremovalcenter.com mamasuper.prom.ua
manifestyourmillion.com managerpak204.weebly.com
manimpotence.com
manipulyator-peterburg.ru
maridan.com.ua
marinetraffic.com
marketland.ml marketland.ml
matchpal-a.akamaihd.net mature.free-websites.com
mathgym.com.au medanestesia.ru
mebel-vstroika.ru medkritika.ru
medmajor.ru meendo-free-traffic.ga
megaindex.ru metabar.ru
meltwater.com mezaruk.info
metalonly.info microstatic.pl
metarip.ru misslike.ru
micasainvest.com mobicover.com.ua
minharevisao.com mojaocena.com
minyetki.ru mojowhois.com
mobile-appster.ru moncleroutletonline.win
monclerboots.xyz
money-every-day.com
montazhnic.ru
moonci.ru
moscow.xrus.org moscow.xrus.org
mossmesi.com musicktab.com
mowser.com musicstock.me
moyaterapiya.ru nardulan.com
mrlmedia.net nationalbreakdown.com
mtmtv.info newsperuse.com
muabancantho.info nofreezingmac.work
mydearest.co norththeface.store
mylida.org nvformula.ru
mysexpics.ru nyfinance.ml
nacap.ru obiavo.com
nalogovyykodeks.ru
narkologiya-peterburg.ru
networkad.net
newhairstylesformen2014.com
news-speaker.com
newstudio.tv
nfljerseys.online
nicefloor.co.uk
nsatc.net
o333o.com
obiavo.in obiavo.in
officedocuments.net offtopic.biz
old-rock.com oktube.ru
olympescort.com onefilms.net
onemantrip.com
oneshotdate.com oneshotdate.com
ons-add.men onlineku.com
ooo-olni.ru optitrade24.com
oops-cinema.ru osoznanie-narkotikam.net
origin-my.ru ownshop.cf
ostrovtaxi.ru
ourville.info
outshop.ru
ownshop.win
oxotl.com oxotl.com
panicatack.com panchro.xyz
panouri-solare-acoperis.com panouri-solare-acoperis.com
partner-cdn.men parajumpersstore.online
partner-high.men pastaleads.com
paydayloanslocal.com pavlodar.xkaz.org
peekyou.com perm-profnastil.ru
penisvergrotendepillennl.ovh pestomou.info
petsblogroll.com
phobia.us phobia.us
photo-clip.ru pinkduck.ga
pics-group.com pipki.r.acdnpro.com
picscout.com pixell.club
picsfair.com pizdopletka.club
pila.pl poems.com.ua
piluli.info poffet.net
pio.polytopesexempt.com pogruztehnik.ru
pix24x7.com polybuild.ru
pl.id-forex.com poquoson.org
play-mp3.com pornhive.org
podshipniki-nsk.ru pornhub-forum.ga
pogodnyyeavarii.gq porno.simple-image.com.ua
pons-presse.com pornogig.com
porngalleries.top pornpost.in
porno-raskazy.ru portnoff.od.ua
pornogad.com poshiv-chehol.ru
pornoplen.com pozdrawleniya.com
pornzone.tv presleycollectibles.com
potoideas.us privacylocationforloc.com
preparevideosafesystem4unow.site pro-poly.ru
progress-upakovka.ru productarium.com
prokotov.com projectforte.ru
promoforum.ru projefrio.com.br
pwwysydh.com prom23.ru
pxhdwsm.com prombudpostach.com.ua
quelle.ru prostitutki-belgoroda.org
quick-seeker.com prostitutki-yaroslavlya.org
quizzitch.net quick-offer.com
qwesa.ru qwarckoine.com
realting-moscow.ru rabotaetvse.ru
rapidokbrain.com
rarbg.to
razyboard.com
realizmobi.com
rebrand.ly rebrand.ly
rebuildermedical.com registratciya-v-moskve.ru
refads.pro remont-ustanovka-tehniki.ru
refudiatethissarah.info remybutler.fr
registrysweeper.com
reimageplus.com
reklamuss.ru
rentehno.ru rentehno.ru
resellerclub.com replicalouboutin.xyz
restaurantlescampi.com restorator-msk.ru
richinvestmonitor.com reversing.cc
rniaeba.ga ric.info
rockprogblog.com rusoft-zone.ru
rossmark.ru russkoe-zdorovie.ru
roznica.com.ua
rucrypt.com
rvtv.ru rvtv.ru
s.lollypopgaming.com s8-nowy-wygraj.comli.com
samo-soznanie.ru sadaholding.com
santasgift.ml sajatvelemeny.com
savememoney.co.za saltspray.ru
savetubevideo.com sanidumps.com
scanner-alex.top santechnik.jimdo.com
scanner-elena.top scanner-jess.top
scansafe.net scansafe.net
scripted.com scenicmissouri.us
search.xtconnect.com sdelatmebel.ru
searchkut.com segol.tv
securityallianceservices.com semalt.com
seminarygeorgia59.ga seorank.info
serialsway.ucoz.ru sergiorossistore.online
sex-watch.com sexgalleries.top
sexpornotales.net sexobzor.info
sexvporno.ru sexy.babes.frontend-stack.top
sexytrend.ru shillyourcoins.com
sharebutton.net shoesonlinebuy.cn
shariki-zuma-lines.ru shoesonlinebuy.xyz
sheerseo.com shopsellcardsdumps.com
ship-marvel.co.ua silktide.com
shitting.pro sims-sims.ru
signal03.ru sitopreferito.it
sisiynas.ru
site-speed-checker.site
siteonomy.com
smadihome.com smadihome.com
snegozaderzhatel.ru smart-scripts.com
snjatie-geroinovoy-lomki.ru snip.tw
social-fun.ru sobecjvuwa.com.ru
social-s-hhh.xyz social-vestnik.ru
socialmadesimple.com
softomix.net softomix.net
spidtest.org spin2016.cf
sr-rekneskap.no spl63.fr
stariy-baku.com spywarenuker.com
stmassage.ru spywarespy.com
sstroy44.ru
stardevine.com
statustroll.com
steebook.com
steelmaster.lv
sterva.cc
stillmiracle.com
stop-gepatit.te.ua stop-gepatit.te.ua
store-rx.com streha-metalko.si
stroicol.net stroiminsk.com
stroymonolit.su stromerrealty.com
sucsesofinspiration.com stuff-about-money.com
sugarkun.com success-seo.com
sunflowerdrawingpaintings.blogspot.com sugvant.ru
superfish.com supermesta.ru
surcentro.com svolze.com
swsociety.se swiped.su
symphonyintegratedhealthcare.com sygraem.com
tabletkinaodchudzanie.com.pl tabletkinaodchudzanie.com.pl
taraz.xkaz.org talant-factory.ru
tasteidea.com tastyfoodideas.com
td-33.ru teslathemes.com
teencastingporn.com thecoolimages.net
the-torrent-tracker.blogspot.com thefarmergame.com
thedownloadfromwarez.blogspot.com theheroes.ru
thegolfclub.info
thenetinfo.com
thetoiletpaper.com thetoiletpaper.com
titan-ads.life tizanidineinteractions.blogspot.com
titan-cloud.life tizanidinezanaflex.blogspot.com
tizanidinehcl2mgtablet.blogspot.com top-deal.com.pl
tizanidinenarcotic.blogspot.com top10registrycleaners.com
tizanidineusedfor.blogspot.com topcar-krasnodar.ru
tjkckpytpnje.com topquality.cf
tmearegion26.com
tnctrx.com
topclickguru.com
toproadrunner5.info
torrentdownloadhub.com
torrnada.ru
toursmaps.com
trafficjunky.net trafficjunky.net
traffpartners.com trafficmp.com
tramadolandtizanidine.blogspot.com trustl.life
trichizobswiv.agddns.net tsyndicate.com
trubywriting.com turizmus.us
truemfilelj.gq tx41tclega.ru
tubeoffline.com
tuckermktg.com
tupper-posuda.ru
ua-company.ru
ublaze.ru
uchetunet.su uchetunet.su
uchil.net
udsgame.online udsgame.online
ukkala.xyz uk-zheu20.ru
ukrtvir.com.ua ukrtextbook.com
unitexindia.com ukrup.com
ural-buldozer.ru umaseh.com
uvozdeckych.info unmaroll.ya.ru
unpredictable.ga
v24s.net
velobikestock.com velobikestock.com
vereo.eu verymes.xyz
versaut.xxx-cam.webcam viagra-soft.ru
viagengrarx.com viandpet.com
viagroid.ru video-camer.com
videochat.mx videochat.bz
videochaty.ru videogamesecrets.com
videtubs.pl vipps.com.my
vietimgy.pw virus-respirators.com
vilingstore.net visa-china.ru
virtuagirl.com vostoktrade.info
virus-schutzmasken.de vseigru.one
vitoriacabos.com vtc.pw
volgograd.xrus.org vtcdns.com
w7s.ru vysigy.su
wallpaperaccess.com wdfdocando.com
wallpapersdesk.info we-are-gamers.com
watracker.net webinstantservice.com
webkeyit.com
webs.com
webshoppermac.com webshoppermac.com
website-audit.com.ua website-audit.com.ua
webtherapy.ru wechatdownload10.com
welcomeauto.ru weclipart.com
wma-x.com weekes.biz.tc
wnhjavlhezp.gq wfb.hatedriveapart.com
worst-sites.online whengirlsgowild.com
writingservices17.blogspot.ru while.cheapwebsitehoster.com
www.arenda-yeisk.ru white-truck.life
www.solartek.ru winterclassichockeyjerseys.com
xev.ru wleuaprpxuvr.ga
xgames-04.com womama.ru
xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai woweb.com.ua
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai wpthemedetector.co.uk
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai www.souvenirua.com
xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai x-diesel.org
xn--h1aakne2ba.xn--p1ai xkaz.org
xtubeporno.net xn----itbkqkfiq.xn--p1ai
xvideosbay.com xn--80aanaardaperhcem4a6i.com
xxxasianporn.net xn--b1agm2d.net
yourads.website xtrafficplus.com
xtube.com
yoluxuryevents.com
your-bearings.com
ypmuseum.ru
zahvat.ru zahvat.ru
zapiszto.pl zaim-pod-zalog-krasnodar.ru
zastenchivosti.net zatjmuzu.info
zazagames.org zebradudka.com
zero1.it
zerocash.msk.ru zerocash.msk.ru
zetmaster.ru zreloeporno.tv
zog.link
zoosexart.com
zs2vm.top
zvezdagedon.ru
zygophyceous.womanstars.site

484
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
08800.top 101raccoon.ru
4kpics.rocks abcguru.xyz
51.la acc.eu.org
883zy.com acmebtn.ml
8si.ru adclickthru.net
adnotbad.com adimmix.com
ads.tremorhub.com adultnet.in
adult3dgames.com advertex.info
advertisingtag.net ahrefs.com
agysya.ru aimayangzhi.com
alive-ua.com alfa9.com
allstatesugarbowl.org alice.it
alphacarolinas.com allforminecraft.ru
alphahoverboards.com allnews.md
angigreene.com alpharma.net
animenime.ru anaksma.info
apispringsmartne-a.akamaihd.net apessay.com
applyneedy.xyz arcteryxsale.online
asiengirls.net atlasvkusov.ru
atley.eu.pn availit.weebly.com
autobudpostach.club ayerbo.xhost.ro
autochoixspinelli.com azazaporn.com
autotrends.today azlex.uz
azbukafree.com azte.ch
battlecarnival.su bbsoldes.fr
bayareaaeroclub.org bet-prognoz.com
bg6s0.com bioscorp.ru
biteg.xyz blog.f00kclan.de
btvn.ru bloggedporn.com
bupropion-sr-150-mg.us blpmovies.com
buyscabiescream.com bmwhighperformers.com
buyviagraa.blogspot.com brokergid.ru
calvet.altervista.org bugshoot.cn
canzoni.ru buron.pw
carina-sy.de buy-cheap-online.info
cartierreplica.top buy-forum.ru
cashkitten-a.akamaihd.net cactussoft.biz
ceotrk.com canoncdriverq3.pen.io
cerev.info carmuffler.net
chatroulette.world cartierlovestore.com
cheapestjerseysonwholesale.com cb.iphantom.com
celejihad.info
cenokos.ru
centrdebut.ru
chidporn.com chidporn.com
cleanpcnow.com cibpenonptib.flu.cc
clicksor.com ciekawinki.pl
compliance-julia.top cienum.fr
cookingmeat.ru ciproandtizanidine.blogspot.com
cyse.tk circlesl.com
d-black.bz clippingphotoindia.com
dafatiri.com coaching-netz.info
decorationspcs.com coderstate.com
demon-tweeks.com compliance-irvin.top
design-lands.ru compliance-willy.top
diamond-necklace.info cookielawblog.wordpress.com
dikx.gdn data-mining.tk
docstoc.com deshevo-nedorogo.ru
doctissimo.fr dev78.dioniqlabb.se
domainsatcost.com digitalassetmanagement.site
downloadmefiranaratb1972.xpg.com.br dinkolove.ya.ru
dwomlink.info directivepub.com
efnor-ac.com discovertreasure-a.akamaihd.net
ekspertmed.com dnsrsearch.com
erotiktreff24.info download-wallpaper.net
escortplius.com doxysexy.com
essay-writing.work e-avon.ru
etotupo.ru e-poker-2005.com
europeanwatches.ru easync.io
extractorandburner.com elektronischezigarette2.mex.tl
eyes-on-you.ga elektronischezigarettekaufen1.myblog.de
ez8motelseaworldsandiego.com englate.com
ezigarettekaufen.myblog.de erectile.bid
ezigarettekaufen2.mpbloggar.se etur.ru
faracontrol.ir facialporntube.com
fashion-stickers.ru fakehandbags.xyz
feorina.ru
fetishinside.com
filesvine.com filesvine.com
fishtauto.ru finemanteam.com
flowersbazar.com flex4launch.ru
freewhatsappload.com forex.osobye.ru
frvo.alptandem.ru forpostlock.ru
fugarif.ga free-floating-buttons.com
funtoonez.com
fxund.us
g.starmoe.xyz g.starmoe.xyz
gallery.rennlist.com gallictures.com
galleryawesome.com gavuer.ru
gameonasia.com getmyads24.com
gazporno.com ghazel.ru
geckoandfly.com glall.ru
getoutofdebtfree.org graphics8.info
gg-arena.ru greenzaim.ru
goldadpremium.com gsasearchengineranker.xyz
goldenggames.com gsbs.com.ua
gunsvicceadadebt.tk gwebtools.com
handsandlegs.ru hermesbracelets.xyz
hasfun.com himazin.info
hchha.com histats.com
hdwalls.xyz houston-vikings.com
hmmm.cz hplaserjetpdriver8y.pen.io
hobild.net hulfingtonpost.com
hully.altervista.org iamsport.org
ideawheel.com ico.re
imediadesk.com ideibiznesa2015.ru
imgata.com imagine-ex.co
indo-export.ru impresagaia.it
insider.pro insta-add.pro
int.search.mywebsearch.com interior-stickers.ru
iqbazar.ru investsuccess.org
iqs.biz.ua inzn.ru
isitpaleo.info ipostroika.ru
isitwp.com jav-fetish.site
istock-mebel.ru
ivoiretechnocom.ci
ix20.ru
izoll.ru
jackwolfskinoutlet.online
javidol.site javidol.site
jolic2.com jerseywholesalechinabiz.com
jwcialislrt.com jikoman.info
karusel-market.ru joessmogtestonly.com
kazrent.com joyceblog.top
kino-filmi.com keywordhouse.com
kinopolet.net komp-pomosch.ru
knogg.net konkursov.net
kvartir-remont.biz kutikomi.net
laapp.com lacasamorett.com
letslowbefast.today landscaping.center
lion.misba.us laserpen.club
lion.playtap.us laxdrills.com
lubetube.com lazymanyoga.com
m292.info lechtaczka.net
mamasuper.prom.ua legionalpha.com
meddesk.ru liffa.ru
medi-fitt.hu lion.conboy.us
mega-polis.biz.ua littlesunraiser.com
megahdporno.net live-sexchat.ru
megaindex.ru llastbuy.ru
mesbuta.info lob.com.ru
mielec.pl localmatchbook.com
militarysale.pro lockerz.com
misslike.ru loginduepunti.it
mlvc4zzw.space lookingglassemb.com
moesen-ficken.com louboutinreplica.xyz
moncleroutletonline.xyz lovelycraftyhome.com
moscow-region.ru lovi-moment.com.ua
moxo.com makis.nu
musicktab.com mediawhirl.net
myftpupload.com medicine-4u.org
myghillie.info missclub.info
nailsimg.com misswell.net
nardulan.com my-bc.ru
nastroyke.net myfreetutorials.com
netpics.org mysex21.com
new-apps.ru nakozhe.com
nikhilbahl.com naperehresti.info
njpalletremoval.com njpalletremoval.com
nl.netlog.com nonameread45.live
ntic.fr noumeda.com
obiavo.com novosti-hi-tech.ru
obuv-kupit.ru nsatc.net
offf.info o-o-11-o-o.com
o-o-6-o-o.com
obnal.org
offtime.ru
okuos.com okuos.com
online-hit.info online.ktc45.ru
ostrovtaxi.ru owohho.com
otbelivanie-zubov.com parajumpersstore.online
ovirus.ru phormchina.com
physfunc.ru pigrafix.at
pictures-and-images.net plastweb.ru
piluli.info porno-raskazy.ru
pk-pomosch.ru pornofiljmi.com
pons-presse.com portal-eu.ru
prefersurvey.net pro-poly.ru
pregnant.guru promodj.com
prostitutki-rostova.org prostitutki-novgoroda.org
ranksignals.com quelle.ru
ranksonic.com quickbuck.com
ranksonic.org rating-bestcasino.com
rebrand.ly razamicroelectronics.com
rff-cfal.info realresultslist.com
rique.host.sk remontbiz.ru
rrutw.com renecaovilla.online
scanner-jess.top renewablewealth.com
scansafe.net rentehno.ru
scanspyware.net rewardit.com
sdi-pme.com rocketchange.ru
seobility.net rockma.se
seoboxes.com ros-ctm.ru
serw.clicksor.com roznica.com.ua
sexflirtbook.com russia-today-video.ru
sexvideo-sex.com searchwebknow-a.akamaihd.net
shama-rc.net seeresultshub-a.akamaihd.net
signal03.ru seminarygeorgia59.ga
site-auditor.online shell-pmr.ru
sitiz.club shop.acim.org
shopcheermakeup.info
silktide.com
site3.free-share-buttons.com
slim.sellany.ru
small-game.com
smartpet.ru smartpet.ru
snegozaderzhatel.ru snegozaderzhatel.ru
snworks.com social-s-ggg.xyz
sobecjvuwa.com.ru social-s-hhh.xyz
soc-proof.su spywarespy.com
soserfis.com strag-invest.ru
spravka-medosmotr.ru sugarkun.com
spy-app.info tabletkinaodchudzanie.com.pl
spy-sts.com teenforporn.com
stard.shop the-torrent-tracker.blogspot.com
sukarame.net tizanidinehcl2mg.blogspot.com
supermama.top tmearegion26.com
tanieaukcje.com.pl topvidos.ru
tattooha.com torrents-tracker.com
textads.men torrents.cd
timeallnews.ru tovaroboom.vast.ru
tizanidineandcipro.blogspot.com trafficmonetize.org
tizanidinedosageforsleep.blogspot.com u-cheats.ru
tizanidinedruginteractions.blogspot.com unisexjewelry.org
tizanidinevscyclobenzaprine.blogspot.com univerfiles.com
topbestgames.com unrealcommander.com
totu.info vacuumcleanerguru.com
toy-shop.top varbergsvind.se
track112.site vellings.info
tracksurf.daooda.com video-chat.cn
traffpartners.com videtubs.pl
traxdom.ru vids18.site
tversvet.ru viveresaniesnelli.it
typer.one wapsite.me
ukkala.xyz watchmygf.net
ultramart.biz watsonrealtycorp.com
unrealcommander.biz we-are-gamers.com
vbtracker.net weboptimizes.com
vchulkah.net website-analytics.online
veopornogratis.xxx westen-v.life
via-energy-acquistare.com westvilletowingservices.co.za
viagra.pp.ua whiteelephantwellington.com
vintontech.info wingsoffury2.com
vse-pesni.com wjgony.com
website-speed-checker.site wowas31.ucoz.ru
wetgames.ru x5market.ru
wholesalejerseys-cheapest.com xgftnlrt.bloger.index.hr
wholesalejerseyscheapjerseys.us.com xn--1-8sbcpb0bdm8k6a.xn--p1ai
wildworld.site yatrk.xyz
womensplay.net yogamatsexpert.com
wordpresscore.com yuarra.pluto.ro
world-mmo.com yun56.co
ww2awards.info zaimhelp.ru
www.arenda-yeisk.ru zeroredirect5.com
www.kabbalah-red-bracelets.com zkjovpdgxivg.ga
xlolitka.com zmoda.hostreo.com
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai zynax.ua
xn--80aanaardaperhcem4a6i.com
xn--h1ahbi.com.ua
yourmovies.pl
zeroredirect12.com
zocaparj.kz
zytpirwai.net

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.80 0; 10.1.0.14 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3221 ### Version: V4.2022.07.3222
### Updated: Mon Jul 11 10:03:39 UTC 2022 ### Updated: Mon Jul 11 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.07.3221 ### Version: V4.2022.07.3222
### Updated: Mon Jul 11 10:03:39 UTC 2022 ### Updated: Mon Jul 11 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##