vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 10:40:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2898 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-04 22:07:15 +00:00
parent 31ba776a33
commit bf2606590f
47 changed files with 77483 additions and 77493 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2897 #### Version: V4.2022.02.2898
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2897 #### Version: V4.2022.02.2898
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2897 #### Version: V4.2022.02.2898
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9550
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2897 #### Version: V4.2022.02.2898
#### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7089](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9554
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9554
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9554
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9554
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2897 2898

9554
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9554
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.22.124 0; 13.92.136.14 0;

9554
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

9554
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.22.124 0; 13.92.136.14 0;

9554
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.112.22.124 0; 13.92.136.14 0;

9554
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 1; 10.1.0.135 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Brandwatch Dirbuster
DSearch G-i-g-a-b-o-t
Seekport InfoTekies
T8Abot Iria
WebSucker Mag-Net
WebsiteQuester Mister PiX
Who.is Bot PyCurl
WinHTTrack SmartDownload
clark-crawler WebAuto
meanpathbot webprosbot

304
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
404checker 404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek Abonti
Aboundex Aboundex
Aboundexbot Acunetix
AlphaBot AfD-Verbotsverfahren
AiHitBot
Aipbot
Alligator
Ankit
Anthill
Apexoo Apexoo
Aspiegel AwarioRssBot
Asterias AwarioSmartBot
BDCbot BBBike
BLEXBot BackStreet
BackDoorBot
BackWeb BackWeb
Backlink-Ceck BacklinkCrawler
Badass
Bandit Bandit
Barkrowler
BatchFTP BatchFTP
Battleztar Bazinga
BetaBot BetaBot
Bitacle
BlackWidow
Blow
BlowFish BlowFish
Bolt Brandwatch
Buck Buck
Buddy BuiltWith
Bullseye
CATExplorador CATExplorador
CCBot Calculon
CazoodleBot
Cegbfeieh Cegbfeieh
CheTeam CheeseBot
Chlooe CherryPicker
Citoid CopyRightCheck
Cocolyzebot
Copier
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DBLBot
DIIbot DIIbot
DSearch DataCha0s
DTS Agent
Deusu
Dirbuster Dirbuster
Disco
Discobot
Discoverybot Discoverybot
Dispatch Dispatch
DittoSpyder DittoSpyder
DomainCrawler
Dotbot
Drip
EMail Wolf EMail Wolf
EasyDL EroCrawler
Ebingbong Exabot
Ecxi EyeNetIE
Extractor
Extreme Picture Finder
Ezooms Ezooms
FemtosearchBot FDM
Firefox/7.0
Foobot Foobot
FrontPage
Fuzz Fuzz
FyberSpider Fyrebot
GT::WWW
Genieo
GermCrawler GermCrawler
GetRight Getintent
GetWeb
Gigabot Gigabot
Go!Zilla GrapeFX
Go-Ahead-Got-It HMView
GrapeshotCrawler HTTrack
HTTP::Lite Haansoft
HaosouSpider Humanlinks
Harvest Image Fetch
HonoluluBot
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
InfoNaviRobot
InfoTekies InfoTekies
Intelliseek Iria
InterGET JamesBOT
JOC Web Spider
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Jyxobot
Kenjin Spider Kenjin Spider
Kinza Keyword Density
Kozmosbot
LWP::Simple
Larbin Larbin
LeechGet Leap
LexiBot Lftp
LibWeb LibWeb
LieBaoFast
Likse
LinkScan LinkScan
LinkWalker LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinksManager LinkpadBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Spider
Litemage_walker Litemage_walker
Ltx71 Lmspider
MIDown tool MIDown tool
MJ12bot MJ12bot
MSFrontPage
MTRobot MTRobot
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12 Majestic12
Mediatoolkitbot Mata Hari
MauiBot
Meanpathbot
Metauri Metauri
Morfeus Fucking Scanner MicroMessenger
Msrabot Mozlila
NICErsPRO Mr.4x3
Musobot
Name Intelligence
Navroad Navroad
NearSite
Needle Needle
Nessus Nessus
Net Vampire
NetAnts NetAnts
NetLyzer NetLyzer
Netcraft NetMechanic
Nettrack NetSpider
NetZIP
Netvibes
Nibbler Nibbler
Niki-bot
Nikto Nikto
NimbleCrawler Ninja
Not
Nuclei Nuclei
Octopus Nutch
Offline Explorer
Offline Navigator Offline Navigator
OpenVAS OpenVAS
Openvas Openfind
OrangeBot OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient Panscient
Papa Foto Pavuk
PeoplePal PeoplePal
Picscout
Picsearch Picsearch
PictureFinder Pockey
Piepmatz Pump
Pimonster
PleaseCrawl
Psbot
Pu_iN
PyCurl PyCurl
QueryN Metasearch
Quick-Crawler Quick-Crawler
RSSingBot RankActive
RankurBot RankFlex
RebelMouse RankingBot
RankingBot2
ReGet
RealDownload
Recorder Recorder
RepoMonkey
RocketCrawler RocketCrawler
SBIder SEOkicks
SEOkicks-Robot
SISTRIX SISTRIX
SMTBot
SalesIntelligent
Scrapy Scrapy
ScrepyBot Seekport
Searchestate SentiBot
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot Siphon
Shodan
SiteSnagger
Siteimprove Siteimprove
Sitevigil
SlySearch SlySearch
SmartDownload
Snake Snake
Snoopy
Sosospider
Sottopop Sottopop
Spammen Spanner
SpankBot
Spbot Spbot
Steeler Spinn3r
Sucker SputnikBot
Sucuri
SuperBot
SuperHTTP
Surfbot Surfbot
T8Abot Teleport
Telesphorep TeleportPro
The Intraformant The Intraformant
Tracemyfile TheNomad
Titan
Toweyabot
Trendictionbot Trendictionbot
True_Robot True_Robot
Turnitin Turingos
URLy Warning
URLy.Warning URLy.Warning
UnisterBot V-BOT
Upflow
Vagabondo Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
Voil Virusdie
WASALive-Bot
WBSearchBot
WISENutbot WISENutbot
WPScan WWW::Mechanize
WWW-Collector-E
Wallpapers Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE
Web Auto Web Auto
Web Collage
Web Fetch Web Fetch
Web Fuck Web Fuck
WebAuto Web Sauger
WebBandit
WebCopier
WebFetch WebFetch
WebImageCollector
WebPix WebPix
WebReaper
WebSauger WebSauger
WebWhacker WebStripper
WebSucker
WebZIP WebZIP
WebsiteQuester Website Quester
Webster Widow
Whatweb WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Woobot
Wprecon Wprecon
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider Xenu
YoudaoBot
Zade Zade
Zitebot Zermelo
ZmEu ZmEu
ZoomBot ZoominfoBot
ZumBot
ZyBorg ZyBorg
arquivo-web-crawler adscanner
archive.org_bot
backlink-check
cah.io.community
clark-crawler clark-crawler
coccocbot-web cognitiveseo
crawler.feedback com.plumanalytics
dataforseo.com crawl.sogou.com
heritrix crawler4j
demandbase-bot
gopher
internetVista monitor internetVista monitor
iubenda-radar magpie-crawler
muhstik-scan meanpathbot
page scorer netEstate NE Crawler
oBot
plumanalytics
polaris version
ripz ripz
satoristudio.net
scalaj-http scalaj-http
seoscanners sitechecker.pro
serpstatbot
siteripz siteripz
sogouspider
sp_auditbot
sysscan
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webmeup-crawler webmeup-crawler
webpros.com
webprosbot webprosbot
zauba.io x22Mozilla
zgrab

300
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404checker 360Spider
404enemy 404enemy
AIBOT
Aboundex
Aboundexbot
Acunetix Acunetix
Aipbot AfD-Verbotsverfahren
Anthill AllSubmitter
Apexoo AlphaBot
Ankit
Aspiegel Aspiegel
Asterias Asterias
AwarioRssBot AwarioSmartBot
BLEXBot BDCbot
BackDoorBot BackStreet
Badass BackWeb
Barkrowler Backlink-Ceck
Battleztar Bazinga BatchFTP
Bitacle BetaBot
Black Hole
Blackboard Blackboard
Bolt
Brandwatch
Buddy Buddy
BuiltWith BuiltBotTough
Bullseye Bullseye
BunnySlippers
BuzzSumo BuzzSumo
CCBot CODE87
CSHttp CSHttp
Calculon Calculon
CheeseBot CazoodleBot
Chlooe CherryPicker
Citoid Citoid
Claritybot Claritybot
Cliqzbot Cliqzbot
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector
Copier Copier
CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
Crescent CrazyWebCrawler
CrunchBot DBLBot
Custo
CyotekWebCopy
DIIbot DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Devil DigitalPebble
Discobot Dirbuster
Dispatch Dispatch
DnBCrawler-Analytics DittoSpyder
DnyzBot DomCopBot
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Download Wonder
EMail Siphon EMail Siphon
EMail Wolf EasyDL
Ecxi
EirGrabber EirGrabber
EroCrawler
Evil Evil
ExtLinksBot Exabot
EyeNetIE
FDM
FHscan FHscan
FemtosearchBot FemtosearchBot
Fimap Firefox/7.0
FlashGet Freeuploader
FrontPage
Fuzz Fuzz
FyberSpider Fyrebot
Genieo G-i-g-a-b-o-t
GermCrawler GalaxyBot
Getintent GetWeb
Go!Zilla Go-Ahead-Got-It
Grafula GoZilla
GrapeFX Grabber
GridBot
HMView
HTMLparser HTMLparser
HTTrack HaosouSpider
Harvest IDBot
Heritrix Id-search
HonoluluBot InfoNaviRobot
Humanlinks InfoTekies
HybridBot
Indy Library
Intelliseek Intelliseek
InterGET InterGET
Iria
Iskanie Iskanie
JetCar IstellaBot
JamesBOT
JennyBot
Jetty Jetty
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider Kenjin Spider
LNSpiderguy Keyword Density
LWP::Simple Kozmosbot
Larbin LeechFTP
Leap LexiBot
LeechGet Libwhisker
LibWeb Likse
LinqiaRSSBot Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Ltx71 Ltx71
MIIxpc MFC_Tear_Sample
MIDown tool
MSFrontPage MSFrontPage
MSIECrawler MSIECrawler
MTRobot
Magnet Magnet
MarkMonitor Mail.RU_Bot
Masscan Majestic SEO
Mb2345Browser MarkWatch
MeanPath Bot MegaIndex.ru
Microsoft URL Control
Mister PiX Mister PiX
Moblie Safari Moblie Safari
MolokaiBot Mojolicious
Msrabot
Musobot
Name Intelligence Name Intelligence
Nameprotect
Navroad Navroad
NearSite
Needle Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NetSpider NetSpider
NextGenSearchBot Nibbler
Niki-bot
NimbleCrawler NimbleCrawler
Nimbostratus
Ninja Ninja
Nmap
Not
Nutch Nutch
Octopus Offline Explorer
Offline Navigator OnCrawl
OpenVAS
Openfind
OrangeBot OrangeBot
OutclicksBot OutclicksBot
PHPCrawl OutfoxBot
POE-Component-Client-HTTP PECL::HTTP
PageGrabber
PageThing.com PageThing.com
Panscient Picscout
Pavuk Pockey
PeoplePal
Pi-Monster
Piepmatz
Pimonster
Pixray
ProPowerBot
ProWebWalker ProWebWalker
Pu_iN Pu_iN
Pump Quick-Crawler
QueryN Metasearch RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex RankFlex
Rankivabot RankingBot
RankurBot
Re-re Re-re
ReGet
RealDownload RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey RepoMonkey
Ripper
RocketCrawler
Rogerbot Rogerbot
SEOlyticsCrawler SEOkicks
SMTBot SEOprofiler
SalesIntelligent SalesIntelligent
Scanbot
ScoutJet
Scrapy Scrapy
Screaming
ScreenerBot ScreenerBot
ScrepyBot Searchestate
SearchmetricsBot SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan Shodan
Siphon
Site Sucker Site Sucker
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker SiteSucker
Sitebeam Snake
Sitevigil SpaceBison
SlySearch
SmartDownload
Snoopy
Sociscraper
Sosospider
Spammen
Spinn3r Spinn3r
SputnikBot
Sqlmap Sqlmap
Sqlworm
Sqworm Sqworm
Steeler Steeler
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot Surfbot
Suzuran
Szukacz Szukacz
T8Abot
Teleport
TeleportPro TeleportPro
Telesphorep
The Intraformant The Intraformant
TheNomad TheNomad
TightTwatBot TightTwatBot
Toata Toata
Toweyabot Trendiction
True_Robot True_Robot
Turnitin V-BOT
URLy Warning VidibleScraper
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voil Voil
Voltron Voltron
WWW-Mechanize WISENutbot
Web Fetch WPScan
Web Sucker WWW-Collector-E
WebBandit WWW::Mechanize
Wallpapers
WallpapersHD
WebFetch WebFetch
WebImageCollector
WebLeacher
WebPix WebPix
WebReaper WebReaper
WebSucker WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot WebmasterWorldForumBot
Webster Webshag
Wonderbot Website Quester
Xaldon WebSpider WebsiteExtractor
Xenu Whacker
YoudaoBot Who.is Bot
Zade WinHTTrack
Zeus Woobot
Zitebot Xaldon_WebSpider
ZoomBot
ZyBorg
archive.org_bot archive.org_bot
cah.io.community arquivo.pt
autoemailspider
backlink-check
coccocbot-web coccocbot-web
crawl.sogou.com crawler.feedback
dataforseo.com dataforseo.com
demandbase-bot demandbase-bot
eCatch eCatch
instabid evc-batch
isitwp.com gopher
iubenda-radar internetVista monitor
lwp-request
mediawords mediawords
muhstik-scan muhstik-scan
oBot netEstate NE Crawler
page scorer page scorer
pcBrowser pcBrowser
ripz plumanalytics
scan.lol polaris version
seoscanners s1z.ru
satoristudio.net
seostar seostar
siteripz serpstatbot
sp_auditbot
spyfu
tAkeOut tAkeOut
webgains-bot trendiction.de
voyagerx.com
webmeup-crawler
webprosbot webprosbot
zgrab x22Mozilla

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
amyfoxfitness.com 123kuma.com
boazpower.com admeasures.com
c-gainsbourg.com dktr.ru
editmedios.com elitepcgames.com
karusel-market.ru gazoblok.net.ua
perfection-pleasure.ru insider.pro
sa-rewards.co.za notebook-pro.ru
sexphoto.site theplacetoupdating.pw
sodexo.com thetoiletpaper.com
sudexpert66.ru xn--80aikhbrhr.net

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0c47f8422d3f.com 00author.com
0daymusic.org 11235813.webzdarma.cz
1008.su 11pikachu.ru
1688.com 2daytrendingnews.com
178evakuator178.ru 2itech.ru
18ps.ru 4kepics.com
2kata.ru 51.la
45en.ru 6hopping.com
4inn.ru 7makemoneyonline.com
7a2rnuey1tw9ar.ru 8si.ru
8kisses.eu 9icmzvn6.website
DomainStatsBot adclickthru.net
a96527gi.beget.tech add-add.men
aa14ab57a3339c4064bd9ae6fad7495b5f.com ads.gold
aac52006ec82a24e08b665f4db2b5013f7.com adsfresh.men
acads.net adultfriendfinder.com
actionnooz.com agapovdg.ru
adidas.frwebs.fr agreda.pluto.ro
adman.gr air-edem.ru
adminshop.com alekseevec.ru
adtech.de all4wap.ru
advancedcleaner.com ampower.me
advokat-grodno.by anabolics.shop
adzpower.com analytics-ads.xyz
akvamaster.dp.ua android-style.com
alessandraleone.com animalia-life.club
allsilver925.co.il anonymizeme.pro
alphavisions.net ap.senai.br
altamayoztourism.com apiappenableinfo-a.akamaihd.net
amazingpic.net apioutoboxnet-a.akamaihd.net
anti-virus-removal.info apiportalmorecom-a.akamaihd.net
apper.de approved.su
arenda-avtoprokat-krasnodar.ru apps-analytics.net
arius.tech aruplighting.com
artdestshop.eu asrvvv-a.akamaihd.net
arvut.org atlant-auto.info
asscenihotosidea.blogspot.com audiobangout.com
atmovs.com autobrennero.it
atout-energie-69.com autolombard-krasnodar.ru
aviav.org automatic-seo.com
avkzarabotok.com autovideobroadcast.com
avon-severozapad.ru avto-oligarh.ru
avtocredit-legko.ru avtoarenda.by
avtointeres.ru
avtovolop.ru
ayanaspa.com ayanaspa.com
azartniy-bonus.com ayeartoforget.com
azinoofficial777.ru b00kmarks.com
azlex.uz babyfactory.fr
backuperwebcam.weebly.com backiee.com
badavit.com.ua backlinkwatch.com
bannerads.de bala.getenjoyment.net
baoxaydung.com.vn balla-boo.se
bestfortraders.com balois.worldbreak.com
besttorrentknifta.weebly.com bang-hotties.com
bgviagrachrx.com bdsmgalls.net
bidbuy.co.kr beachpics.com
bigames.online betune.onlinewebshop.net
bimatoprost-careprost.com biglistofwebsites.com
bimmerpost.com bigpictures.club
biteg.xyz bikini-image.com
bizru.info bizlist.com.de
bjgugu.net.ua blog.f00kclan.de
blavia.00author.com bnt-team.com
bloggen.be bobinoz.com
bluesalt.co bonky.biz
bluesman.nu bookmark4you.com
bonzibuddi.com boole.onlinewebshop.net
brainboostingsupplements.org brainsandeggs.blogspot.com
buckspar.gq braintobe.win
budpost.com.ua bscodecs.com
buigas.00it.com bumskontakte.org
business-made-fun.com buy-cheap-pills-order-online.com
buyparajumpers.online buypuppies.ca
buytizanidineonlinenoprescription.blogspot.com buzzonclick.com
cactussoft.biz candiceloves.us
camel-beach.com canvas.gloverid.site
cand.jp carapics.com
candlehandmade.com cartierbracelet.xyz
carabela.com.do cartierbraceletsreplica.pw
cars-modification.net cartierlovebracelet.xyz
cartierlove.xyz cartierreplica.top
casinorewards.info casinopinup-wins.com
cbox.ws
cbozhe.com
cctva.tv
cdncash.net cdncash.net
centre-indigo.org.ua censys.io
cgi2.nintendo.co.jp centraletermice.us
chastnoeporno.com cheapbarbour.online
cheapestjerseysonwholesale.com cheapjerseysap.com
cheapjerseysa.com cheapsergiorossi.online
check-host.net
checkhit.com
chelnytruck.ru chelnytruck.ru
children-learningreading.info chocolateslim-u-srbiji.com
chimiver.info chocoslim.pro
chiptuninger.com cienum.fr
christianlouboutinsaleonline.us cjs.com.ru
clickhype.com clean-virus-mac.com
clicksotrk.com clknsee.com
coinsspb.com compliance-george.top
compliance-irvin.xyz
comsysnet.com comsysnet.com
conciergegroup.org continent-e.tv
concordexoticrentals.com counterbot.com
construmac.com.mx culad.com
cookie-law-enforcement-ee.xyz dailystrength.org
coolwallpapers-hd.com daymusam.com
countbertwistdisp26.soup.io dealighted.com
crackzplanet.com dellalimov.com
craftinsta.ru demian.kz
creditmoney.com.ua designdevise.com
cubook.supernew.org dichvuvesinhhanoi.com
culmimg.pw digitalassetmanagement.site
customcatchcan.com dimaka.info
czeshop.info dinkolove.ya.ru
dame-ns.kz diusyawiga.tk
danceuniverse.ru dokumentalkino.net
dandiyabeats.in domainsphoto.com
data-mining.tk draniki.org
dayibiao.com driving.kiev.ua
ddospanel.com dyt.net
derevesendeco.com earn-from-articles.com
detoxmed24.ru elektroniksigaraankara.info
deutschland123.de elidelcream.weebly.com
dispo.de elitesportsadvisor.com
domcran.net elstal.com.pl
doska-vsem.ru emergencyneeds.org
dptaughtme.com empathica.com
drunkenstepfather.com enbersoft.com
dscaas.website erotik-kostenlos.net
dvervmoskvu.ru esfchat.tk
e-c.al eshop.md
e-poker-2005.com etur.ru
eachdayisagift.review
eandsgallery.com
edwinkonijn.com.au
ege-russian.ru
electrik-avenue.com
elektrozigaretten1.postbit.com
energy-ua.com
eredijovon.com
ereko.ru
escortslet.net
euronis-free.com
exci.ru exci.ru
exportshop.us expdom.com
extremepornos.net ezb.elvenmachine.com
eyemagination.com ezigarettenshop1.yolasite.com
ezaz.info f012.de
favoritemoney.ru face.hostingx.eu
fbdownloader.com fapgon.com
faptitans.com
farmingworm.com
fast-torrent.ru
favornews.com
fefo.gdn fefo.gdn
ferieboligkbh.dk ferretsoft.com
ff30236ddef1465f88547e760973d70a.com filmetricsasia.com
fickenprivat.info finstroy.net
fikasound.tk fireads.men
filmfanatic.com flagcounter.me
findclan.org
firstdrugmall.ru
fitfloponline.store
flipper.top
focalink.com focalink.com
forms-mtm.ru forexgb.ru
fortevidyoze.net foto-telok.net
foxjuegos.com fotzen-ficken.com
fr-bearings.ru free411games.com
franch.info freeuploader.com
freelifetimefuckbook.com freeuploader.ml
fres-news.com fres-news.com
freshmac.space fym.com.ru
froggytube.com
funnypica.com
funponsel.com
galaxy-family.ru
galeria-zdjec.com galeria-zdjec.com
game-mmorpg.net gardene.ru
game300.ru gazporno.com
gamezblox.com gdcentre.ru
gearcraft.us gdebestkupit.ru
gelezki.com generalporn.org
gemgrab-a.akamaihd.net gidonline.one
get-free-social-traffic.com girlporn.ru
getoutofdebtfree.org girlsatgames.ru
girlspicsa.com go2mike.ru
goatse.ru goldandcard.ru
gok-kasten.net gomusix.com
goldadpremium.com googlefeud.com
google-liar.ru
goroda-vsego-mira.ru
greendream.com.ua
greenshop.su greenshop.su
guardlink.com gribkovye-zabolevaniya.com
guardlink.org groupmoney.ru
guitar-master.org grtyi.com
habermetre.com gsasearchengineranker.pw
hccoder.info gtopstats.com
hdimagegallery.net gwagka.com
heatpower.ru gwhwpxbw.bloger.index.hr
gyffu.com
gymi.name
haikuware.com
harmonyglen.us
hasshe.com
hd-filmy.net
hebr.myddns-flir.com
heygidday.biz heygidday.biz
highland-homes.com hifidesign.ru
highstairs-a.akamaihd.net himazin.info
hiwibyh.bugs3.com historichometeam.com
homedecorpicture.us hledejvshopech.cz
hotchatdate.com hmywwogw.bloger.index.hr
hotcore.info hol.es
hothot.ru hostcritique.com
house.sieraddns.com howlongdoestizanidinestayinyoursystem.blogspot.com
hut1.ru huimin764128.com
ibb.com.ua hully.altervista.org
iboss.com i-service.kz
ideoworld.org ideoworld.org
igithab.com img.wallpaperstock.net
ilte.info incep.imagine-ex.co
in-tandem.co
inbabes.sexushost.com
indo-export.ru indo-export.ru
infektsii.com innodgfdriverhm.aircus.com
insomniagamingfestival.com instabid.tech
int.search.mywebsearch.com ipchicken.com
internetproviderstucson.com iphantom.com
iqoption-bin.com irkutsk.online-podarki.com
irkutsk.zrus.org itronics.ca
itrevolution.cf ivanovo.zrus.org
jackwolfskinoutlet.online javxxx18.com
jagg.info jennyfire.ru
janavibekken.no jerseychinabizwholesale.com
kartiniresto.com jerseyswholesalechinalimited.com
katadhin.co jerseywholesalebizchina.com
kaz.kz jofucipiku.tk
kemerovo.zrus.org justdating.online
ketrzyn.pl karusel-market.ru
keyhantercume.com kellyonline.xyz
keyword-suggestions.com
keywordhut.com
khadastoafarde.tk khadastoafarde.tk
khafre.us kino-rating.ru
kinogolos.ru kit-opt.ru
kol-energo.ru klumba55.ru
kolotiloff.ru kmgamex.cf
komputers-best.ru knowyournextmove.com
krasnodar.ru krasivoe-hd.net
krassh.ru ku6.com
ldrtrack.com kunstaktien.info
legionalpha.com kupit-adenu.ru
lezbiyanki.net kvartiry-remont.ucoz.ru
life.biz.ua laapp.com
limtu.ifmo.ru lapolis.it
locustdesign.co laserpen.club
lol-smurfs.com lawyers.cafe
lomb.co lemon-ade.site
lombardfinder.ru lignofix.ua
lombia.com linerdrilling.com
lonerangergames.com linkredirect.biz
lsp-awak-perikanan.com lionking-1994.blogspot.com
lubetube.com littlesunraiser.com
mactechinfo.info live-sexcam.tk
mansparskats.com livesex-amateure.info
maranbrinfo.com.br lizace.com
matrixalchemy.com louboutinreplica.pw
mediaoffers.click love-baby.cz
meetlocalchicks.com luckyday.world
megagrabber.ru luckyshop.net.ua
mexicosleevegastrectomy.com machicon-akihabara.info
michaelkorsoutlet.store machicon-ueno.info
mikozstop.com macrotek.ru
minegam.com magazintiande.ru
mirzonru.net magicplayer-s.acestream.net
misandesign.se makis.nu
mmofreegames.online managerpak204.weebly.com
mmostrike.ru markjaybeefractal.com
mnogolok.info marmitaco.cat
mobot.site matpre.top
money-every-day.com mebel-vstroika.ru
moscow-clining.ru mediafresh.online
mrpornogratis.xxx memberty.com
msk.afora.ru microsoftportal.net
musflashtv.com minet.club
mustwineblog.com minharevisao.com
my-floor.in.ua mlvc4zzw.space
mybackgroundlandscape.blogspot.com mobilierland.com
mydirtyhobby.com moinozhki.com
morf.snn.gr
movies-in-theaters.net
mttwtrack.com
muz-tracker.net
myfreecams.com myfreecams.com
mykings.pw myfreemp3.eu
myshopmatemac.com mywallpaper.top
narkologiya-peterburg.ru nakozhe.com
narutonaruto.ru nhl17coins.exblog.jp
neodownload.webcam nightvision746.weebly.com
nerudlogistik.ru niroo.info
net-profits.xyz nonameread45.live
new-post.tk nordvpn.com
nullrefer.com npoet.ru
o-dachnik.ru nrv.co.za
o-o-8-o-o.ru nudepatch.net
obiavo.ru o-o-6-o-o.ru
oda.as obiavo.su
ofanda.com
onblastblog.online
online-hd.pl
online-zaymy.ru online-zaymy.ru
onlinedomains.ru onlineku.com
open-odyssey.org onload.pw
openfrost.com orgasmus-virtual.com
ordernorxx.com orsonet.ru
panchro.co.uk ourtherapy.ru
parajumpersoutlet.online ownshop.win
partner-high.men ozoz.it
partnerworkroom.men par-fallen.ga
peekyou.com parajumpersstore.online
perfection-pleasure.ru partner-cdn.men
pharmacyincity.com partnerads.men
photochki.com pc-services.ru
pinwallpaper.xyz pdns.download
perm.xrus.org
pestomou.info
peugeot-club.org
pic2fly.com
piccdata.com
picphotos.net
picswe.com
picturesboss.com
piratecams.com
pixgood.com pixgood.com
pixshark.com porndl.org
pl-vouchers.com porno-video-chati.ru
pladform.ru pornobrazzers.biz
plastgranar.nu pornogig.com
poems.com.ua
poppen-nw.net
popugauka.ru
porndroids.com
porngalleries.top
pornogratisdiario.com pornogratisdiario.com
pornokajf.com pornohd1080.online
pornophoto.xyz pornoinn.com
pornozhara.com pornoklad.net
powitania.pl pornosemki.info
priscilarodrigues.com.br portadd.men
privatefx.all4invest.info portal-eu.ru
prizesbook.online prefersurvey.net
professionaldieselcare.com primedice.com
profitwithalex.info privetsochi.ru
promodj.com professionalwritingservices15.blogspot.ru
prosperent.com progonrumarket.ru
pufip.com prosmibank.ru
pulse33.ru prostitutki-almata.org
puteshestvennik.com proxyradar.com
puzo2arbuza.ru pst2017.onlinewebshop.net
qld10000.net pussyfleet.com
qualitymarketzone.com quickchange.cc
quelle.ru qwarckoine.com
rapevideosmovies.com radiodigital.co
ratemodels.net rainbowice.ru
razamicroelectronics.com rangjued.com
razleton.com rating-casino2021.ru
rcpmda.ikan1080.xyz rczhan.com
realting-moscow.ru realitykings.com
redirlock.com realtytimes.com
refads.pro recipedays.com
reklamuss.ru registrationdomainsite.com
renecaovillasale.online relax.ru
resant.ru rent2spb.ru
resellerclub.com replicalouboutin.xyz
restaurantlescampi.com rightenergysolutions.com.au
reyel1985.webnode.fr rootandroid.org
rfid-locker.co roznica.com.ua
rfserial.net runtnc.net
roleforum.ru rusexy.xyz
runofilms.ru rutor.group
s-forum.biz s1z.ru
sa-rewards.co.za saitevpatorii.com
saecsa.co samolet.fr
sale-japan.com sanatorrii.ru
salmonfishingsacramentoriver.com
satellite.maps.ilovevitaly.com satellite.maps.ilovevitaly.com
scalerite.co.za sbdl.no
scanmarine.info scanner-alex.top
scanner-don.top scanner-jess.top
scanner-julia.top scanner-marwin.top
scanner-viktor.top scanner-nelson.top
scanner-willy.top scansafe.net
se-welding.ru search.pch.com
search.1and1.com searchwebknow-a.akamaihd.net
seasonvar.ru seeresultshub-a.akamaihd.net
seminarygeorgia59.ga sexreliz.com
senger.atspace.co.uk sexs-foto.com
seo-2-0.com sexvideo-sex.com
seoanalyses.com sexy-pings.com
seokicks.de sexyali.com
seorankinglinks.com
sexblog.pw
sextracker.com
sexy-screen-savers.com
sharebutton.to sharebutton.to
shinikiev.com.ua
shitmovs.com shitmovs.com
shopcheermakeup.info sierraapps.com
shopvilleroyboch.com.ua simple-share-buttons.com
shopwme.ru sims-sims.ru
signx.info sirpornogratis.xxx
similardeals.net site-speed-checker.site
sinel.info snip.tw
siteimprove.com social-button.xyz
sivs.ru social-s-ggg.xyz
smailik.org sockshares.tv
smart-balancewheel.com sohoindia.net
snworks.com sotkal.lark.ru
socialbookmarksubmission.org spinazdrav.ru
softomix.net spl63.fr
sogimlecal.tk spy-sts.com
sprttrack.com sribno.net
spy-app.info staff.prairiesouth.ca
spylog.com stanthonyscatholicchurch.org
stairliftsarea.com
stard.shop stard.shop
stats-public.grammarly.io starwars.wikia.com
stjamesschool.info stickers-market.ru
streetfooduncovered.com strana-krasoty.ru
strongsignal-a.akamaihd.net stroyhelp-dv.ru
stroy-portal22.ru stuffpride.com
studiokamyk.com.pl styro.ru
svarbit.com sukarame.net
svarkagid.com superkanpo.com
swingerseiten.com supermesta.ru
taihouse.ru suralink.com
taqywu51.soup.io tastyfoodideas.com
technopellet.gr tecspb.ru
teenporn18.net telegramdownload10.com
telemetryverification.net telemetryverification.net
telesvoboda.ru tgtclick.com
thaismartloan.com thebestphotos.eu
theautoprofit.ml thecounter.com
thebestweightlosspills.ovh thefotosgratis.eu
tizanidinehcl4mgtabinfo.blogspot.com timetorelax.biz
timhost.ru
tizanidinedruginteractions.blogspot.com
tizanidinevssoma.blogspot.com
tizanidinewithdrawal.blogspot.com
tizanidinezanaflex.blogspot.com tizanidinezanaflex.blogspot.com
tmearegion26.com toondinsey.com
tmm-kurs.ru traffic2cash.org
toolsky.com trafficreceiver.club
tooplay.com traffpartners.com
top-deal.com.pl trucri.me
top10-online-games.com uamtrk.com
torrentdownloadhub.com udayavani.com
trafficgenius.xyz ukrtvory.in.ua
trailer.cinemaflix.website umg-stroy.ru
trustedhealthtips.com validdomain.xyz
tuckermktg.com vashsvet.com
tv-spoty.info vchulkax.com
tvand.ru velobikestock.com
tvoystartup.ru venta-prom.ru
twittruth.com ventelnos.com
txxx.com
uggsale.online
ukrup.com
ultramart.biz
um-razum.ru
userequip.com
uvozdeckych.info
valkiria-tk.ru
valmetrundan.se
vclicks.net
vedomstvo.net
vekzdorov.ru
vesnatehno.ru vesnatehno.ru
viandpet.com viberdownload10.com
video-chat.in video--production.com
videochat.ph video-chat.cn
video-hollywood.ru
video-woman.com
videokrik.net videokrik.net
videooko.weebly.com videos-for-your-business.com
vip-dom.in videtubs.pl
vigrx-original.ru
virus-respirators.com
visitcambridge.org visitcambridge.org
vita.com.hr viveresaniesnelli.it
vonradio.com vkontaktemusic.ru
vrnelectro.ru vpnmouse.com
vtcdns.com
vykupavto-krasnodar.ru vykupavto-krasnodar.ru
vzlomfb.com w3data.co
wallpapersist.com wallpapersdesk.info
wapsite.me waterefficiency.co
watracker.net
wdfdocando.com
webix.me webix.me
webmasters.stackexchange.com weblo.com
welck.octopis.com website-analyzer.info
weprik.ru website-speed-up.top
westsextube.com websiteaccountant.de
white-truck.life wechatdownload10.com
wma-x.com whereverdesperate.gq
wordpress-crew.net whiteproduct.com
wholesalejerseychinaoutlet.com
wildnatureimages.com
wiosenny-bon-1500.pl
woman-h.ru
worldoffiles.ru
writingservices17.blogspot.ru
wrz0iuebwhp5fg.freeddns.com wrz0iuebwhp5fg.freeddns.com
wtsindia.in xcc24.pl
www.arenda-yeisk.ru xep.info
www.labves.ru xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai
x-lime.com
x-stars.ru
xchat26.myfreecams.com
xgames-04.com
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn----itbkqkfiq.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai xn--24-glceagatoq7c2a6ioc.xn--p1ai
xn--80aikhbrhr.net xn--80aaagvmjabrs1aoc9luc.xn--p1ai
xn--b1addnj3cah.xn--p1ai xn--80atua3d.xn--p1ai
xn--e1aggki3c.xn--80adxhks
xn--h1ahbi.com.ua
xn--oogle-wmc.com xn--oogle-wmc.com
xpresscare.ru xportvusbdriver8i.snack.ws
xxart.ru xxxdatinglocal.us
xxxnatelefon.ru
xxxtubesafari.com xxxtubesafari.com
xzlive.com xzlive.com
yeartwit.com y8games-free.com
yebocasino.co.za yebocasino.com
yellocloud.be
yoluxuryevents.com
yoopsie.com
youresponsive.com
yugk.net yugk.net
yun56.co zajm-pod-zalog-nedvizhimosti.ru
yunque.pluto.ro zdesoboi.com
zarenica.net zed21.net
zarepta.com zeroredirect2.com
zeroredirect6.com zigzog.ru
zeroredirect9.com zixizop.net.ru
zhacker.net zoosexart.com
znakom.sibtest.ru zootravel.com
zog.link
zojirushi-products.ru
zoogdinsney.com
zoompegs.com
zryydi.com
zynax.ua

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
03p.info 00author.com
2itech.ru 1millionusd.xyz
45en.ru 45en.ru
5forex.ru 4senses.co
7yue.org 51unlim.ru
aa14ab57a3339c4064bd9ae6fad7495b5f.com adamoads.com
adktrailmap.com admatic.com.tr
adnotbad.com adprotect.net
adobereader-free.ru adserver-e7.com
adultfriendfinder.com advancedcleaner.com
adultmeetonline.info advocatemsk.ru
adultnet.in advokat-grodno.by
afslankpillen2017nl.eu albuteroli.com
akuhni.by alfapro.ru
alert-jdh.xyz all-streaming-media.com
alfa9.com allnews.md
alfabot.xyz allproblog.com
allcredits.su amoi.tn
amateurlivechat.org android-systems.ru
anal-acrobats.hol.es apple.com-webbrowsing-security.review
apartment.ru
app5.letmacworkfaster.world
arcadeplayhouse.com
asseenontvonline.ru asseenontvonline.ru
aviva-limoux.com ausmepa.org.au
avtocredit-legko.ru begalka.xyz
axbocz.net bensbargains.net
bang-hotties.com bestserials.com
bankiem.pl bestwrinklecreamnow.com
bannerbank.ru big-boards.info
bavsac.com bioscorp.ru
bazaronline24.ru blackwitchcraft.ru
beachdriveblog.com blog.koreadaily.com
bedcapdealers.com bolegapakistan.com
belinvestdom.by bonkers.name
belsetirehafi.tk
best-seo-solution.com
bestbuy.ca
bet-prognoz.com
bio.trade-jp.net
blogrankers.com
book-bets.com book-bets.com
bookhome.info brk-rti.ru
break-the-chains.com brothers-smaller.ru
brg8.com builtwith.com
bumble.cheapwebsitehoster.com buyhoverboard.com
callawaygolfstore.online buytizanidineonlinenoprescription.blogspot.com
camdenmemorials.com californianews.cf
candytiner.com carfax.com.ua
carstrends2015.com cartujano-pre.de
cartierbraceletsreplica.pw cialis-samples.com
chelyabinsk.xrus.org cicaki.net
clean-virus-mac.com ciekawinki.pl
clothesforcash.com cityadspix.com
compliance-ivan.top clickhype.com
converse.ddsoldes.fr com-onlinesupport.host
cookie-law-enforcement-hh.xyz compliance-brian.top
cornomase.win compliance-don.top
counter.bloke.com compliance-nelson.top
crirussian.ru coolwallpapers-hd.com
culmimg.pw creams.makeforum.eu
dating-app.ru decoratinghomes.ga
davebestdeals.com dekoration.us
daymusam.com descargar-musica-gratis.net
ddpills.com dichvuvesinhhanoi.com
de.zapmeta.com dickssportinggoods.com
diminishedvalueoforegon.com
dimkino.ru
distver.ru
dnepropetrovsk.mistr-x.org
doktoronline.no
donvito.unas.cz donvito.unas.cz
dood.live dosug-lux.ru
doublepimp.com dtm-spain.com
download-walpaperhd.blogspot.com earncash.com.ua
education-cz.ru ednorxmed.com
energy-ua.com elektronischezigarettekaufen1.myblog.de
eng-lyrics.com enge-fotzen.info
essay-edu.biz englishdictionaryfree.com
exchangeit.gq eshop.md
exonline.info essay-writing.work
f012.de filesclub.net
fantasticpixcool.com filesvine.com
farm26.ru fireads.men
fil.ru flirt4free.com
firesub.pl
fitnesspiks.com
flashlarevista.com
forex-indextop20.ru
forex.osobye.ru
formulaantiuban.com formulaantiuban.com
fotosfotos.eu fotopop.club
foxjuegos.com foxydeal.com
freegamesplay.online frankofficial.ru
funcrushgames.com free411games.com
gambarxkata.co freenode.info
gaming-journal.com funnymama.com
gay-file.com gallery.rennlist.com
get-free-traffic-now.com gamblingnerd.com
gfaq.ru getmiro.com
glastecfilms.com.my goldadpremium.com
greatdealshop.com gorodservis.ru
gwebtools.com hledejvshopech.cz
hackers-crackers.tk hostsshop.ru
handicapvantoday.com housediz.com
handsandlegs.ru ibb.com.ua
heartofbeijing.blogspot.com iinstalll-fii1leis.jus0wil.pp.ua
hermesbelts.xyz imgarit.pw
housemilan.ru immigrational.info
hoverboard360.at inmate-locator.us
hoverboard360.se invest-pamm.ru
howopen.ru ipchicken.com
htmlcorner.com ipornox.xxx
https-legalrc.biz iradiology.ru
iloveitaly.ru iwanttodeliver.com
imadedinner.net izismile.com
imfamous.info japan-bearings.ru
iminent.com jav-fetish.site
integritylandscapeservices.com jennyfire.ru
intermesh.net jerseywholesaleelitestore.com
intim-uslugi.info johnnyhaley.top
invitefashion.com karadene.com
iphantom.com katadhin.co
ispaniya-costa-blanca.ru katushka.net
istmira.ru kfon.eu
jbl-charge.info khadastoafarde.tk
jjbabskoe.ru kinostorm.net
jmat.cn kiprinform.com
jobmarket.com.ua komputers-best.ru
jrpmakati.com krasnodar.ru
kandidos.com kvartira-sutochno.com
kevblog.top lasvegaslockandsafe.com
keywords-monitoring-success.com lietaer.com
kinozapas.org link.ac
koleso24.com.ua lion.playtap.us
kolotiloff.ru liveshoppersmac.com
landreferat.ru lob.com.ru
law-check-nine.xyz localflirtbuddies.com
legionalpha.com manualterap.roleforum.ru
letmacwork.world marketingtechniques.info
lifeinsurancekb.com mcadamssupplyco.com
linkbolic.com mecash.ru
live-cam6.info medanestesia.ru
lmrauction.com medtherapy.ru
lonerangergames.com
lost-alpha.ru
lyrics.home-task.com
malls.com
medicines-choice.com
meget.co.za meget.co.za
meteostate.com metallosajding.ru
microsoftportal.net mhi-systems.ru
mindeyegames.com microsearch.ru
mister-shop.com mir-betting.ru
moesen-ficken.com mixx.com
moncleroutletonline.win mobplayer.net
money-for-placing-articles.com motherboard.vice.com
more-letom.ru mriyadh.com
mrbojikobi4.biz mtmtv.info
mttwtrack.com mydoctorok.ru
na15.ru mystats.xyz
namenectar.com neks.info
netcheckcdn.xyz nero-us.com
new-apps.ru newyorkhotelsmotels.info
news-speaker.com nhl09.ru
newstaffadsshop.club nlfjjunb5.ru
novgorod.xrus.org nordvpn.com
nudepatch.net nowtorrents.com
oksrv.com o-dachnik.ru
onlainbesplatno.ru of-ireland.info
orenburg-gsm.ru ooo-gotovie.ru
paceform.com openfrost.net
pendelprognos.se orsonet.ru
perfectpracticeweb.com ozoz.it
picswe.com penisvergrotendepillennl.ovh
pierrehardysale.online perso.wanadoo.es
piluli.info petedrummond.com
piter.xrus.org pharmacyincity.com
plastjulgranar.se phrcialiled.com
poem-paying.gq pinkduck.ga
pornoinn.com pistonclasico.com
pornoklad.ru piulatte.cz
proftests.net playmsn.com
purplesphere.in pochtovyi-index.ru
pxhdwsm.com polska-poezja.com
popugauka.ru
popup-hgd.xyz
poquoson.org
porngalleries.top
pornofiljmi.com
pornolook.net
poshiv-chehol.ru
positive2b.ru
predominant-invent.tk
pricheskaonline.ru
prizesbook.online
pro-poly.ru
productarium.com
produkto.net
profitwithalex.info
projefrio.com.br
proxyradar.com
ptr.ruvds.com
pulseonclick.com
queerspace.com
qwertty.net qwertty.net
ranksonic.info randki-sex.com
reklama1.ru regdefense.com
retailwith.com regionshop.biz
rimedia.org registratciya-v-moskve.ru
ru-mediaget.ru renecaovillasale.online
rvi.biz replica-watch.ru
sa-rewards.co.za risparmiocasa.bz.it
sady-urala.ru rusexy.xyz
sashagreyblog.ga sajatvelemeny.com
satellite.maps.ilovevitaly.com sax-sex.com
saugatuck.com servisural.ru
scanner-nelson.top sexs-foto.top
scanner-willy.top sexy-pings.com
schalke04fc.info sexystrippe.info
searchaddis.com sharebutton.org
seasaltwithfood.com signx.info
sexpornotales.net snip.to
sextracker.be solicita.info
sigmund-freud.co.uk
smartbalanceworld.com
sneakyboy.com
social-vestnik.ru
srdrvp.com srdrvp.com
stanthonyscatholicchurch.org standardchartered-forex.com
surfbuyermac.com staynplay.net
tagil.zrus.org steebook.com
tandvardshuset.net stoki.ru
taximytishi.ru sugarkun.com
tizanidinehcl4mgtabinfo.blogspot.com tabakur77.com
tizanidineshowupondrugtest.blogspot.com tech4master.com
tizanidinevscyclobenzaprine.blogspot.com thecoolimages.net
tootoo.to thegamerznetwork.com
topclickguru.com threecolumnblogger.com
timecrimea.ru
tizanidineduringpregnancy.blogspot.com
tizanidinehcl2mg.blogspot.com
tizanidinehcl2mgtablet.blogspot.com
tizanidinesideeffectsweightloss.blogspot.com
topkarkas.com
toproadrunner5.info toproadrunner5.info
torrents-tracker.com trackmedia101.com
tradgardspartner.se trion.od.ua
trafficgenius.xyz truebeauty.cc
trafficmp.com trustedmaccleaner.com
tt-ipd.info tytoona.com
twincitiescarservice.com uchebavchehii.ru
twodollarshows.com unimodemhalfduplefw.pen.io
twojebook.pl unlimitdocs.net
u-cheats.ru vapomnoncri.tk
uytmaster.ru virtualbb.com
veles.shop vita.com.hr
video-chat.love wdfdocando.com
videos-for-your-business.com webnode.me
videosbox.ru webs.com
vkonche.com website-analytics.online
vodaodessa.com wedding-salon.net
wallpapers-best.com wholinkstome.com
waysbetter.cn www.bookmaker-bets.com
website-speed-up.site xjlottery.com
weburok.com xn----ctbigni3aj4h.xn--p1ai
whatsappbot.flyland.ru xsfetish.org
whatzmyip.net xxxasianporn.net
word-vorlagen.net youradexchange.com
world-mmo.com zarabotok--doma.ru
writingservices17.blogspot.ru zolotoy-lis.ru
xitjw.info zone-kev717.info
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai zzlgxh.com
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
yachts-cruise.info
ynymnwbm.bloger.index.hr
yourporn.com
zebramart.ru
zophim.me
zreloeporno.tv
zytpirwai.net

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.116 0; 10.1.0.135 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2897 ### Version: V4.2022.02.2898
### Updated: Fri Feb 4 10:03:10 UTC 2022 ### Updated: Fri Feb 4 22:01:28 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2897 ### Version: V4.2022.02.2898
### Updated: Fri Feb 4 10:03:10 UTC 2022 ### Updated: Fri Feb 4 22:01:28 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##