vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-11 07:44:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.10.3424 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-10-21 22:07:18 +00:00
parent 0273a7a6b6
commit aee7ff5d06
47 changed files with 92346 additions and 92356 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3423 #### Version: V4.2022.10.3424
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.10.3423 #### Version: V4.2022.10.3424
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.10.3423 #### Version: V4.2022.10.3424
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11408
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.10.3423 #### Version: V4.2022.10.3424
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11412
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11412
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11412
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11412
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3423 3424

11412
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11412
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.230.119.199 0; 20.66.21.235 0;

11412
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

11412
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.230.119.199 0; 20.66.21.235 0;

11412
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.230.119.199 0; 20.66.21.235 0;

11412
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 1; 10.1.1.117 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BetaBot Brandwatch
CheTeam Cogentbot
DomainAppender Disco
FlashGet GrabNet
GoZilla NetLyzer
Lipperhey Nuclei
NetAnts RocketCrawler
SuperHTTP Steeler
TeleportPro Webshag
TheNomad webpros.com

300
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
404checker 01h4x.com
360Spider
404enemy
80legs
ADmantX
ALittle Client
ASPSeek ASPSeek
Abonti
Aboundex
Acunetix Acunetix
AfD-Verbotsverfahren Aipbot
AhrefsBot Alligator
AiHitBot
AlphaBot
Anarchie Anarchie
Aspiegel Anarchy
Asterias Anarchy99
Atomseobot Ankit
Attach Anthill
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch BDFetch
BackDoorBot BackDoorBot
BacklinkCrawler BackStreet
Badass
Bandit
Barkrowler Barkrowler
Battleztar Bazinga BatchFTP
Black Hole Bigfoot
BlowFish Bitacle
Blackboard
Boardreader
BotALot BotALot
Brandprotect
Brandwatch
Buck Buck
BuiltBotTough BuiltBotTough
Bullseye Bullseye
BunnySlippers
BuzzSumo
CODE87 CODE87
Cegbfeieh Calculon
CensysInspect CheeseBot
CherryPicker
ChinaClaw ChinaClaw
Claritybot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Copier Collector
CopyRightCheck DBLBot
Crescent DIIbot
Curious DigitalPebble
DSearch DnyzBot
Demon DomCopBot
Devil Domains Project
Digincore
DittoSpyder
DomainSigmaCrawler
Dotbot Dotbot
Drip Drip
ECCP/1.0 ECCP/1.0
EMail Siphon EMail Siphon
Ecxi Ebingbong
EirGrabber Express WebPictures
Extreme Picture Finder Extreme Picture Finder
FDM FDM
FHscan
FemtosearchBot FemtosearchBot
Fimap Firefox/7.0
Fuzz Flunky
G-i-g-a-b-o-t Foobot
FyberSpider
Fyrebot
GalaxyBot GalaxyBot
GetWeb
Getintent Getintent
Gigabot Go-Ahead-Got-It
Go!Zilla GoZilla
Grafula Gotit
GrapeFX HEADMasterSEO
GrapeshotCrawler HTTrack
HTTP::Lite
Haansoft
Havij Havij
Heritrix
Hloader
Humanlinks
IDBot IDBot
Iblog IRLbot
Image Fetch IlseBot
InfoTekies InfoTekies
InterGET InterGET
JOC Web Spider Internet Ninja
Jbrofuzz Iria
Joomla Jetty
Jorgee
JustView JustView
Kenjin Spider Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density LWP::Simple
Lanshanbot LeechGet
Larbin
Leap
LexiBot LexiBot
Lightspeedsystems
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Lmspider Litemage_walker
Ltx71
MIDown tool MIDown tool
MSFrontPage MIIxpc
Mag-Net MSIECrawler
Magnet MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12 Majestic12
MarkMonitor
MarkWatch MarkWatch
Mass Downloader
Masscan Masscan
Mata Hari
MauiBot MauiBot
Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX Mister PiX
Mojeek
Mojolicious Mojolicious
Morfeus Fucking Scanner Nameprotect
Mr.4x3 Net Vampire
Msrabot NetSpider
Musobot
NPbot
NetLyzer
NetMechanic
Netcraft Netcraft
Nettrack
Netvibes Netvibes
Niki-bot Niki-bot
Nikto NimbleCrawler
Ninja Ninja
Not
Octopus Octopus
Offline Explorer Offline Navigator
OnCrawl OnCrawl
OpenVAS Openfind
OrangeBot OrangeBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageGrabber Page Analyzer
Pandalytics Panscient
Pavuk Pavuk
Picscout PeoplePal
Pixray Petalbot
PictureFinder
Piepmatz
Pimonster
Pockey
ProPowerBot
ProWebWalker ProWebWalker
Psbot Probethenet
Pump
PxBroker PxBroker
RSSingBot
RankActive
RankFlex RankFlex
Rankivabot RankingBot
ReGet
RealDownload
Reaper Reaper
Recorder
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks SEOkicks
SEOstats SEOlyticsCrawler
SEOprofiler
SMTBot SMTBot
Scanbot Scrapy
ScoutJet ScreenerBot
ScrepyBot
Searchestate Searchestate
SemrushBot SemanticJuice
Seomoz
Shodan Shodan
SiteCheckerBotCrawler
SiteSucker SiteSucker
Siteimprove SlySearch
SmartDownload SmartDownload
Snake Snake
Snoopy Snoopy
Sociscraper SocialRankIOBot
Sottopop Sogou web spider
SpankBot Sosospider
SpaceBison
Spammen
Spbot Spbot
Sqlmap Sqworm
Sucker Steeler
Sucuri Stripper
SuperHTTP SuperHTTP
SurveyBot
Suzuran Suzuran
Szukacz Teleport
T0PHackTeam Telesphoreo
T8Abot
Telesphorep Telesphorep
TheNomad TheNomad
Thumbor
TightTwatBot TightTwatBot
Titan Tracemyfile
Trendictionbot Trendiction
Turingos Turingos
Turnitin
TurnitinBot TurnitinBot
URLy Warning Typhoeus
URLy.Warning URLy.Warning
UnisterBot UnisterBot
Vagabondo VCI
Virusdie Vacuum
VoidEYE VoidEYE
Voil
WBSearchBot WBSearchBot
WWW-Mechanize WWW-Collector-E
WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0 Web Auto
WallpapersHD
WeSEE
Web Collage Web Collage
Web Pix Web Pix
Web Sauger Web Sucker
WebAuto WebAuto
WebCollage WebCopier
WebFuck WebGo IS
WebImageCollector WebImageCollector
WebPix WebPix
Webalta WebReaper
Webshag WebSauger
WebStripper
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Webster Webster
Who.is Bot Who.is Bot
Widow Widow
WiseGuys Robot WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider Xaldon WebSpider
Zauba Xaldon_WebSpider
Zermelo
Zitebot
ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
archive.org_bot ZumBot
backlink-check adscanner
cognitiveseo cah.io.community
check1.exe
crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j crawler4j
dataforseo.com dataforseo.com
evc-batch
facebookscraper facebookscraper
gopher
internetVista monitor internetVista monitor
isitwp.com linkdexbot
lwp-trivial lwp-request
magpie-crawler magpie-crawler
netEstate NE Crawler mediawords
pcBrowser muhstik-scan
polaris version
ripz ripz
s1z.ru satoristudio.net
seobility scan.lol
seoscanners seocompany.store
serpstatbot
siteripz
sogouspider sogouspider
sp_auditbot spyfu
sysscan
tAkeOut tAkeOut
trendiction.com trendiction.com
trendiction.de
voyagerx.com voyagerx.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla x22Mozilla
zauba.io zgrab

314
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 404enemy
360Spider
80legs
ADmantX ADmantX
Abonti AIBOT
Aboundexbot Aboundex
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Alexibot AiHitBot
AllSubmitter AlphaBot
Anarchie Ankit
Anarchy99
Anthill
Aspiegel
Atomseobot Atomseobot
BLEXBot Attach
BackDoorBot AwarioSmartBot
BackStreet BackStreet
BackWeb
BacklinkCrawler
Badass Badass
Bandit Bandit
Barkrowler Battleztar Bazinga
BatchFTP BetaBot
Bigfoot
BlowFish
BotALot
Buck Buck
Buddy BuiltBotTough
Bullseye BunnySlippers
CATExplorador CATExplorador
CCBot CCBot
CODE87 CazoodleBot
CSHttp
CensysInspect
CheTeam CheTeam
ChinaClaw Citoid
Claritybot Cliqzbot
Cocolyzebot Cogentbot
CopyRightCheck Copier
Copyscape Copyscape
Crescent CrazyWebCrawler
Custo Curious
CyotekWebCopy
DIIbot
DSearch DSearch
DTS Agent Deusu
DataCha0s Devil
DatabaseDriverMysqli DnBCrawler-Analytics
Discobot
Discoverybot
DittoSpyder
DnyzBot DnyzBot
DomainCrawler DomCopBot
DomainSigmaCrawler
DomainStatsBot DomainStatsBot
Domains Project Dotbot
ECCP/1.0 Dragonfly
EMail Siphon EMail Siphon
EMail Wolf Ebingbong
EroCrawler Ecxi
Extractor Exabot
Fimap Extreme Picture Finder
FlashGet EyeNetIE
FemtosearchBot
Foobot
Fuzz Fuzz
G-i-g-a-b-o-t
GT::WWW GT::WWW
GalaxyBot GalaxyBot
Genieo GermCrawler
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla Go!Zilla
Gotit Gotit
Grafula GrabNet
GrapeshotCrawler
GridBot GridBot
HTMLparser
HTTP::Lite HTTP::Lite
Humanlinks HaosouSpider
Havij
Heritrix
Hloader
HybridBot HybridBot
IDBot
IRLbot IRLbot
Iblog
Id-search Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot InfoNaviRobot
InfoTekies Iria
Intelliseek JOC Web Spider
InterGET
Iskanie
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot
JetCar JetCar
Jetty JikeSpider
Kenjin Spider Joomla
JustView
Keybot Translation-Search-Machine
Kinza Kinza
LNSpiderguy Kozmosbot
LWP::Simple LibWeb
Larbin
LeechGet
Lftp
Libwhisker Libwhisker
Likse
Linkbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey
Lipperhey Spider Lipperhey Spider
Lmspider
MIDown tool
MJ12bot MJ12bot
MTRobot MQQBrowser
Mail.RU_Bot MSFrontPage
Majestic SEO MSIECrawler
Mag-Net
Majestic-SEO
Majestic12 Majestic12
Mass Downloader Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot Meanpathbot
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft URL Control Mister PiX
Mojolicious Moblie Safari
Morfeus Fucking Scanner
Mozlila
Msrabot Msrabot
Musobot Musobot
NICErsPRO
NPbot
Name Intelligence Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus Nessus
NetLyzer NetAnts
NetMechanic NetZIP
NetSpider NextGenSearchBot
Netvibes Niki-bot
Nikto
NimbleCrawler NimbleCrawler
Nimbostratus Nimbostratus
Nmap Nutch
Not Octopus
Offline Navigator Offline Navigator
OnCrawl
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer PageAnalyzer
PageGrabber
PageScorer
PageThing.com PageThing.com
Pi-Monster Pandalytics
Piepmatz PeoplePal
ProWebWalker Petalbot
Probethenet Picscout
PleaseCrawl
Pockey
Psbot Psbot
Pu_iN Pump
RankFlex PyCurl
RankingBot2 QueryN Metasearch
RankurBot RSSingBot
RankActiveLinkBot
Re-re Re-re
RealDownload
RebelMouse
Recorder Recorder
RepoMonkey
Ripper Ripper
SBIder RocketCrawler
SEOstats SEOlyticsCrawler
SISTRIX SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot SearchmetricsBot
SemrushBot Semrush
SeoSiteCheckup SeoSiteCheckup
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer SiteExplorer
SiteLockSpider SiteLockSpider
SiteSnagger SiteSucker
SmartDownload Sitevigil
Snapbot
Snoopy Snoopy
Sogou web spider Sociscraper
Sosospider
Sottopop
SpaceBison SpaceBison
Spammen Spammen
Spbot
SputnikBot SputnikBot
Sqworm Stripper
Sucuri
SuperBot SuperBot
Suzuran Surfbot
Szukacz SurveyBot
T0PHackTeam Telesoft
T8Abot
Teleport
Telesphorep Telesphorep
The Intraformant TheNomad
Thumbor
Titan
Toata Toata
Trendiction Trendiction
Trendictionbot Trendictionbot
True_Robot
Turingos Turingos
Turnitin Typhoeus
Twice Upflow
URLy Warning
URLy.Warning
UnisterBot
VB Project
Vacuum
Vagabondo Vagabondo
Virusdie VoidEYE
Voil
Voltron Voltron
WASALive-Bot WASALive-Bot
WBSearchBot
WEBDAV WEBDAV
WISENutbot WPScan
WWW-Collector-E WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWWOFFLE
WeSEE WeSEE
Web Collage
Web Enhancer
Web Fetch Web Fetch
WebEnhancer Web Pix
WebBandit
WebFuck WebFuck
WebReaper WebGo IS
WebPix
WebWhacker WebWhacker
WebZIP WebZIP
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Webshag
WebsiteExtractor Webster
Whack WinHTTrack
Whacker Woobot
Who.is Bot
WiseGuys Robot
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider YoudaoBot
Zade
Zauba Zauba
Zeus
Zitebot Zitebot
ZoomBot adscanner
ZoominfoBot
cah.io.community cah.io.community
check1.exe check1.exe
clark-crawler cognitiveseo
demandbase-bot crawler4j
dataforseo.com
eCatch eCatch
isitwp.com evc-batch
iubenda-radar gopher
meanpathbot heritrix
ips-agent
lwp-request
lwp-trivial
magpie-crawler
mediawords
polaris version
probe-image-size probe-image-size
s1z.ru s1z.ru
satoristudio.net scalaj-http
scan.lol
seobility
seoscanners
seostar
serpstatbot serpstatbot
sysscan sitechecker.pro
siteripz
sogouspider
sp_auditbot
trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com webmeup-crawler
webpros.com webpros.com
webprosbot webprosbot
x09Mozilla x09Mozilla
zauba.io xpymep1.exe
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
123any.com aghanyna.com
amung.us bloglag.com
hazardky.net faptitans.com
hybrid.ru free-today.com
obiavo.com gembird.com
psa48.ru hostingclub.lk
salutmontreal.com ragecash.com
vremya.eu roll123.com
xfluro.com rustic-quiver.win
zoominfo.com traffique.net

922
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
01apple.com 03e.info
03p.info 108shot.com
0daymusic.org 273-fz.ru
123cha.com 4kplayer.pl
12masterov.com 5i2.net
18ps.ru 6128786.com
1webmaster.ml 9med.net
256bit.by aa625d84f1587749c1ab011d6f269f7d64.com
4pp13.com aac500b7a15b2646968f6bd8c6305869d7.com
7ooo.ru abiente.ru
7zap.com ad-words.ru
a.pr-cy.ru addtoadd.men
aa8b68101d388c446389283820863176e7.com adtech.de
activepr.ru adult-shop.com.ua
addbin.men adultgalls.com
adtech.fr advancedmassagebysara.com
advokat-grodno.by affrh2015.com
aero2.ru ahmedabadwebs.com
agardomains.com akita.kz
agysya.ru akusherok.ru
albamargroup.com ald2014.org
alert-hgd.xyz alert-fjg.xyz
alevinefesleri.com
alfa-img.com alfa-img.com
all-number.com am-se.com
aludecor.info amehdaily.com
andpolice.com animaltoplist.com
androids-store.com anime.dougasouko.com
anlimebel.kiev.ua anonymousfox.co
anti-virus-removal.info anticrawler.org
apartment.ru apartmentbay.ru
apifasterlightin-a.akamaihd.net
apilinkswiftco-a.akamaihd.net apilinkswiftco-a.akamaihd.net
appearance-cool.com apishops.ru
app5.letmacworkfaster.world
apparel-offer.com
appsaurus.com
arabgirls.adultgalls.com arabgirls.adultgalls.com
arpelsreplica.xyz arcteryxstore.online
artpicso.com arenanews.com.ua
arkkivoltti.net
arraty.altervista.org
as5000.com as5000.com
aucoinhomes.com asrv-a.akamaihd.net
autobrennero.it asseenontvonline.ru
autowebmarket.com.ua atleticpharm.org
avirasecureserver.com autotrends.today
ayeartoforget.com availit.weebly.com
bad-stars.net avto-oligarh.ru
bankmib.ru azbuka-mo.ru
batanga.net bablonow.ru
bausparen.bz.it backgroundpictures.net
bedandbreakfast.com bagsonsale.online
belinvestdom.by baladur.ru
berdasovivan.ru bannerswap.com
beremenyashka.com beachfix.co
berrymall.ru best-deals-products.com
best-seo-solution.com
bestcurs.org
bestofferswalkmydogouteveryday.gq bestofferswalkmydogouteveryday.gq
betshuckclean.com beta.hotkeys.com
betwinservice.com beztuberkuleza.ru
bimatoprost-careprost.com biketank.ga
binomo.kz bimmerpost.com
bio.trade-jp.net bizcheapjerseyswholesalechina.com
biteg.xyz blackplanet.com
bizlist.com.de bluejays-jerseys.us
bjetjt.com bochemit.com.ua
blackcurranthumidifiers.site bombla.org
boeuklad.com bonanza-fortune.men
bonzbuddy.com bookmaker-bet.com
boobsimge.com bookmark4you.com.biz
bosman.pluto.ro brandov.ru
brainzpod.win brateg.xyz
brendbutik.ru brothers-smaller.ru
brillianty.info btc4u.ru
brimstonehillfortress.org buchananshardware.com
burger-imperia.com buybest1.biz
buscarfoto.com buypillsorderonline.com
buzzzg.men bvlgariring.xyz
callawaygolfstore.online camsex.xxx-cam.webcam
canvas.gloverid.site cand.jp
capture-room.com
carabela.com.do carabela.com.do
carsplate.com cartierlove2u.com
carstrends2015.com cayado.snn.gr
cashkitten-a.akamaihd.net ccjp.eu
celejihad.info cementaresearch.se
ceotrk.com cenokos.ru
cfjump.com cheapmoncler.xyz
cheapmoncler.pw chlooe.com
cialisovercounteratwalmartusa.com ci.ua
cienum.fr ciekawinki.pl
co.lumb.co circlesl.com
coindirect.io classicakuhni.ru
communisave.co.za clickso.com
com-secure.download
companies-catalog.com companies-catalog.com
compliance-donald.xyz compliance-checker.info
compliance-jessica.top compliance-ivan.xyz
compliance-john.top compliance-walter.top
compliance-margo.top compucelunlock.net
concordexoticrentals.com cookie-law-enforcement-aa.xyz
copro.pw cookie-law-enforcement-ff.xyz
copypaste.traderzplanet.in copblock.org
cowblog.fr counciltally.com
crackguru.tk cowlmash.com
dafatiri.com cpabegins.ru
dailystrength.org credit-online.ws
date-withme.com crest3d.ru
day-news.info cubook.supernew.org
dealwifi.com czeshop.info
design-ideas.info d-black.bz
daneshetabiat.com
degerlund.net
dekoration.us
delayreferat.ru
dev-seo.blog
digest-project.ru
diminishedvalueoforegon.com diminishedvalueoforegon.com
dirtpics.pw
distver.ru distver.ru
dktr.ru div.as
dnepr-avtospar.com.ua
docstoc.com docstoc.com
domaincdn.xyz doeco.ru
domcran.net dojki-hd.com
download-wallpaper.net domainanalyzing.xyz
drugs-no-rx.info dorratex.tn
duplicashapp.com downvids.net
dynainbox.com dumpsmania24.com
elektrozigaretten1.tumblr.com e-poker-2005.com
elitesportsadvisor.com ecommerce-seo.com
elmacho.xyz ekosmetyki.net.pl
elvel.com.ua ekspertmed.com
elektrischezigarettekaufen2.cowblog.fr
elektrozigarette2.webs.com
elitepcgames.com
embedle.com embedle.com
emergencyneeds.org empathica.com
empis.magix.net energy-ua.com
encodable.com enge-fotzen.info
englishdictionaryfree.com erectile.bid
englishgamer.com erot.co
eorogo.top erotik-kostenlos.net
eralph.tk erotik0049.com
eu-cookie-law.blogspot.com esfchat.tk
euromasterclass.ru eurosamodelki.ru
evehemming.blogspot.com.au everypony.ru
ewebarticle.info evrotekhservis.ru
extractorandburner.com excitacao.com
ezigarettenshop1.yolasite.com extlinks.com
facebook-mobile.xyz ez8motelseaworldsandiego.com
facecup.top ezigarettenkaufen1.deviantart.com
favornews.com ezigarettenkaufen1.pagina.gr
ezrvrentals.com
falcon-images.blogspot.com
fdzone.org
ferretsoft.com
fickblock18.com fickblock18.com
fickkontaktehobbyhuren.com filmi-v.online
filesclub.net financehint.eu
filesmonster.porn financeloan.us
find1friend.com flagcounter.me
findpik.com
findsexguide.com
flash4fun.com
flashahead.info flashahead.info
flauntyoursite.com
flipper.top flipper.top
floridahuntingfishingadventures.com flytourisme.org
foodgid.net forex-procto.ru
forexgb.ru foto-telok.net
formseo.com fotosfotos.eu
formulaantiuban.com foxydeal.com
forum.tvmir.org gameplexcity.com
forum69.info gay-file.com
freakycheats.com gembird.com
free-laptop-reward.com genericlowlatencyasiodriverhq.aircus.com
free-share-buttons.com getmiro.com
freecamdollars.com gheus.altervista.org
freelotto.com
freewlan.info
freshdz.com
gael-s.ru
galaxyflowers.ru
galaxys6manual.info
gamebackyard.com
gaygalls.net
gaypornmovie.net
gayxperience.com
gazobeton-p.com.ua
geoads.com
getdot.ru
gidonline.one
girls-ufa.ru
gktt.ru
global-ics.co.za
go2mike.ru
gojiberriess.apishops.ru
gok-kasten.net
goldadpremium.com goldadpremium.com
goodnightjournal.com golden-catalog.pro
gosreg.amchs.ru goodwinmetals.co
gotcher.us googlefeud.com
gratis-sexkontakte.com graphid.com
gta-club.ru greamimgo.pw
gta-top.ru hackers-crackers.tk
guitar-master.org harmonyglen.us
gungamesz.com hccoder.info
hawaiisurf.com healmytrauma.info
hayate.biz hentai-manga.porn
healing-dysplasia.ru hjaoopoa.top
hermesreplica.pw holidaypics.org
historichometeam.com host-tracker.com
hit-kino.ru hotchatdate.com
homemature.net hotgirlhdwallpaper.com
howmuchdoestizanidinecost.blogspot.com
hreade.com
huimin764128.com
hulfingtonpost.com hulfingtonpost.com
hustoon.over-blog.com i-hobot.ru
i-midias.net.br ibb.com.ua
i-service.kz ihc2015.info
ifirestarter.ru ikritikimou.gr
igadgetsworld.com iloveitaly.ru
igithab.com
ilovevitaly.ru
imadedinner.net imadedinner.net
imagerydatabase.com in-tandem.co
imagui.eu indiakino.net
impresagaia.it infoupdate.org
increasewwwtraffic.info intellekt21.ru
intermesh.net investingclub.ru
internetartfair.com iptool.xyz
iqoption.com
iscblog.info iscblog.info
istizanidineanopiate.blogspot.com isistaylorporn.info
itronics.ca ispac.org
ivanovo.zrus.org iwantmyfreecash.com
jennyfire.ru jennyfire.ru
jobgirl24.ru jeremyeaton.co
joessmogtestonly.com johannesburgsingles.co.za
katadhin.co jwcialislrt.com
keki.info kabbalah-red-bracelets.com
keywordhut.com kaidalibor.de
kladrus.ru kaliningrad.zrus.org
konturkrasoty.ru kamagragelusa.net
kumuk.info kandidos.com
labplus.ru karpun-iris.ru
landscapebackgrounds.blogspot.com kasino-money.pw
keywords-monitoring-your-success.com
keywordsking.com
keywordsuggest.org
kino-filmi.com
kinofak.net
kirov.zrus.org
kollekcioner.ru
komp-pomosch.ru
komputers-best.ru
kongoultry.net
kosova.de
krasnodar-avtolombards.ru
kurwa.win
la-fa.ru
landmania.ru
landscaping.center landscaping.center
lasvegaslockandsafe.com law-check-eight.xyz
laxob.com law-check-seven.xyz
light.ifmo.ru leadn.pl
lightinghomes.net legalrc.biz
linkredirect.biz libertybilisim.com
lionking-1994.blogspot.com lidoradio.com
lisque.batcave.net likesdesign.com
listiseltemournlan.gq linkrr.com
liveinternet.ru littlesexdolls.com
livejasmin.com livefixer.com
liveu.infoteka.hu livetsomudvekslingstudent.bloggersdelight.dk
loadopia.com lostfilm-online.ru
locationdesaison.com machicon-akihabara.info
lonely-mature.com macnewtech.com
long-beach-air-conditioning.com macotool.com
longlifelomilomi.info mansiondelrio.co
lotto6888.com map028.com
louisvuittonoutletstore.net marcoislandvacations.net
lsp-awak-perikanan.com masthopehomes.com
lyngdalhudterapi.no matpre.top
lyrics.home-task.com matsdale.com
magicplayer-s.acestream.net
mapquestz.us
marmitaco.cat
matematikus.info
matrixalchemy.com
meddesk.ru
mediafresh.online
medtherapy.ru medtherapy.ru
meduza-consult.ru metallosajding.ru
michaelkorssaleoutletonline.net metascephe.com
mielec.pl michaelkorsoutletstore.net
millionare.com migente.com
minet.club miniads.ca
minharevisao.com missis.top
mini-modus.ru misswell.net
mixed-wrestling.ru misterjtbarbers.com
moje-recenze.cz mnogolok.info
movpod.in moesonce.com
moz.com mojowhois.com
mp3s.club monclercoats.xyz
msk-diplomat.com monclervests.xyz
msk.afora.ru monetizer.com-01.site
musflashtv.com money-every-day.com
musirc.com mouselink.co
mwtpludn.review mug-na-chas-moscow.ru
my-big-family.com musicspire.online
my-floor.in.ua mustwineblog.com
myghillie.info myonigroup.com
myiptest.com nalogovyy-kodeks.ru
naj-filmy24.pl nalogovyykodeks.ru
najaden.no naturalbreakthroughsresearch.com
namecrumilchlet.tk netanalytics.xyz
narkologiya-penza.ru nikitsyringedrivelg.pen.io
nastroyke.net nisuturnetdgu.tk
neks.info
nelc.edu.eg
new7ob.com
newstudio.tv
nextconseil.com
nfljerseyscheapbiz.us
nhl17coins.exblog.jp
nhl17coinsforps3.gratisblog.biz
nina.az
njkmznnb.ru njkmznnb.ru
nonameread45.live njpalletremoval.com
nosecret.com.ua nodding-passion.tk
notaria-desalas.com nordvpn.com
novodigs.com nudepatch.net
nucia.biz.ly nullrefer.com
o-dachnik.ru obnal.org
omoikiri-japan.ru oecnhs.info
onclickpredictiv.com ok-ua.info
onlinadverts.com okonich.com.ua
online-hit.info onlineporno.site
optom-deshevo.ru onload.pw
ordernorxx.com onlywoman.org
orgasmus-virtual.com openstat.com
ourville.info pateaswing.com
outshop.ru paydayonlinecom.com
pc-test.net perfection-pleasure.ru
pdamods.ru perfectplanned.com
pdn-4.com
pdns.cz
pensplan4u.com
perm-profnastil.ru perm-profnastil.ru
perosan.com perso.wanadoo.es
pewit.pw phuketscreen.com
picsearch.com
pictures-and-images.net
picturesify.com
pinkduck.ga pinkduck.ga
pinup-casino1.ru pipki.r.acdnpro.com
pirateday.ru piratecams.com
pix-hd.com placid-rounded-coast.glitch.me
platezhka.net plugingeorgia.com
ploenjitmedia.azurewebsites.net podshipniki-ntn.ru
plusnetwork.com polcin.de
pomoc-drogowa.cba.pl polytopesexempt.com
popup-fdm.xyz
popup-jdh.xyz popup-jdh.xyz
pornowarp.info popup.matchmaker.com
pr0fit-b0x.com pornoplen.com
pretty-mart.com pornotubs.com
preventheadacheguide.info positive2b.ru
privat-girl.net powc.r.ca.d.sendibm2.com
preg.marketingvici.com
privhosting.com
prizeestates.cricket
prizefestival.mobi prizefestival.mobi
prom23.ru pro-tec.kz
produkto.net
proekt-mos.ru
professionaldieselcare.com
prokotov.com
promoforum.ru
prostitutki-astana.org
proxyelite.biz proxyelite.biz
ptr.ruvds.com pufip.com
qor360.com pulseonclick.com
quit-smoking.ga push-ad.com
razamicroelectronics.com qitt.ru
rcb101.ru radiogambling.com
reckonstat.info realizmobi.com
restaurantlescampi.com realresultslist.com
rfserial.net recinziireale.com
rockprogblog.com refererx.com
rollercoin.com registrysweeper.com
rome2rio.com remont-fridge-tv.ru
rootandroid.org research.ifmo.ru
rustic-quiver.win respublica-otel.ru
rusvideos.su resultshub-a.akamaihd.net
rvtv.ru rialp.getenjoyment.net
rybalka-opt.ru richinvestmonitor.com
sack.net ringtonepartner.com
sape.top robertefuller.com
sarm.tk royalcar-ufa.ru
sbetodiodnye-lampy.ru roznica.com.ua
scalerite.co.za ruspdd.com
scanner-julia.top rvi.biz
score-ads.men sadaholding.com
sdelai-prosto.ru sakhboard.ru
seadragonherbery.com salutmontreal.com
searchimage.co sammlungfotos.online
seccioncontrabajo.com santechnik.jimdo.com
seofirmreviewsus.info sarafangel.ru
serpstat.com sarahmilne.top
service.adtech.fr sbf441.com
sex-foto.pw scanner-ivan.top
sexreliz.com scanner-jess.top
sexy-screen-savers.com scanner-josh.top
scanner-walter.top
scmor.ilxc.cc
scottbywater.com
searchinquire.com
searchinterneat-a.akamaihd.net
seemoreresultshu-a.akamaihd.net
seksvideoonlain.com
semaltmedia.com
sexflirtbook.com
sexiporno.net
sexpartygirls.net
sexpornotales.net
sexs-foto.top
sextracker.com
sexytrend.ru sexytrend.ru
sharebutton.net shemalegalls.blogporn.in
sharebutton.to sherlock.se
shoplvlv.us
shymkent.xkaz.org
sibtest.ru
sigmund-freud.co.uk
signal03.ru signal03.ru
sildenafilcitratemed.com sildenafilcitratemed.com
silverage.ru sim-service.net
silvercash.com simpoed.ufop.br
silvermature.net siteaero.com
sisi-go.ru sixcooler.de
siteexpress.co.il slavkokacunko.de
slim.sellany.ru
sloopyjoes.com
slowmacfaster.trade slowmacfaster.trade
smart-balancewheel.com smart-balancewheel.com
social-s-hhh.xyz snow.nvr163.com
sonnikforme.ru social-buttons.xyz
spabali.org socialbuttons.xyz
sport7777.net softtor.com
squidoo.com spinazdrav.ru
sstroy44.ru spl63.fr
staff.prairiesouth.ca stardevine.com
stal-rulon.ru
star61.de
startufa.ru startufa.ru
startwp.org startwp.org
stathat.com stillmiracle.com
staticfs.host stoki.ru
steelmaster.lv stpolice.com
strag-invest.ru studentguide.ru
strongholdsb.ru success-seo.com
subj.ukr-lit.com suhanpacktech.com
sucsesofinspiration.com sukarame.net
summerlinhomes411.info sumo.com
superlist.biz surcentro.com
surflinksmedical.com sweepstakes.rewardit.com
svbur.ru swinger-mobil.net
svnuppsalaorebro.se symphonyintegratedhealthcare.com
symbaloo.com syndicate.fun
tabletkinaodchudzanie.com.pl tasteidea.com
tarad.com td-l-market.ru
testbotprocessor44.com tech4master.com
tfxiq.com tecnoteakviareggio.it
thegamerznetwork.com teenfuck.tv
teenporn18.net
thebestphotos.eu
thegolfclub.info thegolfclub.info
thepantonpractice.co.uk thelottosecrets.com
titan-cloud.life theplacetoupdating.pw
tizanidineforopiatewithdrawal.blogspot.com thiegs.reco.ws
tizanidinehcl2mg.blogspot.com tiens2010.ru
tizanidinestreetprice.blogspot.com tizanidine4mgtablets.blogspot.com
tn811.us tizanidinedosageforsleep.blogspot.com
tongkatmadura.info tizanidineduringpregnancy.blogspot.com
top10registrycleaners.com tizanidineingredients.blogspot.com
toproadrunner5.info tnctrx.com
torrentgamer.net toolsky.com
traffic-club.info top-l2.com
traffic2cash.org topcar-krasnodar.ru
trustl.life topflownews.com
tsan.net torontoplumbinggroup.com
tsyndicate.com torrnada.ru
turbo-suslik.org touchmods.fr
typimga.pw tourismvictoria.com
ublaze.ru track-rankings.online
uggbootsoutletsale.us track2.shop
ukkelberg.no tracxn.com
unrealcommander.org traderzplanet.in
uprour.com tuckpointingmasonrysystems.com
uptime-alpha.net tupper-posuda.ru
u555u.info
uac.net.au
uchil.net
uggsale.online
ugogo.info
ukr-lit.com
ukrtextbook.com
umekana.ru
unece.org
unimodemhalfduplefw.pen.io
userequip.com userequip.com
vashsvet.com varbergsvind.se
vasileostrovsky-rayon.ru vegascosmetics.ru
vekzdorov.ru via-energy-order.com
versaut.xxx-cam.webcam videospornogratisx.net
videochat.cafe vip-dom.in
videojam.tv vksex.ru
videokrik.net vodaodessa.com
videonsk.com vostoktrade.info
vipps.com.my vse-pesni.com
vizitki.net vvpg.ru
vkontarkte.com wapsite.me
vksaver-all.ru webcamdevochka.com
vladhistory.com website-audit.com.ua
vseuznaem.com weekes.biz.tc
vzglyadriv.kg wfb.hatedriveapart.com
waycash.net whatsupinfoley.com
webads.co.nz whipme.yopoint.in
webscouter.net
website-datenbank.de
wedding0venues.tk
wellcome2slovenia.ru
westvilletowingservices.co.za
white-truck.life white-truck.life
wholinkstome.com win-spy.com
wildnatureimages.com wma-x.com
word-vorlagen.net worldtraveler.world
workle.website www.ehscloud.cn
works.if.ua xn-----6kcaabbafhu7cskl7akvongwpo7hvjj.xn--p1ai
worldoffiles.ru xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
woweb.com.ua xn----7sbbagbq7bd5aheftfllo4m.xn--p1ai
wrona.it xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
ww1943.ru xn--80aeahghtf8ac5i.xn--p1ai
www.wohnkabinen-shop.de xn--b1addnj3cah.xn--p1ai
wygraj-skiny.win xn--c1acygb.xn--p1ai
x-true.info
xep.info
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xn--90acenikpebbdd4f6d.xn--p1ai
xn--lifehacer-1rb.com
xnxx699.com xnxx699.com
xrus.org xsfetish.org
xtrafficplus.com xxx-treker.ru
xvideosporn.biz yoluxuryevents.com
xxxdatinglocal.us yourads.website
yaaknaa.info youresponsive.com
yopoint.in ytmnd.com
yougame.biz yubikk.info
yourporn.com zahvat.ru
youtubologia.it
zaidia.xhost.ro zaidia.xhost.ro
zajm-pod-zalog-nedvizhimosti.ru zambini.ru
zaloro.com zeroredirect9.com
zero1.it zetgie.com.pl
zixizop.net.ru zhongwenlink.com
znakomstvaonlain.ru zootravel.com
znaniyapolza.ru zvezdagedon.ru
zoogdisany.com
zoolubimets.ru
zscalertwo.net
zytpirwai.net

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
000free.us 03e.info
2000k.ru 08800.top
55wmz.ru 1millionusd.xyz
5ws.dating-app.ru
66cpwgln.space 66cpwgln.space
8lufu.com 7fon.ru
abbanreddy.com aad1f4acb0a373420d9b0c4202d38d94fa.com
acads.net adman.se
adanih.com adultgalls.com
adrunnr.com alive-ua.com
allboard.xobor.de alloysteel.ru
am15.net alvtank.se
amt-k.ru
androids-store.com androids-store.com
aosexkontakte.net arcadepages.com
apimegabrowsebiz-a.akamaihd.net arkartex.ru
apimossnetinfo-a.akamaihd.net autobrennero.it
asrv-a.akamoihd.net benchmarkcommunications.co.uk
atdedinotuho.tk biglistofwebsites.com
ayerbo.xhost.ro bizlist.com.de
azartmsl.com blavia.00author.com
azbaseimages.net blog.remote-computer.de
azbukafree.com bloggerads.net
babosas.com boc.kz
backuperwebcam.weebly.com bookmark4you.com
bagsonsale.online brandedleadgeneration.com
balans.shahterworld.org brus-vsem.ru
bamo.xsl.pt brus.city
bannerbank.ru buyessaynow.biz
beclean-nn.ru cartujano-pre.de
bestpriceninja.com cashonads.com
betshuckclean.com cb.iphantom.com
bibys.com cheapcigarettesc.info
blackwitchcraft.ru checkpagerank.net
bongiornos.info ciekawinki.pl
bookmaker-bet.com cinemaflix.website
brokergid.ru clean-start.net
bryansk.zrus.org cmhomestayagency.com
businescoop.men coaching-netz.info
businesxxl.com compliance-alexa.xyz
buttons-for-website.com contentsexpress.com
camel-beach.com coolgamechannel.com
canrole.com crackzplanet.com
carina-sy.de customcollegeessays.net
carloans.com dalavia.ru
cartierjusteunclou.xyz darkages.info
cerev.info descargar-musica-gratis.net
cheapjerseysbizwholesale.us djonwatch.ru
christianlouboutinreplica.win
club-lukojl.ru
compliance-john.top
conboy.us
connectingsingles.com
coslab.club
counciltally.com
cowlmash.com
craftburg.ru
crd.clan.su
customchocolate.business-for-home.com
cv.wallhade.co
d2jsp.org
data-mining.tk
day-news.info
den-noch24.ru
dev.citetick.com
digital-sale.su
digital-video-processing.com
dimkino.ru
discountliv.com
divci-hry.info
documentbase.net documentbase.net
domaincheck.io domain-submit.info
doxysexy.com dood.live
drunkmoms.net dotmass.top
dyt.net dverimegapolis.ru
e-poker-2005.com dwomlink.info
elektronischezi.livejournal.com dynainbox.com
elektronischezigarettekaufen2.tumblr.com education-cz.ru
enbersoft.com elektrozigaretten2.yn.lt
ero-advertising.com elite-sex-finders.com
erotische-geschichten-xxl.com eloxal.ru
faithe.top en.altezza.travel
figuringmoneyout.com eropho.com
filerockstar298.weebly.com eupornstar.info
firma-legion.ru exonline.info
firstdrugmall.ru expertblog.info
fototravel.eu extremal-blog.com
free-share-buttons.com extremez.net
free-share-buttons.top falllow.gq
fullgirl.ru feeriaclub.ru
gambarkataku.co fermersovet.ru
games.kolossale.ru fickblock18.com
gayxperience.com fillmewithhappiness.com
genetworx.com filmfanatic.com
gettpromos.com floating-share-buttons.com
forex21.ru
freshmac.space
ftns.ru
gabeshop.ru
gardene.ru
glass-msk.ru glass-msk.ru
go2album.com graphics8.info
goldadpremium.com graphicwe.org
goosefishpost.bid greatidea.marketing
groupmoney.ru gsasearchengineranker.pw
handsandlegs.ru hanink.biz.ly
hanwei.us haveinc.xyz
hausfrauensex18.com hdseriale.pl
hoholikik.club health-medical-portal.info
hotblog.top hebr.myddns-flir.com
howmuchdoestizanidinecost.blogspot.com hentaiheroes.com
ibmdatamanagement.co home.myplaycity.com
icaseclub.ru hotsocialz.com
insomniagamingfestival.com huimin764128.com
integritylandscapeservices.com hunthillfarmtrust.org
ispac.org iccornacircri.cf
ivearchenceinflu.cf ikritikimou.gr
iyasimasennka.com juliaworld.net
jerseywholesalechinabiz.com jumptap.com
kareliatobacco.ru jurajskie.info
katadhin.co kicknights.gq
kazinogames.lv kimcurlrvsms.com
kemerovo.zrus.org kinocccp.net
keywordhouse.com knogg.net
kino-ecran.ru knowsitall.info
kinogolos.ru krasnodar.xrus.org
kladrus.ru labvis.host.sk
kovrenok.ru lanasshop.ru
krasnodar.ru lankarns.com
krasnodar.zrus.org laptop-4-less.com
landscaping.center larger.io
laparfumotec.com lecbter-relationships.ga
laserpen.club lenvred.org
life.biz.ua levaquin750mg.blogspot.com
lignofix.ua life-instyle.com
limtu.ifmo.ru lifeinsurancekb.com
listiseltemournlan.gq lion.conboy.us
loadopia.com lion.misba.us
lob.com.ru livesex-amateure.info
m-google.xyz locimge.pw
m4ever.net lonfon.xyz
macfix.life lostaruban.com
matsdale.com luciddiagnostics.in
mcar.in.ua macdamaged.tech
migente.com machicon-ueno.info
miniads.ca mackeeper-center.club
mir-limuzinov.ru magnetic-bracelets.ru
mistr-x.org makemoneyonline.com
mmoguider.ru markjaybeefractal.com
mncrftpcs.com masserect.com
morf.snn.gr mebelcomplekt.ru
muz-shoes.ru medispainstitute.com.au
myhydros.org militarysale.pro
mysexpics.ru mindeyegames.com
newsperuse.com monarchfind-a.akamaihd.net
njpalletremoval.com monclerboots.xyz
nmrk.ru mp3ritm.top
nordvpn.com mug-na-chas-moscow.ru
novatech.vn muycerdas.xxx
offer.wpsecurity.website narutonaruto.ru
office2web.com needtosellmyhousefast.com
ohmyrings.com newyorkhotelsmotels.info
oksrv.com nina.az
online-sbank.ru notasprensa.info
paydayloanslocal.com obiavo.ru
pensplan.com oconto.ru
picsearch.com offf.info
pistonclasico.com ons-add.men
ploenjitmedia.azurewebsites.net origin-my.ru
plugingeorgia.com paintingplanet.ru
paperwritingservice17.blogspot.ru
partnerline.men
pastaleads.com
pix24x7.com
pizza-tycoon.com
playmsn.com
porno-raskazy.ru porno-raskazy.ru
porno-transsexuals.ru pornowarp.info
pornosee.info portal-eu.ru
pornosemki.info predmety.in.ua
pornoslive.net prizefestival.mobi
postclass.com pron.pro
powitania.pl prostitutki-kiev.org
prodess.ru putitin.me
puserving.com qld10000.net
qpypcx.com
rankingchart.de rankingchart.de
recipedays.ru rednise.com
remont-komputerov-notebook.ru registratciya-v-moskve.ru
royalcar-ufa.ru reklamuss.ru
sady-urala.ru renecaovillasale.online
saecsa.co retreatia.com
saneitconsulting.com rfserial.net
scanmarine.info riders.ro
riralmolamsaca.tk
rixpix.ru
ru-mediaget.ru
sanidumps.com
sarafangel.ru
sbetodiodnye-lampy.ru
scanner-don.top
scanner-george.top
scanner-ivan.top
scanner-jess.top scanner-jess.top
scanspyware.net scansafe.net
seadragonherbery.com scenicmissouri.us
seocheckupx.com sdi-pme.com
seoholding.com se.bnt-team.com
seoprofiler.com searchmywindow-a.akamaihd.net
seorankinglinks.us serdcenebolit.com
serialsway.ucoz.ru sex-dating.co
sexs-foto.top sexs-foto.top
shopfishing.com.ua sexyteens.hol.es
shoppingjequiti.com.br shtaketniki.ru
silvercash.com sildenafilcitratemed.com
sindragosa.comxa.com similardeals.net
siteaero.com simon3.ru
slkrm.ru snjack.info
slowmacfaster.trade snworks.com
space4updating.win socialsignals24.com
sptslmtrafms.com sogimlecal.tk
spywarespy.com sosdepotdebilan.com
steamoff.net stariy-baku.com
store-rx.com stevemonsen.com
storehouse.ua stoki.ru
superkanpo.com tds-advert002.info
surflinksmedical.com teenporn18.net
swinon.site telemetryverification.net
teletype.in telsis.com
thebluffs.com themestotal.com
thepokertimer.com timetorelax.biz
tizanidinevscyclobenzaprine.blogspot.com titangel-vietnam.com
tizanidinewithdrawal.blogspot.com tizanidinecapsules.blogspot.com
tracfone.com tizanidinesideeffects.blogspot.com
tradedeals.biz tizanidinevssoma.blogspot.com
trafficcentr.xyz top-study.work
truck-addzilla.life torrentgamer.net
tube8.com trustedhealthtips.com
typer.one tvorozhnaja-zapekanka-recept.ru
umnovocaminho.com twittruth.com
upupa.net uac.net.au
vadimkravtcov.ru unimodemhalfduplefw.pen.io
validdomain.xyz uptimebot.net
uytmaster.ru
verymes.xyz verymes.xyz
viddyoze.com viagraneggrx.com
videochat.bz vipsiterip.org
videochaty.ru
vinsit.ru
visitcambridge.org
vkgaleria.com vkgaleria.com
vkontaktemusic.ru voronezh.xrus.org
vladimir.zrus.org vsdshnik.com
vozbujdenie.com vseigru.one
waterpurifier.club vtcdns.com
wejdz-tu.pl wallpapersist.com
wemarketing.se webadvance.club
winwotgold.pl websites-reviews.com
wttavern.com wiosenny-bon-1500.pl
wovis.site
woweb.com.ua
ww1943.ru ww1943.ru
wygraj-skiny.win wygraj-skiny.win
x-musics.com xkaz.org
xedserver.com xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xingzi-vision.com xn--80ajbshivpvn2i.xn--p1ai
xn--24-glceagatoq7c2a6ioc.xn--p1ai yaoguangdj.com
xn--d1abj0abs9d.in.ua yoluxuryevents.com
xtube.com youradulthosting.com
xxx-treker.ru yourporn.com
yougetsignal.com yurgorod.ru
zaim-pod-zalog-krasnodar.ru zacreditom.ru
zaloadi.ru zeroredirect12.com
zeroredirect5.com zirondelli.it
zoominfo.com
zophim.me
zzlgxh.com

10
dev-tools/test_units/ratelimittest-beta.txt
View file

@ -581,14 +581,4 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.203 0; 10.1.1.117 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3423 ### Version: V4.2022.10.3424
### Updated: Fri Oct 21 10:04:54 UTC 2022 ### Updated: Fri Oct 21 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.10.3423 ### Version: V4.2022.10.3424
### Updated: Fri Oct 21 10:04:54 UTC 2022 ### Updated: Fri Oct 21 22:01:22 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##