vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.08.3275 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-08-07 10:09:23 +00:00
parent aa2e26cc18
commit 73ad835e0e
47 changed files with 86654 additions and 86644 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3274 #### Version: V4.2022.08.3275
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.08.3274 #### Version: V4.2022.08.3275
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.08.3274 #### Version: V4.2022.08.3275
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10694
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.08.3274 #### Version: V4.2022.08.3275
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10698
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10698
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10698
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10698
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3274 3275

10698
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10698
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.66.253 0; 20.12.195.139 0;

10698
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

10698
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.66.253 0; 20.12.195.139 0;

10698
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.228.66.253 0; 20.12.195.139 0;

10698
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 1; 10.1.0.125 1;
127.0.0.1 1; 127.0.0.1 1;

18
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anarchy99 CODE87
Buddy DBLBot
HaosouSpider Dotbot
NICErsPRO Evil
Fyrebot
Lftp
Nameprotect
Nuclei Nuclei
Page Analyzer PHPCrawl
SpaceBison sitechecker.pro
Titan
VCI
Zeus

312
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 360Spider
404checker
404enemy
80legs 80legs
ADmantX ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti Abonti
Aboundex Aboundex
AhrefsBot Acunetix
AfD-Verbotsverfahren
AiHitBot AiHitBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Aspiegel Aspiegel
Asterias Attach
AwarioSmartBot AwarioSmartBot
BDFetch
BackStreet BackStreet
Backlink-Ceck Backlink-Ceck
Barkrowler BacklinkCrawler
Badass
Battleztar Bazinga Battleztar Bazinga
BetaBot BetaBot
Bigfoot Bitacle
Black Hole Black Hole
BlackWidow
Blackboard Blackboard
BotALot BlowFish
BuiltBotTough Boardreader
BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CCBot CODE87
CSHttp Calculon
CherryPicker CensysInspect
Citoid CheTeam
Cocolyzebot CheeseBot
Collector ChinaClaw
Chlooe
Claritybot
Cloud mapping
Craftbot Craftbot
CrazyWebCrawler DTS Agent
Crescent DataCha0s
CyotekWebCopy Deusu
DSearch Digincore
Demon Dirbuster
Discobot
Dispatch Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
Download Wonder Dotbot
Dragonfly
ECCP/1.0 ECCP/1.0
Ebingbong EMail Siphon
EirGrabber EMail Wolf
Exabot EroCrawler
Express WebPictures ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder Extreme Picture Finder
Ezooms EyeNetIE
FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
FlashGet
Foobot Foobot
FyberSpider Freeuploader
FrontPage
Fyrebot
GT::WWW
GalaxyBot GalaxyBot
Genieo GetRight
Gigabot GetWeb
Go-Ahead-Got-It
GoZilla
GrabNet GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot GridBot
HEADMasterSEO HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft Haansoft
HaosouSpider Havij
Harvest Hloader
HonoluluBot
HybridBot HybridBot
IDBTE4M
IDBot
IRLbot
Iblog Iblog
Image Fetch Id-search
Image Sucker Image Sucker
InfoNaviRobot
InfoTekies InfoTekies
Intelliseek
Internet Ninja Internet Ninja
Iskanie IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
Jetty
Joomla Joomla
Jorgee Jyxobot
JustView
Keyword Density Keyword Density
Kozmosbot Kinza
LNSpiderguy Lftp
LWP::Simple
LeechFTP
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems Lightspeedsystems
Likse LinkScan
LinkextractorPro Linkbot
LinqiaMetadataDownloaderBot Lipperhey
Lipperhey Spider
Litemage_walker Litemage_walker
Lmspider
Ltx71 Ltx71
MJ12bot MIDown tool
Mail.RU_Bot Mag-Net
Majestic SEO Majestic12
MarkWatch MarkWatch
Masscan Masscan
Mb2345Browser Mb2345Browser
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri MicroMessenger
Microsoft Data Access Microsoft Data Access
Moblie Safari Microsoft URL Control
Mojolicious Mozlila
MolokaiBot Musobot
Morfeus Fucking Scanner NPbot
Name Intelligence Name Intelligence
Nameprotect Nameprotect
Nessus NearSite
Needle
NetLyzer
NetMechanic NetMechanic
NetSpider NetSpider
Nettrack Netvibes
Nibbler NextGenSearchBot
Niki-bot Nimbostratus
Nikto Octopus
Not Offline Explorer
Openfind OnCrawl
OrangeBot Openvas
OutclicksBot POE-Component-Client-HTTP
OutfoxBot
PHPCrawl
Page Analyzer Page Analyzer
PageScorer PageThing.com
Pandalytics
Pavuk Pavuk
PeoplePal Petalbot
Pi-Monster
Picsearch
Pimonster Pimonster
Pixray Pixray
ProPowerBot PleaseCrawl
ProWebWalker ProWebWalker
Psbot
Pump Pump
PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler Quick-Crawler
RankingBot RSSingBot
RankActive
RankFlex
Rankivabot
RankurBot RankurBot
ReGet Re-re
RealDownload
Reaper
RedesScrapy RedesScrapy
Rogerbot RepoMonkey
SEOkicks-Robot SMTBot
SalesIntelligent Scanbot
Scrapy
Screaming Screaming
ScreenerBot ScreenerBot
Searchestate
SearchmetricsBot SearchmetricsBot
Seekport Semrush
SentiBot SentiBot
SeobilityBot
Seomoz Seomoz
Shodan Shodan
SiteExplorer
SiteSnagger
Site Sucker Site Sucker
SiteSnagger
Siteimprove
Sitevigil Sitevigil
Snake Snapbot
Snoopy Snoopy
Sociscraper Sociscraper
Sogou web spider Sogou web spider
Spanner SpaceBison
Spinn3r Spammen
SputnikBot Spbot
Stripper Stripper
SuperBot
SuperHTTP
Surfbot
Suzuran
T8Abot T8Abot
TeleportPro TeleportPro
Telesphoreo
Telesphorep Telesphorep
TheNomad Titan
Toweyabot Tracemyfile
Trendiction TwengaBot
Trendictionbot
True_Robot
Turnitin
TurnitinBot
Upflow Upflow
VCI Vacuum
Vagabondo
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VoidEYE
Virusdie Voltron
WBSearchBot WASALive-Bot
WEBDAV WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize WWW::Mechanize
WWWOFFLE WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
Web Fuck WebFetch
WebAuto
WebBandit
WebCopier
WebFuck
WebGo IS
WebImageCollector WebImageCollector
WebSucker WebPix
WebWhacker WebReaper
WebZIP WebStripper
Webshag
WebsiteQuester WebsiteQuester
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker Whacker
Whatweb
Widow Widow
Wotbox WinHTTrack
Wprecon
Xaldon_WebSpider
Xenu
Zade Zade
Zauba
Zermelo
Zeus Zeus
Zitebot
ZmEu
ZoomBot ZoomBot
ZoominfoBot ZyBorg
archive.org_bot
autoemailspider autoemailspider
cah.io.community cah.io.community
check1.exe check1.exe
cognitiveseo coccocbot
crawler4j crawl.sogou.com
crawler.feedback
dataforseo.com dataforseo.com
heritrix eCatch
ips-agent facebookscraper
magpie-crawler instabid
mediawords isitwp.com
muhstik-scan iubenda-radar
page scorer lwp-trivial
pcBrowser meanpathbot
probe-image-size netEstate NE Crawler
scalaj-http oBot
plumanalytics
polaris version
scan.lol scan.lol
seobility seobility
seoscanners seoscanners
seostar sexsearcher
trendiction.com sitechecker.pro
trendiction.de siteripz
webmeup-crawler sogouspider
webpros.com voyagerx.com
x09Mozilla
zauba.io

292
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider
AIBOT
ALittle Client ALittle Client
ASPSeek ASPSeek
Abonti
Acunetix Acunetix
AfD-Verbotsverfahren
AhrefsBot AhrefsBot
Alexibot Aipbot
Apexoo AllSubmitter
Asterias Asterias
AwarioRssBot AwarioRssBot
BBBike BBBike
BDCbot BDCbot
BLEXBot BackDoorBot
BackStreet BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot Bigfoot
Bitacle Bitacle
Black Hole BlackWidow
Brandwatch Blow
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador CATExplorador
CensysInspect CCBot
CheTeam CheTeam
CherryPicker CherryPicker
ChinaClaw ChinaClaw
Citoid
Claritybot Claritybot
Cloud mapping
Cocolyzebot Cocolyzebot
Collector
CopyRightCheck CopyRightCheck
Crawling at Home Project Craftbot
CrazyWebCrawler
Crescent Crescent
Curious CrunchBot
Custo Custo
CyotekWebCopy CyotekWebCopy
DIIbot DIIbot
DTS Agent
DatabaseDriverMysqli DatabaseDriverMysqli
Deusu Dispatch
Devil
DigitalPebble
Dirbuster
Disco
DomainAppender DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project Domains Project
EMail Wolf Dragonfly
Ecxi Drip
EirGrabber EasyDL
Exabot Exabot
ExtLinksBot Extreme Picture Finder
EyeNetIE Freeuploader
FemtosearchBot FyberSpider
Fimap G-i-g-a-b-o-t
Firefox/7.0
Foobot
GT::WWW
GalaxyBot
GermCrawler GermCrawler
GetRight GetRight
Getintent GoZilla
Gigabot GrabNet
Go!Zilla
GrapeFX GrapeFX
HEADMasterSEO
HMView HMView
HTTP::Lite HTTP::Lite
HTTrack HTTrack
Haansoft Haansoft
Havij
Hloader Hloader
HonoluluBot Humanlinks
HybridBot
IDBot IDBot
IndeedBot IRLbot
Id-search
Image Sucker
Indy Library Indy Library
InfoTekies
Intelliseek Intelliseek
Iskanie
IstellaBot IstellaBot
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
LWP::Simple JennyBot
Lanshanbot Jetty
Larbin Joomla
Leap Kenjin Spider
LexiBot Kinza
LNSpiderguy
LeechFTP
Lftp
LibWeb LibWeb
LinkScan Likse
LinkWalker LinkWalker
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Lipperhey
Ltx71
MIIxpc MIIxpc
Magnet MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO Majestic-SEO
Majestic12 Majestic12
Mass Downloader MarkMonitor
MauiBot MarkWatch
Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
Mediatoolkitbot Mediatoolkitbot
MegaIndex.ru
MicroMessenger MicroMessenger
Mister PiX Microsoft Data Access
Moblie Safari Microsoft URL Control
Mojolicious
MolokaiBot
Morfeus Fucking Scanner Morfeus Fucking Scanner
Msrabot Mr.4x3
NPbot Musobot
Name Intelligence Navroad
Nameprotect NearSite
NetAnts NetLyzer
Netcraft Netvibes
NextGenSearchBot NextGenSearchBot
Nibbler Not
Nikto Nuclei
Nimbostratus Nutch
Octopus Octopus
Offline Navigator
OnCrawl
OpenVAS OpenVAS
OrangeBot Openvas
OutclicksBot
OutfoxBot OutfoxBot
PECL::HTTP POE-Component-Client-HTTP
PHPCrawl Page Analyzer
PageScorer PageAnalyzer
Panscient PageGrabber
PageThing.com
Pandalytics
Papa Foto Papa Foto
Pimonster Pavuk
PleaseCrawl Petalbot
Pockey Piepmatz
Probethenet Pixray
Psbot ProPowerBot
Pump ProWebWalker
RankActive
RankActiveLinkBot
RankFlex RankFlex
RankingBot2 RankingBot
RankurBot Rankivabot
Re-re
ReGet
RealDownload RealDownload
Reaper Reaper
RebelMouse
Ripper
RocketCrawler RocketCrawler
Rogerbot SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SEOstats SISTRIX
SMTBot
SalesIntelligent SalesIntelligent
Scrapy ScanAlert
Screaming
ScrepyBot ScrepyBot
SearchmetricsBot SearchmetricsBot
Seekport SemanticJuice
Semrush Semrush
SeoSiteCheckup SemrushBot
Seomoz
Siphon Siphon
SiteCheckerBotCrawler Site Sucker
SiteExplorer
SiteLockSpider SiteLockSpider
SiteSucker
Sitebeam Sitebeam
Sitevigil SmartDownload
Snake SocialRankIOBot
Snoopy Spammen
SpaceBison SpankBot
Spanner Spanner
Spbot Sqlmap
Sqworm Sqlworm
Sucker Steeler
Surfbot Stripper
Suzuran
T0PHackTeam T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft Telesoft
Telesphoreo The Intraformant
Telesphorep TheNomad
Titan Titan
Toata Toata
Trendictionbot Toweyabot
True_Robot Trendiction
TwengaBot
Typhoeus Typhoeus
URLy Warning
URLy.Warning URLy.Warning
V-BOT UnisterBot
VelenPublicWebCrawler VCI
VeriCiteCrawler VeriCiteCrawler
VoidEYE VidibleScraper
WASALive-Bot Virusdie
WBSearchBot Voil
Voltron
WISENutbot
WPScan WPScan
WWW-Mechanize
WWWOFFLE WWWOFFLE
Wallpapers/3.0 Wallpapers
WeSEE
Web Auto Web Auto
Web Enhancer
Web Fetch Web Fetch
Web Fuck
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix WebPix
WebSauger WebSauger
WebAuto WebStripper
WebCollage
WebCopier
WebGo IS
WebLeacher
WebReaper
WebZIP WebZIP
Webshag
WebsiteExtractor WebsiteExtractor
WebsiteQuester WebsiteQuester
Whack Whack
Whacker
Whatweb Whatweb
Who.is Bot WinHTTrack
Widow Wotbox
WiseGuys Robot Wprecon
Woobot Zermelo
Xaldon WebSpider
Xenu
Zeus
Zitebot Zitebot
ZmEu ZoominfoBot
ZyBorg ZyBorg
archive.org_bot arquivo-web-crawler
check1.exe autoemailspider
cognitiveseo backlink-check
clark-crawler
crawl.sogou.com crawl.sogou.com
crawler.feedback crawler.feedback
crawler4j
dataforseo.com dataforseo.com
eCatch demandbase-bot
evc-batch domainsproject.org
facebookscraper gopher
heritrix heritrix
internetVista monitor
ips-agent
linkdexbot linkdexbot
magpie-crawler
mediawords
muhstik-scan muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser pcBrowser
plumanalytics serpstatbot
ripz
satoristudio.net
seobility
sexsearcher
sogouspider
sp_auditbot
sysscan sysscan
tAkeOut
trendiction.com
voyagerx.com voyagerx.com
webprosbot webgains-bot
x22Mozilla
xpymep1.exe xpymep1.exe
zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
allknow.info acheterviagrafr24.com
discovertreasurenow.com auto-zapchasti.org
eu-cookie-law.info compliance-barak.top
historichometeam.com dprtb.com
kamen-e.ru etotupo.ru
leftofcentrist.com inspiring-desperate.tk
musicvidz.ru ptr.ruvds.com
play-mp3.com tds-advert005.info
vkmusics.ru ussearche.cf
xitjw.info webscouter.net

940
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
03e.info 0912701309f8ce.com
1-99seo.com 1-99seo.com
100dollars-seo.com 108shot.com
123movies.love 12bet.com
20pascals.nl 1adult.com
2nt.ru 273-fz.ru
300richmond.co.nz 3rbseyes.com
4kplayer.pl
4webmasters.com 4webmasters.com
5u.com
76brighton.co.uk 76brighton.co.uk
777-club.ru aab94f698f36684c5a852a2ef272e031bb.com
999webdesign.com adclickthru.net
a14download.com adelly.bg
aarbur.com adnotbad.com
acads.net afora.ru
adclickservice.com alekseevec.ru
addray.pro alfapro.ru
adinterax.com algarveglobal.com
adman.gr allcredits.su
adserver-e7.com allfinweb.com
adsland.men allnews24.in
adtech.fr allstatesugarbowl.org
adtology.com alphaforum.ru
affrh2015.com ameblo.top
afftrack001.com amehdaily.com
ald2014.org
alfa-medosmotr.ru
alltheviews.com
allwidewallpapers.com
alphavisions.net
aludecor.info
am15.net
amt-k.ru amt-k.ru
animal-drawings.com anabolics.shop
animali.deagostinipassion.it ap.senai.br
anonymizeme.pro apartmentratings.com
api.stathat.com api.stathat.com
apiholdingmypage-a.akamaihd.net apiadanaknet-a.akamaihd.net
apiportalmorecom-a.akamaihd.net
app5.letmacworkfaster.world app5.letmacworkfaster.world
appiq.mobi approvedlocal.co.za
appleid-verification.com apptester.tk
architecturebest.com atelielembrancaqueencanta.com.br
arendakvartir.kz atmovs.com
asseenontv.ru autogrep.ru
audiobangout.com
audiofree.ru
autoplate.info autoplate.info
autovideobroadcast.com aviapanda.ru
avramstroy.ru avtolombard-krasnodar.com
ayeartoforget.com bagcionderlab.com
azazu.ru balkanfarma.org
bala.getenjoyment.net beauby.ru
bannerbank.ru berlininsl.com
battlecarnival.su best-seo-solution.com
bausparen.bz.it
beauty-bracelet.com
beauty-things.com
begalka.xyz
berrymall.ru
best-way.men best-way.men
bestcalovebracelet.cn betterscooter.com
bestempresas.es biketank.ga
besthomemadepornsites.com bird1.ru
biglistofwebsites.com blackhatworth.com
bimatoprost-careprost.com.ua blog.koreadaily.com
bin-brokers.com blog.yam.com
bio-japan.net bloggerads.net
birzha-truda.eu
bloggers.nl
blogrankers.com
blpmovies.com blpmovies.com
bonanza-fortune.men bonux.nextview.ru
bonkers.name bonzybuddy.com
bradleylive.xyz bracketsmackdown.com
break-the-chains.com brk-rti.ru
buchananshardware.com brothers-smaller.ru
bumble.cheapwebsitehoster.com bugof.gq
bvlgariring.xyz bupropion-sr-150-mg.us
bvlgariwallet.xyz buqyxa.rincian.info
bwlx.prepedu.cn buttons-for-your-website.com
callejondelpozo.es buy-cheap-online.info
callmd5map.com callmd5map.com
canacopegdl.com camel-beach.com
cartechnic.ru carmuffler.net
cartierlovebraceletreplica.xyz carstrends2015.com
cashonads.com cartierreplica.top
cheap-trusted-backlinks.com cartujano-pre.de
cheapjerseysbizwholesale.us castingbank.ru
catalogs-parts.com
cb.iphantom.com
cheapjerseysa.com
cheapsergiorossi.online cheapsergiorossi.online
chee-by.biz chee-by.biz
chinaelitecheapjerseys.com chelyabinsk.xrus.org
ciekawinki.pl chocoslim.pro
ciproandtizanidine.blogspot.com christianlouboutinreplica.pw
clicksotrk.com cialisndbrx.com
coccoc.com ciceros.co
compliance-george.top clubfashionista.com
conciergegroup.org cmd.kz
contentsexpress.com cognitiveseo.com
coop-gamers.ru com-supportcenter.website
countercrazy.com community.allhiphop.com
cowblog.fr compliance-alexa.xyz
creditmoney.com.ua concordexoticrentals.com
cubs-jerseys.us coolwallpapers-hd.com
customchocolate.business-for-home.com copenergo.ru
customerguru.in counterbot.com
customsua.com.ua cryptoswap.biz
cwetochki.ru cupday.com
cyclobenzaprinevstizanidine.blogspot.com custom-product-labels.com
daneshetabiat.com customboxes4less.com
dcj-nn.ru daisye.top
deanmoore.ie day-news.info
den-noch24.ru ddospanel.com
deutschland123.de decoratinghomes.ga
diffbot.com delfin-aqua.com.ua
delitime.info
dentalpearls.com.au
derevesendeco.com
design-ideas.info
destinationrealestate.com
detalizaciya-tut.biz
digital-sale.su digital-sale.su
disruptingdinnerparties.com digital-video-processing.com
dktr.ru digitalassetmanagement.site
documentbase.net dkvorota.ru
dojki-hd.com dlya-android.org
doktoronline.no dodlive.mil
doreenblog.online dojki365.online
dtm-spain.com dosugrostov.site
e-avon.ru dprtb.com
e-buyeasy.com drhomes.biz
e-poker-2005.com druzhininevgeniy63.blogspot.com
earncash.com.ua duplicashapp.com
ebonyporn.site dvr.biz.ua
edudocs.net e-commerce-seo.com
egvar.net earl-brown.info
elektrischezigarette1.blog.pl egovaleo.it
eldiariodeguadalajara.com
electricwheelchairsarea.com
elektrischezigarettekaufen2.cowblog.fr elektrischezigarettekaufen2.cowblog.fr
elektronischezi.livejournal.com elektrischezigaretten2.beeplog.com
elektronischezigarette2.mex.tl
elektrozigaretten1.postbit.com elektrozigaretten1.postbit.com
elitesportsadvisor.com elektrozigaretten1.tumblr.com
elmacho.xyz elektrozigaretten1.webs.com
energydiet-info.ru eloxal.ru
engines-usa.com emailaccountlogin.co
enskedesquashclub.se eropho.com
enternet.ee esfchat.tk
enthuse.computernetworksonline.com eshop4u.jp
estibot.com espaceinventoristes.com
euronis-free.com etm-consult.de
evehemming.blogspot.com.au evehemming.blogspot.com.au
extremez.net excaliburfilms.com
f0815.de exlarseva.webblog.es
face.hostingx.eu exoneration-project.us
faithe.top ezaz.info
favoritemoney.ru ezigarettenkaufen1.deviantart.com
fickblock18.com falopicm.pw
filmidivx.com family1st.ca
find1friend.com fickenbumsen.net
filesclub.net
financeloan.us
findanysex.com findanysex.com
findclan.org findpics.pw
fix-website-errors.com fivedwld.cf
flagcounter.me flavors.me
fok.nl foto-sisek.porngalleries.top
forminecrafters.ru fotoxxxru.com
forodvd.com freakycheats.com
forum20.smailik.org free-video-tool.com
forum69.info freshmac.space
frameimage.org friendflnder.com
frcls.fr frustrated-favorable.gq
freemags.cc fusoradio.info
frequiry.com fxgallery.com
freshwallpapers.info game300.ru
fuckingawesome.com gamebackyard.com
fym.com.ru gamingspark.com
gallery.rennlist.com gay.adultgalls.com
gambarkatabaru.com gayxperience.com
gelezki.com ge0ip.com
generalporn.org ge0ip.net
getlamborghini.ga ge0ip.org
globalscam.ga get-your-social-buttons.info
gloverid.site getaclueamerica.com
gnuetella.com girlsfuckdick.com
goldenggames.com glavtral.ru
goodhousekeeping.com glcomputers.ru
gosreg.amchs.ru golfresa.lucania.se
gowreckdiving.com goodwinmetals.co
greendream.com.ua googlefeud.com
gsbs.com.ua gosmeb.ru
guardlink.com gratuitbaise.com
hawaiisurf.com greatgrace.ru
hdxnxxtube.mobi greatidea.marketing
hebr.myddns-flir.com gsasearchengineranker.pw
herehloadibs.cf guruofcasino.com
hidefiles.org gwebtools.com
historichometeam.com hasshe.com
hit-kino.ru hawaiielectriclight.com
hmmm.cz hdhc.ru
home-task.com health-medical-portal.info
host-tracker.com hetmanship.xyz
hostnow.men hidemyass.com
howopen.ru hjaoopoa.top
howtowhitenteethfast.xyz honyaku.yahoofs.jp
husky-shop.cz hoterika.com
hut1.ru hothot.ru
hvd-store.com hotshoppymac.com
hybrid.ru houdom.net
iamsport.org housediz.com
idealtits.net htmlcorner.com
ifirestarter.ru iblogpress.xyz
igrovyeavtomaty777.ru idc.com.ua
impresagaia.it igru-xbox.net
inboundlinks.win ilikevitaly.com
inclk.com imabase.com
indetiske.ya.ru imfamous.info
imperiafilm.ru
impisr.edunsk.ru
inboxdollars.com
informatiecentro.be informatiecentro.be
innodgfdriverhm.aircus.com int.search.mywebsearch.com
instabid.tech intermesh.net
instasexyblog.com iqoption-bin.com
integritylandscapeservices.com irkutsk.zrus.org
intellektmedia.at iskalko.ru
internetproviderstucson.com jewelryandfiligree.com
iomoio.net jmat.cn
iopeninghours.co.uk jongose.ninja
iron-age.info jus0wil.pp.ua
isitwp.com justkillingti.me
islamtoday.co.za kam-dom.ru
ivanovo.zrus.org kamen-e.ru
jav-way.site kasino-money.pw
jerseywholesalebizchina.com kazka.ru
jerseywholesaleelitestore.com keywordblocks.com
joy-penguin.com kinosed.net
karachev-city.ru kinostorm.net
kemerovo.zrus.org kit-opt.ru
keywordhouse.com komputers-best.ru
kino-fun.ru kongoultry.net
kino-rf.ru krasnodar-avtolombards.ru
kinobest.pl krassh.ru
kliksaya.com kriokomora.info
koopilka.com ku6.com
kostenlos-sexvideos.com kung-fu-ru.com
kosynka-games.ru kupit-adenu.ru
krasivoe-hd.com kutikomi.net
krasivye-devushki.net labafydjxa.su
lacapilla.info landoftracking.com
ladsup.com laptoper.net
laexotic.com larutti.ru
lanasshop.ru legionalpha.com
landreferat.ru lietaer.com
larchik.net lifehacĸer.com
laudit.ru liffa.ru
laulini.soclog.se linkbolic.com
lenvred.org lob.com.ru
lerporn.info lol-smurfs.com
limtu.ifmo.ru lonely-mature.com
linerdrilling.com m-google.xyz
linkwithin.com m292.info
littlesunraiser.com magicalfind-a.akamaihd.net
livejasmin.com matchpal-a.akamaihd.net
long-beach-air-conditioning.com me-ke.com
lulea-auktionsverk.se medosmotr-ufa.ru
mackeeper-center.club mex-annushka.ru
magiadinamibia.blogspot.com michaelkorssaleoutletonline.net
mansparskats.com missclub.info
maslenka.kz mlf.hordo.win
masterseek.com mnogabukaff.net
med-zdorovie.com.ua modnie-futbolki.net
mediaoffers.click moje-recenze.cz
meet-flirt-dating.com money-for-placing-articles.com
meltwater.com moscow.xrus.org
mexicotravelnet.com moxo.com
mhi-systems.ru moyakuhnia.ru
michellblog.online moyaterapiya.ru
mielec.pl mp3ringtone.info
minneapoliscopiers.com mrinsidesales.com
mir-betting.ru mrpornogratis.xxx
mixed-wrestling.ru muizre.ru
mmostrike.ru mustat.com
moesexy.com myhitmp3.club
moesonce.com myhydros.org
mountainstream.ms mymobilemoneypages.com
mouselink.co nalogovyykodeks.ru
moz.com naphukete.ru
mrlmedia.net narco24.me
mrvideospornogratis.xxx
msfsaar.de
musirc.com
muycerdas.xxx
my-floor.in.ua
myblogregistercm.tk
mygameplus.com
napalm51.nut.cc
nardulan.com
narkologiya-penza.ru
narkologiya-voronezh.ru narkologiya-voronezh.ru
naturalbreakthroughsresearch.com naturalbreakthroughsresearch.com
neks.info nhl17coins.exblog.jp
newfilmsonline.ru no-fuel.org
newstraveller.ru nodding-passion.tk
nicefloor.co.uk normalegal.ru
nikkiewart.ru noumeda.com
nl.netlog.com novatech.vn
notfastfood.ru novosibirsk.xrus.org
o-dachnik.ru novosti-hi-tech.ru
o-o-8-o-o.com nufaq.com
obiavo.by obiavo.in
offf.info obiavo.kz
oksrv.com oddamzadarmo.eu
onefilms.net omgtnc.com
online-hit.info onclickpredictiv.com
online-sbank.ru onlainbesplatno.ru
oops-cinema.ru onlineserialy.ru
openfrost.com onstrapon.purplesphere.in
opinionreelle.com openfrost.net
optom-deshevo.ru optibuymac.com
ownshop.win ordernorxx.com
oz-offers.com oxford-book.com.ua
ozoz.it paradontozanet.ru
paccohichetoti.ml parajumpersjakkesalgnorge.info
paceform.com partner-pop.men
paclitor.com partnerline.men
paidonlinesites.com partners-ship.pro
pandroid.co
parajumpersstore.online
parfusale.se
partner-print.men
pathwhelp.org
pcads.ru pcads.ru
pcboa.se pdamods.ru
pekori.to pestomou.info
perm.xrus.org
pewit.pw
phormchina.com
photosaga.info
phrcialiled.com
picsearch.com
picsforkeywordsuggestion.com
pigrafix.at pigrafix.at
pijoto.net playfortuna-play.ru
pinsdaddy.com
pinup-casino1.ru
pinwallpaper.xyz
pio.polytopesexempt.com
pladform.ru
play.leadzupc.com
playlott.com playlott.com
plohaya-kreditnaya-istoriya.ru polytopesexempt.com
polcin.de porndl.org
polybuild.ru porndroids.com
popup-jdh.xyz pornhive.org
porn555.com porno-chaman.info
pornhub-forum.ga pornofeuer.com
porno-dojki.net portal-eu.ru
porno-video-chati.ru pospr.waw.pl
pornpost.in powenlite24.ru
positive2b.ru pp-budpostach.com.ua
postclass.com priceg.com
potoideas.us privatefx-in.ru
potolokelekor.ru privatefx.all4invest.info
predominant-invent.tk professionalwritingservices15.blogspot.ru
preparevideosafesystem4unow.site proftests.net
presleycollectibles.com pulse33.ru
printdirectforless.com putitin.me
prostitutki-rostova.org puzzleweb.ru
psoriasis-file.trade questionmarque.ch
quizzitch.net quickbuck.com
ranking2017.ga randalljhoward.com
razamicroelectronics.com rczhan.com
remote-dba.de redirlock.com
renecaovilla.online reelheroes.net
renewablewealth.com reeyanaturopathy.com
renhacklids.tk regdefense.com
running-line.ru registratciya-v-moskve.ru
rus-pornuha.com reklama-i-rabota.ru
rybalka-opt.ru reklama1.ru
ryetaw.com renecaovillasale.online
s-iwantyou.com resellerclub.com
samara.rosfirm.ru restaurantlescampi.com
robot-forex.biz
rome2rio.com
rootandroid.org
royal-investments.net
royalcar-ufa.ru
rubbed.us
rumamba.com
ruscoininvest.company
russintv.fr
sa-rewards.co.za
saecsa.co
sakhboard.ru
sammlungfotos.online sammlungfotos.online
savingsslider-a.akamaihd.net sape.top
saveriopiazza.it
scanner-barak.top scanner-barak.top
scanner-brian.top seinterface.com
scanner-jess.top seo18.su
scanner-olga.top sergiorossistore.online
schalke04fc.info service-core.ru
schlampen-treffen.com serving.adbetclickin.pink
seoanalyses.com servisural.ru
seolab.top sexkontakteao.info
servethis.com sexyebonyteen.com
sex-foto.pw shivafurnishings.com
sex-pr.net simply.net
sexflirtbook.com simul.co
sextracker.be site-speed-checker.site
sexyteens.hol.es siteonomy.com
sheerseo.com skanninge.se
shisha-swag.de skytraf.xyz
shopfishing.com.ua slavkokacunko.de
shopperifymac.com slim.sellany.ru
shopvilleroyboch.com.ua small-games.biz
sibtest.ru smart-scripts.com
signal03.ru smartadserver.com
sildenafil-tadalafil.info socas.pluto.ro
siteexpress.co.il soft1.ru
sitopreferito.it solicita.info
skatestick.bid solnplast.ru
social-search.me sonnikforme.ru
songoo.wz.cz soserfis.com
soviet-portal.do.am spamnuker.com
spaceshipad.com spb.afora.ru
splendorsearch-a.akamaihd.net spin2016.cf
spinazdrav.ru
spinnerco.ca
spl63.fr
spy-sts.com
srgwebmail.nl
statistici.ro
stats-public.grammarly.io
stoki.ru
stroiminsk.com stroiminsk.com
sugarkun.com stroyhelp-dv.ru
suggest-keywords.com
superstats.com superstats.com
swinon.site survival.betteroffers.review
symbaloo.com svetlotorg.ru
taihouse.ru sweepstakes.rewardit.com
taxi-v-eisk.ru tamada69.com
teastory.co tampabaywatch.org
teencastingporn.com tarad.com
textads.men tasteidea.com
thecoral.com.br tds-advert002.info
theguardlan.com teesdaleflyballclub.co.uk
theheroes.ru telemetryverification.net
thewebsitetemplate.info teletype.in
timer4web.com testingads.pro
titelhelden.eu thepokertimer.com
tomatis.gospartner.com thewomenlife.com
top10registrycleaners.com tizanidinehcl2mgsideeffects.blogspot.com
topkarkas.com tizanidinehcl4mgtabinfo.blogspot.com
topvidos.ru tizanidinesideeffectsweightloss.blogspot.com
tourcroatia.co.uk token-lab.org
toyota.7zap.com toolsky.com
track2.shop topdownloads.ru
tracxn.com torture.ml
traxdom.ru tourismvictoria.com
trucri.me tovaroboom.vast.ru
trustaffs.com traderzplanet.in
trustl.life tradgardspartner.se
tvnewsclips.info trafficmp.com
tvteleport.ru trafficreceiver.club
twelvevisionspartyofcolorado.com tramadolandtizanidine.blogspot.com
u555u.info tsstcorpcddvdwshbbdriverfb.aircus.com
ublaze.ru tt-ipd.info
universals.com.ua tuberkulezanet.ru
ussearche.cf tv-spoty.info
ustion.ru tversvet.ru
vacuumscleaner.com tvorozhnaja-zapekanka-recept.ru
validccseller.com ufa.xrus.org
vapomnoncri.tk ukrtvory.in.ua
vasileostrovsky-rayon.ru ukrup.com
vchulkax.com ultramart.biz
veles.shop umnovocaminho.com
venta-prom.ru unblocksit.es
ventelnos.com unisexjewelry.org
veopornogratis.xxx utrolive.ru
vepad.com vedomstvo.net
versaut.xxx-cam.webcam versaut.xxx-cam.webcam
vgoloveboli.net vezuviy.su
video-chat.cn vielporno.net
videooko.weebly.com vigrx-original.ru
videosbox.ru vip.51.la
vilingstore.net vipps.com.my
voloslove.ru viteonlusarezzo.it
vote-up.ru vladhistory.com
vvon.co.uk vladimir.zrus.org
vzubah.com vod.com.ua
weblibrary.win vodaodessa.com
weburlopener.com voditeltrezviy.ru
wechatdownload10.com voluumtrk.com
welck.octopis.com vonradio.com
wellcome2slovenia.ru voronezh.xrus.org
whatistizanidinehclusedfor.blogspot.com vpnmouse.com
vykup-avto-krasnodar.ru
vzlom-na-zakaz.com
warning.or.kr
watchmygf.net
waterpurifier.club
wdfdocando.com
webads.co.nz
webextract.profound.net
webinstantservice.com
webmasterhome.cn
webnode.me
wedding-salon.net
whiteproduct.com whiteproduct.com
wholesalejerseychinaoutlet.com wiosenny-bon-1500.pl
wholesalejerseysgaa.com womensterritory.ru
wieseversa.no www.solartek.ru
wildnatureimages.com wygraj-teraz.com
winner7777.net xclicks.net
winx-play.ru xdoza.com
woman-orgasm.ru xlolitka.com
worldinternetauthority.com xn----7sbahjd3btneuw1joc.xn--p1ai
worldis.me xn----7sbaphztdjeboffeiof6c.xn--p1ai
wrz0iuebwhp5fg.freeddns.com xn--b1addnj3cah.xn--p1ai
wtsindia.in xn--lifehacer-1rb.com
ww2awards.info xtube.com
www.jbetting.com xxart.ru
x-lime.com yadro.ru
xn-----7kceclhb4abre1b4a0ccl2fxch1a.xn--p1ai yellowfootprints.com
xxxrus.org yellowstonesafaritours.com
xxxtube69.com your-bearings.com
xzlive.com yousense.info
yeartwit.com ytmnd.com
youdao.com yubikk.info
youjizz.vc
yourmovies.pl
yourserverisdown.com
yunque.pluto.ro yunque.pluto.ro
zaloro.com zapatosenventa.info
zambini.ru zapiszto.pl
zeroredirect7.com zdesformula.ru
zigzog.ru zebramart.ru
zojirushi-products.ru zeroredirect2.com
zolotoy-lis.ru zetmaster.ru
zoogdiesney.com zhorapankratov7.blogspot.com
zoompegs.com zigarettenonl.canalblog.com
zigarettenonlinekaufen1.blox.pl
znaniyapolza.ru

488
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1webmaster.ml 101billion.com
2015god.org 2kata.ru
24-ak.ru 3rbseyes.com
273-fz.ru 98oi.ru
2daytrendingnews.com adpremium.org
4kepics.com aerogo.com
7wind.ru aktobe.xkaz.org
abbanreddy.com alert-jdh.xyz
abcdefh.xyz alfa-medosmotr.ru
abtasty.com all-streaming-media.com
adanih.com alta-realestate.com
air-edem.ru amanda-porn.ga
akama.com andpolice.com
alert-hgd.xyz ap.senai.br
all4invest.info apartment.ru
alloysteel.ru
amateurgalls.com
amateurlivechat.org
amazingninja.com
ananumous.ru
apartmentratings.com apartmentratings.com
apiholdingmypage-a.akamaihd.net apple.com-webbrowsing-security.science
asacopaco.tk auto4style.ru
asrvrep-a.akamaihd.net b2b-lounge.com
atout-energie-69.com bannerbank.ru
autochoixspinelli.com bashtime.ru
avirasecureserver.com beachtoday.ru
azartmsl.com berdasovivan.ru
babespcs.com beremenyashka.com
balitouroffice.com betshuckclean.com
bard-real.com.ua big-cash.net
bavsac.com bigcities.org
becuo.com bjanshee.ru
bezsporno.ru blackbabesporn.com
bikini-image.com blavia.00author.com
bimatoprost-careprost.com blogig.org
biographiya.com bluesalt.co
bloggedporn.com bmw-ark.ru
bloke.com bodybuilding-shop.biz
bolezniorganov.ru boom-celebs.com
bongacams.com brandedleadgeneration.com
bonzbuddy.com brg8.com
braintobe.win bronzeaid-a.akamaihd.net
cartierreplica.xyz burger-imperia.com
casablancamanor.co.za buyscabiescream.com
casinopinup-wins.com buzzsumo.com
ccjp.eu byme.se
cheapcigarettesc.info canoncdriverq3.pen.io
clickintext.net cartierlovestore.com
clmforexeu.com casite-513049.cloudaccess.net
codysbbq.com chatseo.com
compliance-walter.top cheapbelstaff.online
cranly.net cheapmoncler.pw
customboxes4less.com cheapsergiorossi.online
danceuniverse.ru cigarpass.com
daneshetabiat.com clean-virus-mac.com
dangphoto.trade clickcash.com
data-mining.tk clipartnew.com
detki-opt.ru club-musics.ru
dev33.dioniqlabb.se compiko.info
diesel-parts28.ru compliance-george.top
djonwatch.ru corta.co
draniki.org covid-schutzmasken.de
edge.sharethis.com cowlmash.com
eets.net crest3d.ru
ekosmetyki.net.pl cscwtalkto.site
ekspresihati.info cutt.us
elektrozigaretten1.postbit.com d-black.bz
eupornstar.info dailyrank.net
europeanwatches.ru dairyindia.in
evehemming.blogspot.com.au dogbreedspicture.net
ezigarettenkaufen1.deviantart.com dood.live
ezrvrentals.com doxysexy.com
f1nder.org e705.net
facecup.top enbersoft.com
fickblock18.com enthuse.computernetworksonline.com
forminecrafters.ru euromasterclass.ru
foto-basa.com ezigarettekaufen1.hpage.com
franecki.net fashionavenuegame.com
free-video-tool.com fastcrawl.com
fungirlsgames.net filesvine.com
ge0ip.net fivedwld.cf
gearcraft.us footballfarrago.com
geile-lelly.eu forexunion.net
gembird.com free-social-buttons.com
genericlowlatencyasiodriverhq.aircus.com fxgallery.com
gepezz.info geoads.com
gheus.altervista.org gilsonchiro.xyz
gne8.com glavtral.ru
go2jump.org goforexvps.com
goldenggames.com goodwinmetals.co
googglet.com googglet.com
gorodservis.ru gox.com.ua
grupografico-pilar.com.ar gpms.org.my
hawaiisurf.com gratis-sexkontakte.com
headpharmacy.com gstatey.net
hermesbelts.xyz hamacapty.com
hetmanship.xyz hao123.com
highspeed5.net havepussy.com
hobild.net hayate.biz
hotdl.in hdapp1008-a.akamaihd.net
hoverboard360.se hdhc.ru
https-legalrc.biz helvetia.com.ua
huhn.altervista.org herokuapp.com
ie.57883.net highstairs-a.akamaihd.net
igithab.com himgaws.pw
imabase.com imperia31.ru
imk.com.ua impresagaia.it
imperiafilm.ru infodocsportal.com
inet-traffic.com isitwp.com
internet-apteka.ru jestr.org
iplusbit.blogspot.co.za jobgirl24.ru
iron-age.info karusel-market.ru
ivanstroi.ru kazan.zrus.org
jackpotchances.com kerch.site
jewelryandfiligree.com kletkimehan.ru
joyceblog.top koversite.info
jrpmakati.com labafydjxa.su
kmd-pto.ru lacave.ntic.fr
kvartira-sutochno.com letslowbefast.site
kvartiry-remont.ucoz.ru lineshops.biz
ladov.ru
laxdrills.com
libertybilisim.com
linkarena.com linkarena.com
liran-locks.com linkdebrideur.xyz
lisque.batcave.net lion.bolegapakistan.com
ljusihus.se lion.misba.us
lockerz.com lob.com.ru
lostfilm-online.ru locimge.pw
m-google.xyz lodki-pvh.dp.ua
m0r0zk0-krava.ru lsex.xyz
makemoneyonline.com lyrics.home-task.com
mansparskats.com mackeeper-center.club
manualterap.roleforum.ru megavolt.net.ua
marinetraffic.com meget.co.za
maxxtor.eu microsearch.ru
mbiologi.ru microsoftportal.net
mobstarr.com microstatic.pl
morpicert.pw mindbox.co.za
movies-in-theaters.net missis.top
mrmoneymustache.com misswell.net
musezone.su mixx.com
national-today-winning-winner.club mnimmigrantrights.net
nerudlogistik.ru mobplayer.net
netoil.no mojpreskumanie.com
netpics.org mosdverka.ru
nikkiewart.ru muizre.ru
nudejapan.net mulberryoutletonlineeu.com
o-o-6-o-o.com my-floor.in.ua
obiavo.com myhitmp3.club
obnal.org narosty.com
onko-24.com nationalbreakdown.com
online-podarki.com nextconseil.com
online247.ml ngps1.ru
nudo.ca
obiavo.net
olympescort.com
oneminutesite.it
onlyforemont.ru onlyforemont.ru
ops.picscout.com ooo-gotovie.ru
papasdelivery.ru optitrade24.com
pekori.to oranga.host.sk
pelfind.me ovirus.ru
perm-profnastil.ru panouri-solare-acoperis.com
physfunc.ru parajumpersstore.online
pl.aasoldes.fr pcgroup.com.uy
play-movie.pl pics-group.com
play.leadzupc.com pinstake.com
playmsn.com pintattoos.com
pomoc-drogowa.cba.pl pizdeishn.com
pornogig.com pizdopletka.club
pst2017.onlinewebshop.net play-mp3.com
psvita.ru poem-paying.gq
pornosee.info
privatefx.all4invest.info
proftests.net
pronekut.com
radiogambling.com radiogambling.com
rankingchart.de realting-moscow.ru
refudiatethissarah.info rebelmouse.com
relax.ru redirect.trafficreceiver.club
research.ifmo.ru reelheroes.net
riralmolamsaca.tk registry-cleaner.net
risparmiocasa.bz.it replica-watch.ru
rosbalt.com.ua restaurantlescampi.com
rossmark.ru rique.host.sk
ruex.org.ua rogervivierforsale.com
ruspdd.com rootandroid.org
russia-tao.ru rostov.xrus.org
s.lollypopgaming.com runtnc.net
satellite.maps.ilovevitaly.com saletool.ru
sax-sex.com sanidumps.com
scanner-alexa.top scanner-marwin.top
seoboxes.com search.alot.com
seolab.top segol.tv
seonetwizard.com sexsaoy.com
sex-watch.com shtaketniki.ru
shop.xz618.com skincrate.net
sibecoprom.ru slavia.info
signx.info slkrm.ru
site-speed-checker.site slutloadlive.com
sitechecker.pro soaksoak.ru
slujbauborki.ru social-fun.ru
smart-scripts.com socialmonkee.com
smartbalanceworld.com softtor.com
startufa.ru sovetogorod.ru
statoutlook.info srdrvp.com
staynplay.net stockspmb.info
storehouse.ua strangeduckfilms.com
stpicks.com styro.ru
stpolice.com tastyfoodideas.com
strv.se tecspb.ru
success-seo.com templates.franklinfire.co
sunflowerdrawingpaintings.blogspot.com tgtclick.com
svarbit.com thegolfclub.info
swsociety.se thetoiletpaper.com
taraz.xkaz.org titangel-vietnam.com
taxi-v-eisk.ru titslove.yopoint.in
teguh.info tizanidineandhydrocodone.blogspot.com
tizanidineduringpregnancy.blogspot.com tnaionline.org
tizanidinezanaflex.blogspot.com tracfone.com
topvidos.ru trahic.ru
toursmaps.com turbabitload.weebly.com
tozup.com uptimechecker.com
traderzplanet.in
traffic2cash.org
traffictrade.life
trubywriting.com
twinderbella.com
ua-company.ru
ua.tc
uhdtv.website
urengoy.pro
url-extractor.xyz url-extractor.xyz
uvozdeckych.info uzungil.com
vapomnoncri.tk velobikestock.com
vedomstvo.net vezuviy.su
viandpet.com via-energy-order.com
video-production.com videochat.cafe
villakohlanta.nu videochat.mx
vip2ch.com videochat.ph
webmonetizer.net videosbox.ru
webradiology.ru videositename.com
websiteexplorer.info vostoktrade.info
weightatraining.com vut.com.ru
westum.se vvpg.ru
woman-orgasm.ru websitevaluebot.com
ws.ampower.me westvilletowingservices.co.za
www.timer4web.com whiteelephantwellington.com
xchat26.myfreecams.com wholesalejerseys-cheapest.com
xep.info wikes.20fr.com
xn--80aagddcgkbcqbad7amllnejg6dya.xn--p1ai woweb.com.ua
xn--h1ahbi.com.ua wpsecurity.website
xxxguitars.com www.event-tracking.com
yellowfootprints.com xboxster.ru
yoshkarola.zrus.org xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
zapiszto.pl xn--c1acygb.xn--p1ai
xn--d1aifoe0a9a.top
xvideospornoru.com
youjizz.vc
yourads.website
yourdesires.ru
ypmuseum.ru
zhacker.net
zigzog.ru
zygophyceous.womanstars.site

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.76 0; 10.1.0.125 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3274 ### Version: V4.2022.08.3275
### Updated: Sat Aug 6 22:01:21 UTC 2022 ### Updated: Sun Aug 7 10:03:32 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.08.3274 ### Version: V4.2022.08.3275
### Updated: Sat Aug 6 22:01:21 UTC 2022 ### Updated: Sun Aug 7 10:03:32 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##