vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-03 19:20:16 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2993 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-21 22:07:17 +00:00
parent 9a2fc49c51
commit 8ea8726c4d
46 changed files with 97959 additions and 97959 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2992 #### Version: V4.2022.03.2993
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2992 #### Version: V4.2022.03.2993
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2992 #### Version: V4.2022.03.2993
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12110
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2992 #### Version: V4.2022.03.2993
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

12114
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12114
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

12114
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

12114
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2992 2993

12114
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

12114
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.245.253 0; 52.165.0.156 0;

12114
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

12114
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.245.253 0; 52.165.0.156 0;

12114
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
13.64.245.253 0; 52.165.0.156 0;

12114
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 1; 10.1.0.13 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Asterias Barkrowler
BackWeb Blow
Havij Buck
Masscan LibWeb
Morfeus Fucking Scanner Libwhisker
Pixray RepoMonkey
Sociscraper TheNomad
VidibleScraper Twice
WISENutbot Web Fetch
crawler.feedback Web Pix

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
404checker 404checker
404enemy
ALittle Client ALittle Client
ASPSeek ASPSeek
AfD-Verbotsverfahren Abonti
Aipbot AhrefsBot
AlphaBot
Anarchie Anarchie
Anarchy Anarchy
Asterias Ankit
Attach Anthill
BBBike Aspiegel
BDCbot AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackDoorBot BackDoorBot
Backlink-Ceck BackStreet
BackWeb
BacklinkCrawler BacklinkCrawler
Badass Badass
Barkrowler BatchFTP
Bigfoot
Black Hole
BlackWidow
Blow Blow
BlowFish BotALot
Bolt Brandprotect
Buck
Buddy Buddy
CATExplorador BuiltBotTough
CODE87 CODE87
CSHttp
CazoodleBot CazoodleBot
Cegbfeieh
CheTeam CheTeam
ChinaClaw
Chlooe Chlooe
Citoid
Cliqzbot Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot Cocolyzebot
Collector Collector
Copier Copier
Cosmos CopyRightCheck
Crescent Copyscape
CrunchBot Crawling at Home Project
Curious Curious
Custo
DIIbot
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Devil DigitalPebble
Discobot Dirbuster
Discoverybot
Dispatch
DittoSpyder
DomCopBot
DomainCrawler DomainCrawler
Download Wonder
Drip Drip
ECCP/1.0
EMail Wolf EMail Wolf
Evil EasyDL
Exabot Ecxi
ExtLinksBot EirGrabber
Extractor Extractor
ExtractorPro ExtractorPro
FemtosearchBot FemtosearchBot
Flunky Firefox/7.0
Foobot
Freeuploader Freeuploader
FyberSpider
Fyrebot Fyrebot
GT::WWW G-i-g-a-b-o-t
Genieo GalaxyBot
GetWeb GetRight
Getintent Go-Ahead-Got-It
Gigabot Grabber
GoZilla Grafula
Gotit HTMLparser
GrapeshotCrawler
GridBot
HTTP::Lite
Havij
Heritrix Heritrix
Hloader Hloader
Humanlinks Humanlinks
HybridBot HybridBot
IDBot IDBTE4M
IRLbot
Iblog Iblog
Id-search
IlseBot IlseBot
IndeedBot
InfoTekies InfoTekies
InterGET Internet Ninja
IstellaBot IstellaBot
Jbrofuzz Jbrofuzz
JennyBot
JetCar JetCar
JikeSpider
Joomla
Jorgee Jorgee
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density Keyword Density
Lanshanbot Kinza
Leap Kozmosbot
LNSpiderguy
Larbin
LeechFTP LeechFTP
LeechGet LeechGet
LexiBot Lftp
LieBaoFast LieBaoFast
LinkextractorPro Likse
LinkpadBot LinkScan
Linkdexbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaScrapeBot LinqiaScrapeBot
Litemage_walker Lipperhey Spider
Lmspider Lmspider
MFC_Tear_Sample MQQBrowser
MJ12bot MSFrontPage
Mag-Net Magnet
Mail.RU_Bot Majestic SEO
Majestic12 MarkMonitor
MarkWatch Mass Downloader
Masscan Masscan
Mata Hari Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger MicroMessenger
Microsoft Data Access
Microsoft URL Control Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious Mojolicious
Mozlila Musobot
Mr.4x3 Nameprotect
Msrabot Navroad
NICErsPRO Nessus
Needle NetLyzer
NetSpider
NetZIP NetZIP
Netcraft Netvibes
NextGenSearchBot
Nikto Nikto
Nimbostratus Ninja
Nmap Nmap
Not
Nuclei Nuclei
Nutch Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS
Openfind Openfind
Openvas Openvas
OrangeSpider OrangeSpider
OutclicksBot PECL::HTTP
OutfoxBot PHPCrawl
PageScorer PageAnalyzer
PageThing.com
Pandalytics Pandalytics
Panscient
Papa Foto Papa Foto
PeoplePal Pavuk
PleaseCrawl Picscout
Pockey PictureFinder
ProWebWalker Piepmatz
ProPowerBot
Psbot Psbot
Pump Pu_iN
PxBroker
PyCurl PyCurl
Quick-Crawler Quick-Crawler
RSSingBot
RankActive
RankFlex RankFlex
RankingBot RankurBot
Rankivabot
Re-re Re-re
Reaper Reaper
Recorder RebelMouse
RedesScrapy
RepoMonkey
Ripper Ripper
Rogerbot
SBIder
SEOkicks-Robot SEOkicks-Robot
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler
SEOstats SEOstats
SISTRIX SemanticJuice
ScoutJet
Scrapy
ScrepyBot
Seekport
SemrushBot SemrushBot
SeoSiteCheckup SeoSiteCheckup
Seomoz Shodan
Siphon
SiteLockSpider
SiteSnagger SiteSnagger
SiteSucker Snapbot
Sitevigil Snoopy
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper Sociscraper
Spammen Sosospider
Suzuran SpaceBison
Telesoft SpankBot
Spbot
Spinn3r
Sucuri
Szukacz
T8Abot
Teleport
The Intraformant
TheNomad
Thumbor
Toata Toata
Tracemyfile Trendictionbot
Trendiction
True_Robot True_Robot
Turnitin Turingos
TwengaBot Typhoeus
V-BOT URLy.Warning
VCI Vacuum
VelenPublicWebCrawler
Virusdie Virusdie
Voil
Voltron Voltron
WASALive-Bot
WEBDAV WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD WallpapersHD
WeSEE Web Auto
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Fuck
Web Sucker Web Sucker
WebAuto WebCollage
WebCopier WebFetch
WebImageCollector WebGo IS
WebLeacher WebLeacher
WebPix
WebSauger
WebStripper WebStripper
WebZIP WebmasterWorldForumBot
Webalta Webster
Whacker
Whatweb Whatweb
Who.is Bot Widow
WiseGuys Robot WiseGuys Robot
Woobot Wonderbot
Wotbox
Xaldon_WebSpider Xaldon_WebSpider
Zauba ZoominfoBot
Zeus
ZyBorg
arquivo-web-crawler
backlink-check backlink-check
clark-crawler coccocbot
cognitiveseo com.plumanalytics
demandbase-bot crawler.feedback
crawler4j
domainsproject.org domainsproject.org
facebookscraper
heritrix
instabid instabid
internetVista monitor internetVista monitor
netEstate NE Crawler ips-agent
oBot iubenda-radar
page scorer lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
pcBrowser pcBrowser
plumanalytics plumanalytics
ripz polaris version
probe-image-size
s1z.ru
scalaj-http scalaj-http
scan.lol
seobility
sexsearcher
siteripz siteripz
sogouspider sogouspider
sp_auditbot
spyfu spyfu
tAkeOut
trendiction.de trendiction.de
voyagerx.com webpros.com
webprosbot
zgrab zgrab

292
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 360Spider
ADmantX ADmantX
ASPSeek AIBOT
Abonti Abonti
Aboundexbot Aboundexbot
Acunetix Acunetix
AhrefsBot AhrefsBot
AiHitBot AiHitBot
Alligator Alligator
AlphaBot Anarchie
Anarchy99
Ankit Ankit
Anthill Aspiegel
Apexoo
Asterias
Atomseobot Atomseobot
Attach Attach
AwarioSmartBot AwarioRssBot
BBBike
BDCbot BDCbot
BLEXBot BLEXBot
BackDoorBot BackDoorBot
Backlink-Ceck BackStreet
Badass BacklinkCrawler
Bandit
Barkrowler Barkrowler
BatchFTP BatchFTP
Bitacle Battleztar Bazinga
BlackWidow BlackWidow
Blackboard
BlowFish BlowFish
Brandwatch Boardreader
BuiltBotTough BotALot
Bullseye Buck
BunnySlippers Buddy
BuzzSumo
CCBot
CSHttp
Calculon
CazoodleBot CazoodleBot
CheTeam Cegbfeieh
CherryPicker CherryPicker
Citoid Cloud mapping
Claritybot Cogentbot
Cliqzbot Copyscape
CopyRightCheck
Craftbot Craftbot
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy CyotekWebCopy
DBLBot DBLBot
DIIbot
DTS Agent
DataCha0s DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon DigitalPebble
Discoverybot DittoSpyder
DomainAppender DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot Dotbot
ECCP/1.0
EMail Wolf
Ebingbong Ebingbong
Ecxi EroCrawler
Evil Evil
Exabot
Express WebPictures Express WebPictures
ExtLinksBot Extractor
EyeNetIE ExtractorPro
FDM Firefox/7.0
FHscan
FemtosearchBot
FlashGet
Foobot Foobot
FrontPage
Fuzz
Fyrebot Fyrebot
G-i-g-a-b-o-t GT::WWW
GalaxyBot GalaxyBot
Genieo Genieo
GetRight Getintent
Gigabot Go-Ahead-Got-It
Go!Zilla
GoZilla GoZilla
Gotit GrabNet
Grafula
GrapeshotCrawler GrapeshotCrawler
GridBot
HMView
HTMLparser HTMLparser
Haansoft HaosouSpider
Hloader
IDBTE4M
IDBot IDBot
IRLbot IRLbot
Iblog Id-search
IlseBot Iria
Image Fetch
Image Sucker
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iskanie Iskanie
IstellaBot Keybot Translation-Search-Machine
JamesBOT Kozmosbot
Jbrofuzz
JikeSpider
Joomla
Jyxobot
Kenjin Spider
LWP::Simple LWP::Simple
Lanshanbot
Larbin
LexiBot LexiBot
LibWeb Lftp
Libwhisker LinkScan
Likse
LinkWalker LinkWalker
LinkextractorPro Linkbot
LinkpadBot
Lmspider Lmspider
Ltx71 Ltx71
MJ12bot MIDown tool
MIIxpc
MQQBrowser MQQBrowser
MSFrontPage MSFrontPage
MSIECrawler Magnet
MarkWatch Mail.RU_Bot
Majestic12
MarkMonitor
Masscan Masscan
Mediatoolkitbot MauiBot
Microsoft Data Access Mb2345Browser
Minefield MegaIndex.ru
Metauri
MicroMessenger
Moblie Safari Moblie Safari
Mojeek
Mojolicious
Mr.4x3 Mr.4x3
Msrabot Musobot
NICErsPRO NICErsPRO
Nameprotect
NearSite
Nessus Nessus
NetAnts NetAnts
NetLyzer NetLyzer
NetMechanic
Netcraft
Netvibes
Nibbler Nibbler
Offline Explorer
Offline Navigator Offline Navigator
OpenLinkProfiler OpenLinkProfiler
OpenVAS Openfind
OutfoxBot Openvas
PECL::HTTP PECL::HTTP
PHPCrawl PHPCrawl
Pavuk PageGrabber
Pi-Monster Pandalytics
PleaseCrawl PeoplePal
Petalbot
Picscout
Picsearch
Pimonster
ProWebWalker ProWebWalker
Psbot Probethenet
Pu_iN
Pump Pump
PxBroker PxBroker
RSSingBot RSSingBot
RankActive
RankingBot2 RankingBot2
RankurBot Re-re
ReGet
RealDownload RealDownload
RebelMouse
RepoMonkey RepoMonkey
Ripper Ripper
RocketCrawler
Rogerbot Rogerbot
SBIder SEOstats
SEOkicks SISTRIX
Scanbot SalesIntelligent
SearchmetricsBot ScanAlert
Screaming
SemanticJuice
Semrush Semrush
SemrushBot SeoSiteCheckup
Site Sucker SeobilityBot
SiteLockSpider Seomoz
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker
Sitebeam Sitebeam
Sitevigil
SmartDownload SmartDownload
Snake Snake
Snapbot Snapbot
Sogou web spider
Sosospider
Sottopop Sottopop
SpaceBison
Spammen Spammen
SpankBot
Spanner Spanner
Sqlmap Spbot
Spinn3r
SputnikBot
Sqlworm Sqlworm
Sqworm
Stripper Stripper
Sucker Sucuri
SuperHTTP SuperHTTP
SurveyBot SurveyBot
Suzuran Swiftbot
T0PHackTeam Teleport
TeleportPro TeleportPro
Telesoft
Telesphorep Telesphorep
The Intraformant The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Trendiction Trendiction
True_Robot Trendictionbot
Turingos TurnitinBot
Turnitin
TwengaBot TwengaBot
URLy Warning Typhoeus
V-BOT UnisterBot
VB Project Upflow
VeriCiteCrawler Vacuum
VelenPublicWebCrawler
VoidEYE VoidEYE
Voil
Voltron
WASALive-Bot WASALive-Bot
WPScan WBSearchBot
WWW-Mechanize WISENutbot
WWW::Mechanize WWWOFFLE
Web Enhancer WallpapersHD
Web Pix Web Pix
Web Sucker Web Sauger
WebCollage WebCopier
WebEnhancer
WebFetch
WebFuck WebFuck
WebPix WebGo IS
WebWhacker WebImageCollector
WebReaper
WebZIP WebZIP
Webshag Webshag
Website Quester Webster
Whack Who.is Bot
Whatweb Widow
WiseGuys Robot WiseGuys Robot
Wonderbot
Wotbox Wotbox
Zitebot YoudaoBot
Zauba
Zeus
ZmEu
ZoomBot ZoomBot
ZoominfoBot archive.org_bot
ZyBorg autoemailspider
check1.exe
coccocbot coccocbot
crawler4j dataforseo.com
instabid demandbase-bot
isitwp.com facebookscraper
iubenda-radar internetVista monitor
lwp-request magpie-crawler
lwp-trivial muhstik-scan
meanpathbot netEstate NE Crawler
mediawords page scorer
polaris version plumanalytics
probe-image-size probe-image-size
ripz
s1z.ru
seobility
seocompany.store seocompany.store
seoscanners
serpstatbot
sexsearcher
siteripz siteripz
sp_auditbot sogouspider
sysscan
tAkeOut
trendiction.com trendiction.com
trendiction.de trendiction.de
voyagerx.com ubermetrics-technologies.com
webmeup-crawler
webpros.com webpros.com
webprosbot webprosbot
x09Mozilla x22Mozilla
zauba.io zauba.io
zgrab zgrab

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
alveris.ru bestofferswalkmydogouteveryday.gq
arquapetrarca.info clickbank.net
auspolice.com idc.com.ua
classiquebijoux.ru kiwe-analytics.com
credit-respect.ru olympescort.com
feel-planet.com orsonet.ru
free-share-buttons.top pochemychka.net
graphics8.info stuffpride.com
ostroike.org titangel-vietnam.com
validdomain.xyz tkanorganizma.ru

942
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com
108shot.com 108shot.com
14b.info 123kuma.com
1688.com 18ps.ru
214jaluwobapef.cf 2girls1cup-free.com
24x7-server-support.site 3-letter-domains.net
256bit.by 72-news.com
45en.ru 8kisses.eu
4kepics.com 991mostfm.co.id
4replicawatch.net DomainStatsBot
51.la a1security.com.ua
5forex.ru aa81bf391151884adfa3dd677e41f94be1.com
7ooo.ru aac52006ec82a24e08b665f4db2b5013f7.com
7zap.com aarbur.com
98oi.ru aaronabel.com
aa14ab57a3339c4064bd9ae6fad7495b5f.com absolutelyanalog.com
aasoldes.fr acortarurl.es
absugars.com adclickthru.net
acgs.tk addray.pro
adelly.bg adidas.frwebs.fr
adnotbad.com adrunnr.com
adobereader-free.ru adtiger.tk
adprotect.net
adrenalin-stk.ru
adsland.men
adultwebhosting.info adultwebhosting.info
alarmobninsk.ru advancedmassagebysara.com
all-number.com advokateg.xyz
all-streaming-media.com ahrefs.com
allstatesugarbowl.org airmaxshoes-2016.com
ald2014.org
alfa-medosmotr.ru
aliexpresscashback.club
all4invest.ru
alphaforum.ru alphaforum.ru
alpharma.net
amigobulls.com
amoi.tn
amyfoxfitness.com amyfoxfitness.com
anabolics.shop android-vsem.org
anal-acrobats.com animal36.com
android-style.com anjalika.co.in
android4fun.org apidiamondatanet-a.akamaihd.net
apiallgeniusinfo-a.akamaihd.net apiholdingmypage-a.akamaihd.net
apispringsmartne-a.akamaihd.net apiluckyleapnet-a.akamaihd.net
app-ready.xyz arcadepages.com
arendakvartir.kz arcteryxsale.online
articlesdirectoryme.info arcteryxstore.online
asdfz.pro arenda-avtoprokat-krasnodar.ru
asrv-a.akamaihd.net artefakct.com
asrv-a.akamoihd.net artel116.ru
asrvrep-a.akamaihd.net artpicso.com
atleticpharm.org auto4style.ru
auto-zapchasti.org autolombard-krasnodar.ru
autovideobroadcast.com aviav.org
availit.weebly.com avtochehli.by
avon-novosib.ru awency.com
avramstroy.ru ayakino.net
avtolombard-krasnodar.ru azartniy-bonus.com
axbocz.net baersaratov.ru
azazu.ru bagcionderlab.com
azte.ch bannerpower.com
balkanfarma.org bashtime.ru
bambi.ck.ua battlecarnival.su
bankmib.ru beauty-b0x.pl
baoxaydung.com.vn belinka.com.ua
best-seo-offer.com best-deals-products.com
bestdooz.com best-seo-solution.com
bestmarriages.com bestfortraders.com
bestserials.com besthomemadepornsites.com
bestwebsitesawards.com beta.hotkeys.com
bezlimitko.xyz betterhdporn.com
bibys.com bharatdefencekavach.com
big-boards.info bif-ru.info
bio-japan.net bigpictures.club
bioca.org biketank.ga
bitcoin-ua.top binaryoptionscops.info
blockety.co bingo8888.com
bluerobot.info bingoporno.com
bocoarchives.org blog-hits.com
bombla.org bmw.afora.ru
boole.onlinewebshop.net bonzybuddy.com
brainxs.us book-bets.com
brakehawk.com brainsandeggs.blogspot.com
brg8.com brk-rti.ru
browsepulse-a.akamaihd.net bronzeaid-a.akamaihd.net
buyessayonline19.blogspot.ru bugshoot.cn
cah.io.community builtwith.com
californianews.cf bumskontakte.org
camdolls.com businesn.men
cand.jp buy-cheap-pills-order-online.com
candytiner.com buypanicdisorderpill.com
capture-room.com bwlx.prepedu.cn
carsplate.com bzero1jewelry.net
cashonads.com calcularpagerank.com
caveavins.fr callcafe.info
ceotrk.com calstaterealty.us
cercacamion.it cardiosport.com.ua
certifywebsite.win carmuffler.net
cfsrating.sonicwall.com carstrends2015.com
charmstroy.info cartierbraceletsreplica.pw
chastnoeporno.com cartierring.xyz
chatroulette.si casite-513049.cloudaccess.net
chatseo.com cbb1smartlist12.click
cheapmoncler.xyz cete.ru
cheapsergiorossi.online cgi2.nintendo.co.jp
chee-by.biz cheatcode-lita12.rhcloud.com
chelnytruck.ru
chiptuninger.com chiptuninger.com
chocolateslim-u-srbiji.com chlooe.com
chocoslim.pro cibpenonptib.flu.cc
christianlouboutinreplica.win clean-start.net
cinemaflix.website clickbank.net
cleanpcnow.com cocyq.inwtrade.com
clevernt.com colobit.biz
clickzzs.nl com-onlinesupport.host
clips.ua.ac.be compliance-mark.top
co.lumb.co contentlook.co
collegeessay19.blogspot.ru coprofam.org
cometorussia.net coslab.club
compliance-alex.top cosmetic.donna7753191.ru
coolwallpapers-hd.com cscwtalkto.site
copblock.org cxpromote.com
cpajunkies.com cymbaltaandtizanidine.blogspot.com
crest-poloski.ru dailystrength.org
d0t.ru decorazilla.com
dalavia.ru delayreferat.ru
danschawbel.com delitime.info
dating-app.ru deshevo-nedorogo.ru
datsun-do.com destinationrealestate.com
db.speedup.gdn dev.citetick.com
dekoration.us
dfiles.me dfiles.me
dieswaene.com dfwu1013.info
digilander.libero.it dgfitness.co
dinkolove.ya.ru diamond-necklace.info
discountbarbour.online digital-video-processing.com
distver.ru dipstar.org
dollartree.info dlya-android.org
domashneeruporno.com domain.webkeyit.com
dorratex.tn domain2008.com
downloadeer.net domainanalyzing.xyz
doxyporno.com domaincheck.io
easyukraine.com downloadkakaotalk.com
edwinkonijn.com.au draniki.org
ee77ee.com drivotracker.com
drunkenstepfather.com
duawitchrarato.tk
dvervmoskvu.ru
e-biznes.info
e-c.al
ege-russian.ru
ekspresihati.info
electro-prom.com
elektrischezigarette1.blog.pl elektrischezigarette1.blog.pl
elektronischezigarettekaufen1.beeplog.com elektrozigaretten1.webs.com
elektrozigaretten2.yn.lt elidelcream.weebly.com
elvel.com.ua elkacentr.ru
energydiet-info.ru elstal.com.pl
enews.tech elvenmachine.com
engines-usa.com emergencyneeds.org
englishgamer.com englate.com
eonpal.com etm-consult.de
eropho.com eugenevaultstorage.com
europeanwatches.ru
eurosamodelki.ru
evehemming.blogspot.com.au evehemming.blogspot.com.au
exct.net executehosting.com
exmasters.com exonline.info
ezigarettenkaufen1.pagina.gr ezigarettekaufen2.mpbloggar.se
f1nder.org ezigarettekaufen2.yolasite.com
f5mtrack.com ezigarettenkaufen2.dreamwidth.org
failingmarriege.blogspot.com facebook-mobile.xyz
fandlr.com facecup.top
feorina.ru fakehandbags.xyz
fidelityfunding.com falopicm.pw
findclan.org fanoboi.com
finemanteam.com farm26.ru
finteks.ru farmingworm.com
fishingwholesale.us feargames.ru
flashlarevista.com felizporno.com
forexgb.ru fermersovet.ru
fortwosmartcar.pw fettefrauen.net
fotzen-ficken.com figuringmoneyout.com
free-share-buttons.top filefilter.weebly.com
free-stock-illustration.com floridamobilebillboards.com
freegamesplay.online flytourisme.org
freewhatsappload.com foodgid.net
frustrated-favorable.gq fordsonmajbor.cf
fuel-gas.com forexunion.net
fxgallery.com foxweber.com
franecki.net
free411games.com
freelinkbuilding.website.tk
freetangodownload.com
futbolkisales.ru
fyl.com.ru fyl.com.ru
gamedayassist.com gazporno.com
gameonasia.com gelezki.com
gate5.co.za gepezz.info
gaz-voshod.ru gilbertbanda.net
geilehausfrauen.net glasof.es
get-free-traffic-now.com gogalleryawesome.com
getpopunder.com gotwebsite1.com
gg.zzyjxs.com greatidea.marketing
girlgamerdaily.com greenzaim.ru
girlspicsa.com gta-club.ru
go2album.com guardlink.com
gobongo.info guildebzh.info
gojiberriess.apishops.ru hacktougroup.ru
gonextmedia.com hatdc.org
goodly.pro hd-film.pl
grtyi.com heroz.fr
gtopstats.com hidemyass.com
habermetre.com histats.com
hatedriveapart.com hit-kino.ru
headpharmacy.com hitcpm.com
healgastro.com home-task.com
healthcarestore.info homedecoguide.info
hidefiles.org homemature.net
highstairs-a.akamaihd.net hop.clickbank.net
hit-men.men housediz.com
homik.pw howmuchdoestizanidinecost.blogspot.com
hopeonthestreet.co.uk hybrid.ru
hoporno.com iccornacircri.cf
hplaserjetpdriver8y.pen.io igadgetsworld.com
hunterboots.online iinstalll-fii1leis.jus0wil.pp.ua
hyipmanager.in images-free.net
iboss.com incep.imagine-ex.co
ideawheel.com infobanks.ru
iframe-toloka.com infokonkurs.ru
ikearugs.xyz insurple.com
imediadesk.com internetartfair.com
immobiliaremassaro.com intimshop-fantasy.ru
infoupdate.org ipornox.xxx
infowarcraft.ru iron-age.info
inome.com.ua isitwp.com
instabid.tech ispaniya-costa-blanca.ru
interior-stickers.ru itch.io
ipostroika.ru izismile.com
iqbazar.ru
irunfar.com
ispac.org
istizanidineanarcoticdrug.blogspot.com
istizanidineanopiate.blogspot.com
itservicesthatworkforyou.com
izhevsk.xrus.org
javitas.info
javrip.net javrip.net
jewelryandfiligree.com jerseysbizwholesalecheap.com
jolic2.com jerseyssportsshop.com
junketjuice.blogspot.com jerseywholesalechinabiz.com
jyvopys.com jikoman.info
kamalsinha.com jjbabskoe.ru
karadene.com jo24news.com
kazrent.com jofucipiku.tk
johnnyhaley.top
juliaworld.net
kerch.site kerch.site
kino-filmi.com kerwinandcariza.com
kino-fun.ru keywordspay.com
kinostorm.net kinocccp.net
kletkimehan.ru kiwe-analytics.com
kometars.xyz kleine-titten.biz
krasivye-devushki.net klosetkitten.com
krasnodar-avtolombards.ru kopihijau.info
krasnodar.xrus.org kosynka-games.ru
kvartir-remont.biz kovesszucs.atw.hu
landreferat.ru kupit-adenu.ru
landscaping.center labelwater.se
le-clos-des-alouettes.com lacasamorett.com
leboard.ru larger.io
letolove.ru larutti.ru
lexiangwan.com lenvred.org
lifebyleese.com lescinq.com
lignofix.ua life.biz.ua
linerdrilling.com lightinghomes.net
linkrr.com limads.men
littlecity.ch linkbolic.com
littlesexdolls.com lion.snapmap.us
live-cam6.info
liveinternet.ru liveinternet.ru
liveshoppersmac.com livesex-amateure.info
lkbennettstore.online locimge.pw
louisvuittonoutletstore.net loginduepunti.it
love-baby.cz lostaruban.com
lovelycraftyhome.com lulea-auktionsverk.se
mainlinehobby.net lunamedia.co
map028.com m1media.net
marmitaco.cat magnetic-bracelets.ru
mature.free-websites.com mall.uk
mebelcomplekt.ru me-ke.com
megaindex.ru meget.co.za
menetie.ru metafilter.com
mere.host.sk micasainvest.com
metabar.ru
microstatic.pl microstatic.pl
mirmedinfo.ru mir-limuzinov.ru
missclub.info misslike.ru
modenamebel.ru misterjtbarbers.com
mossmesi.com mnogolok.info
mowser.com mobicover.com.ua
musicpro.monster monclercoats.xyz
mustat.com moneyzzz.ru
myfreetutorials.com montredemarque.nl
myiptest.com more-letom.ru
mylovelibrabry.com mosdverka.ru
myra.top mrbojikobi4.biz
mywallpaper.top muabancantho.info
netvouz.com mvpicton.co.uk
newfilmsonline.ru mylesosibirsk.ru
mystats.xyz
nac-bearings.ru
napalm51.nut.cc
narutonaruto.ru
naturalpharm.com.ua
nero-us.com
news-readers.ru
newstraveller.ru
nextlnk12.com
nextrent-crimea.ru nextrent-crimea.ru
ngps1.ru nicovideo.jp
nicefloor.co.uk
nikkiewart.ru
nmrk.ru
no-rx.info no-rx.info
notebook-pro.ru noclegonline.info
o-dachnik.ru nordstar.pro
odoratus.net novosibirsk.xrus.org
nrv.co.za
nuker.com
o333o.com
oakleyglassesonline.us
of-ireland.info of-ireland.info
offer.wpsecurity.website office2web.com
office-windows.ru officedocuments.net
offtopic.biz offtopic.biz
onlinemegax.com olgacvetmet.com
onlyforemont.ru onefilms.net
onlineku.com
onlineslotmaschine.com
onlinewritingjobs17.blogspot.ru
ooomeru.ru ooomeru.ru
optibuymac.com open-odyssey.org
optitrade24.com openmultipleurl.com
ostroike.org oynat.info
oxotl.com oyster-green.com
paccohichetoti.ml pacificair.com
paceform.com paidonlinesites.com
paighambot.com panchro.co.uk
patterntrader-en.com partner-cdn.men
paydayonlinecom.com pateaswing.com
pdns.download patol01.pw
pendelprognos.se pcboa.se
perm.xrus.org perso.wanadoo.es
phobia.us petedrummond.com
photostudiolightings.com phormchina.com
php-market.ru picturesboss.com
phuketscreen.com picturesmania.com
piccdata.com
pictures-and-images.net
pinwallpaper.top pinwallpaper.top
pisanieprac.info pistonclasico.com
pizza-imperia.com pladform.ru
pkr1hand.com platezhka.net
play-movie.pl pochtovyi-index.ru
ploenjitmedia.azurewebsites.net pogodnyyeavarii.gq
poffet.net pokemongooo.ml
pony-business.com polcin.de
popmarker.com popunder.ru
porndl.org pornoelita.info
porno-transsexuals.ru pornoplen.com
pornofiljmi.com pornowarp.info
pornoklad.net portadd.men
pornoted.com powenlite24.ru
pospr.waw.pl powitania.pl
predominant-invent.tk prostitutki-rostova.org
privatbank46.ru prostitutki-yaroslavlya.org
pro-okis.ru proxyelite.biz
profitsport.club pushdata.sendpulse.com
pxhdwsm.com puteshestvennik.com
q-moto.ru quebec-bin.com
quick-seeker.com questionmarque.ch
qwesa.ru raavidesigns.com
ranksonic.org randalljhoward.com
rankscanner.com
rcpmda.ikan1080.xyz
realitykings.com
realmonte.net realmonte.net
replicaclub.ru realting-moscow.ru
respublica-otel.ru registry-clean-up.net
restaurantlescampi.com relayblog.com
rff-cfal.info remontgruzovik.ru
richinvestmonitor.com remorcicomerciale.ro
riders.ro renecaovillasale.online
rn-to-bsn.com robot-forex.biz
rockingclicks.com rocis.site
rosbalt.com.ua rockprogblog.com
roznica.com.ua roleforum.ru
ru-dety.ru rome2rio.com
ru-mediaget.ru running-line.ru
rubanners.com ruspdd.com
rubbed.us sadaholding.com
ruscoininvest.company satoristudio.net
sack.net sbornik-zakonov.ru
sammyweaver.com schalke04fc.info
samolet.fr schoolfiles.net
sanjosestartups.com
sankt-peterburg.nodup.ru
sardinie.us
saveriopiazza.it
sbwealthsolutions.ca
scalerite.co.za
scanmarine.info
scanner-barak.top
scanner-donald.top
scanner-ivan.top
scanner-jess.top
scanner-julianna.top
scansafe.net
scrapy.org
screentoolkit.com screentoolkit.com
sdsjweb.com scripted.com
searchwebknow-a.akamaihd.net scrnet.biz.ua
seasaltwithfood.com search-error.com
secret.xn--oogle-wmc.com search.pch.com
secretscook.ru searchencrypt.com
sell-fb-group-here.com semp.net
semprofile.com senger.atspace.co.uk
seocheckupx.com seo-prof1.xyz
servethis.com seojokes.net
sexblog.pw seorankinglinks.xyz
sexgalleries.top sexgalleries.top
sexy.babes.frontend-stack.top sexsearch.com
shareyards.com shama-rc.net
shodanhq.com shitting.pro
shopsellcardsdumps.com shopcheermakeup.info
shopvilleroyboch.com.ua sibtest.ru
signal03.ru sicfor.bcu.cc
signoredom.com sientalyric.co
sispe.com.br simply.net
site-auditor.online sisi-go.ru
siteaero.com sisiynas.ru
slujbauborki.ru site.ru
small-games.biz site5.com
smallseotools.com social-s-hhh.xyz
soaksoak.ru soviet-portal.do.am
soc-proof.su space4update.pw
spacash.com special-porn.com
start.myplaycity.com spinazdrav.ru
stockspmb.info srdrvp.com
streetfooduncovered.com stairliftstrue.com
stroymonolit.su standardchartered-forex.com
studiofaca.com stanthonyscatholicchurch.org
superkanpo.com streha-metalko.si
surflinksmedical.com students-cheapskate.ml
svarbit.com sucsesofinspiration.com
swagbucks.com superlist.biz
t-bygg.com svolze.com
tacbelarus.ru svtrd.com
tasteidea.com t3chtonic.com
technopellet.gr taihouse.ru
tengohydar.tk telefonsexsofort.tk
thegioixekhach.com terraclicks.com
theheroes.ru thenews-today.info
thexart.club thetoiletpaper.com
thfox.com tiens2010.ru
tizanidineandcipro.blogspot.com titan-cloud.life
tizanidineforopiatewithdrawal.blogspot.com tizanidinehcl2mg.blogspot.com
tizanidinehcl2mgtablet.blogspot.com tizanidinenarcotic.blogspot.com
tizanidinehydrochloride2mg.blogspot.com tizanidinestreetvalue.blogspot.com
tizanidineingredients.blogspot.com top10-way.com
tjkckpytpnje.com topclickguru.com
tootoo.to toproadrunner5.info
topdownloads.ru topsiteminecraft.com
topmira.com torrent-to-magnet.com
topsy.com torrents.cd
tozup.com toy-shop.top
trafficmonetize.org toyota.7zap.com
trubywriting.com triplepanda.xyz
trustedmaccleaner.com trk-4.net
tube8.com tx41tclega.ru
tuberkuleznik.ru uggsale.online
tuckpointingmasonrysystems.com ukrobstep.com
twittruth.com unacittaconte.org
twodollarshows.com
ua.tc
ucsol.ru
ugogo.info
ukkelberg.no
undergroundcityphoto.com undergroundcityphoto.com
universals.com.ua uogonline.com
unpredictable.ga urldelivery.com
urdoot.win vabasa.inwtrade.com
vbabule.net validccseller.com
vbikse.com
vektorpress.ru
vezuviy.su vezuviy.su
viagra-soft.ru
viagroid.ru
video-woman.com video-woman.com
vip-file.com vietimgy.pw
vitanail.ru vipromoffers.com
vitoriacabos.com
viveresaniesnelli.it viveresaniesnelli.it
voditeltrezviy.ru vizitki.net
voloslove.ru voloomoney.com
vrotike.ru vostoktrade.info
vseigru.one vozbujdenie.com
vzlom-na-zakaz.com vtc.pw
vzube.com vtcdns.com
watchmygf.net vzlomfb.com
webcamdevochka.com wallpapersist.com
wesharepics.com webs.com
westvilletowingservices.co.za websiteaccountant.de
whiteelephantwellington.com wedding-salon.net
witherrom55.eklablog.fr wholinkstome.com
woman-orgasm.ru wingsofrefuge.net
woman-h.ru
womensterritory.ru
wordkeyhelper.com
wordpresscore.com wordpresscore.com
wstroika.ru writersgroup580.web.fc2.com
www.pinnacle-bets.com www.bookmaker-bets.com
x-diesel.biz xaijo.com
x-stars.ru xn--80abgj3a5acid6ghs.top
xbaboon.com xn--hxazdsfy.blogspot.com
xclicks.net xvideosbay.com
xfire.com xxx-treker.ru
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai xxxmania.top
xn----7sbbahaq9bb5afgiqfliv4m.xn--p1ai
xn----8sbarihbihxpxqgaf0g1e.xn--80adxhks
xn----8sblgmbj1a1bk8l.xn----161-4vemb6cjl7anbaea3afninj.xn--p1ai
xn--h1ahbi.com.ua
yaaknaa.info yaaknaa.info
yes-com.com yeartwit.com
yogamatsexpert.com yellowstonevisitortours.com
yoluxuryevents.com yourads.website
ytmnd.com yourtemplatefinder.com
zaimite.ru zaloro.com
zatjmuzu.info zapiszto.pl
zawyna.ua zeg-distribution.com
zigarettenonlinekaufen1.bloog.pl zixizop.net.ru
znakomstvaonlain.ru znakomstva-moskva77.ru
znaniyapolza.ru
zona-aqua.ru
zoosexart.com zoosexart.com
zvuker.net zrelaya.pw
zvetki.ru

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
100dollars-seo.com 0912701309f8ce.com
1adult.com 108shot.com
21h2o.com 40cg.com
2nt.ru aa14ab57a3339c4064bd9ae6fad7495b5f.com
aab94f698f36684c5a852a2ef272e031bb.com abctoppictures.net
acheterviagrafr24.com advocatemsk.ru
addblueoff.com.ua adzpower.com
adloads.com allblogroll.com
adpremium.org amazon-seo-service.com
ahrefs.com anlimebel.kiev.ua
alarmobninsk.ru anonymousfox.co
alert-fjg.xyz anti-virus-removal.info
alldubai.biz api.stathat.com
apiluckyleapnet-a.akamaihd.net artdeko.info
appmsr.org aviav.ru
arquivo.pt avon-ukraine.com
auto.rusvile.lt avtovolop.ru
ayakino.net axbocz.net
b-styles.xyz azartmix.com
back.dog azbaseimages.net
bannerpower.com bagcionderlab.com
bbsoldes.fr bedcapdealers.com
bestpriceninja.com beget.tech
besttorrentknifta.weebly.com best-mam.ru
beta.hotkeys.com bestwebsiteawards.com
betune.onlinewebshop.net big-cash.net
bizzliving.com blog.axant.it
blackhatworth.com brus-vsem.ru
bloggerads.net buchananshardware.com
blogporn.in buyk.host.sk
bolitgorlo.net byme.se
bonky.biz cacheimages.com
bradleylive.xyz cakesplus.com.au
brk-rti.ru candy-glam-hp.com
buketeg.xyz cardsharp1.ru
burger-imperia.com cardul.ru
businesxxl.com carrauterie.be
butstrap.space cartierloveringreplica.xyz
callcafe.info caulderwoodkennels.com
calstaterealty.us cheapwebsitehoster.com
cartierreplica.win chee-by.biz
cartierwatch.xyz chocolateslim-u-srbiji.com
cialisovercounteratwalmartusa.com cialis-samples.com
cjs.com.ru click2pawn.com
classiquebijoux.ru counter.bloke.com
cleanpcnow.com cpabegins.ru
cobaltpro.ru cubs-jerseys.us
cognitiveseo.com dalavia.ru
compliance-ivan.xyz dbmkfhqk.bloger.index.hr
consorzioilmosaico.org ddlmega.net
culmimg.pw dealitright.click
cwetochki.ru dentfidemountpreach.tk
dafatiri.com destinationrealestate.com
deanmoore.ie e-commerce-seo1.com
dev-seo.blog easync.io
dostavimvdom.ru easytuningshop.ru
droidlook.net elektrischezi.canalblog.com
ecommerce-seo.org essayassist.com
elektrozigarette1.dreamwidth.org evaashop.ru
elkacentr.ru everytalk.tv
euroskat.ru exci.ru
falcoware.com fireads.men
fast-wordpress-start.com floridamobilebillboards.com
femmesdenudees.com
fickkontakte.org
fitnesspiks.com
flashlarevista.com
free-fb-traffic.com
free-fbook-traffic.com
freeseedsonline.com freeseedsonline.com
frivgame250.com freshsuperbloop.com
fz139.ttk.ru frustrated-favorable.gq
gameplexcity.com fungamelands.com
get-free-traffic-now.com funponsel.com
getprismatic.com gallictures.com
girlspicsa.com gamesprite.me
goodnightjournal.com glass-msk.ru
gosarhivrt.ru glicol.kz
grizzlysgrill.com goldandcard.ru
gsou.cf goo.ne.jp
hauleddes.com gz2.bbsoldes.fr
hayate.biz handicapbathtubarea.com
hd720kino.ru hcate.com
hdapp1008-a.akamaihd.net hd-film.pl
healmytrauma.info heliko.no
hoholikik.club hotsocialz.com
hopeonthestreet.co.uk humanelydrew.com
hoverboard360.es hvd-store.com
hscsscotland.com hyhj.info
humbmosquina.tk i4track.net
hunthillfarmtrust.org idc.com.ua
iblogpress.xyz intimshop-fantasy.ru
ictizanidinehcl4mg.blogspot.com invest-pamm.ru
imagez.co iwantmyfreecash.com
inclk.com ixora.pro
infektsii.com jamiembrown.com
instakink.com jyrxd.com
isitwp.com kchaxton.com
jennyfire.ru kerei.ru
johannesburgsingles.co.za keywords-monitoring-your-success.com
keywordglobal.co.za kinobaks.com
kinoflux.net ks1234.com
kinogonew.ru laapp.com
knogg.net lacave.ntic.fr
konkursowo-24.pl laparfumotec.com
laexotic.com laserpen.club
lerporn.info lirunet.ru
letsart.ru littlesunraiser.com
lion.bolegapakistan.com louboutinreplica.xyz
lion.snapmap.us lulea-auktionsverk.se
live-sexchat.ru maxxtor.eu
liveinternet.ru mega-bony2017.pl
liver-chintai.org metaxalonevstizanidine.blogspot.com
livetsomudvekslingstudent.bloggersdelight.dk minecraft-rus.org
lovi-moment.com.ua mirzonru.net
m.b00kmarks.com moesexy.com
machicon-akihabara.info moinozhki.com
mall.uk mojowhois.com
matchpal-a.akamaihd.net mp3s.club
mbiologi.ru music7s.me
migente.com myanyone.net
mini.7zap.com mydeathspace.com
mnimmigrantrights.net na-telefon.biz
mobicover.com.ua narkologiya-voronezh.ru
mobile-appster.ru
mobilierland.com
mojpregled.com
mojpreskumanie.com
monclercheap.xyz
mossmesi.com
moz.com
mug-na-chas-moscow.ru
muzaporn.com
myfreecams.com
namenectar.com
napalm51.nut.cc
naval.jislaaik.com
neobux-bg.info neobux-bg.info
new7ob.com nhl17coins.exblog.jp
nightvision746.weebly.com nikitabuch.com
northfacestore.online nippon-bearings.ru
novodigs.com normalegal.ru
novosti-hi-tech.ru novosti-hi-tech.ru
nsatc.net nw-servis.ru
nuit-artisanale.com o-o-11-o-o.com
onefilms.net obiavo.by
onlinetvseries.me officedocuments.net
ons-add.men omsk.xrus.org
ownshop.win online-hd.pl
pagesense.com online247.ml
parfusale.se optom-deshevo.ru
partner-host.men pay2me.pl
partnerline.men pdfprof.com
pastaleads.com percin.biz.ly
pensplan4u.com picturesmania.com
petrovka-online.com pizdopletka.club
physfunc.ru playtap.us
picscout.com pliks.pl
picurams.pw popunder.net
popmarker.com popunder.ru
porno-home365.com popup-hgd.xyz
pornohub.me pornohd1080.online
pornotubs.com portadd.men
pourvous.info portal-eu.ru
prefersurvey.net postclass.com
privacyassistant.net prom23.ru
proxyradar.com promoforum.ru
pulseonclick.com pulse33.ru
quit-smoking.ga rangoman.date
rabotaetvse.ru rapevideosmovies.com
raisedseo.com rapidokbrain.com
rank-checker.online redirectingat.com
remote-dba.de regionshop.biz
remont-ustanovka-tehniki.ru
remontgruzovik.ru
renecaovillasale.online
responsinator.com responsinator.com
rimedia.org rubbed.us
rocis.site russkoe-zdorovie.ru
russia-tao.ru saecsa.co
saltspray.ru samolet.fr
sanatorrii.ru scanner-brian.top
sbdl.no senger.atspace.co.uk
scanner-alexa.top seo-prof1.xyz
searchimpression.com seobility.net
seo18.su sethrollins.net
serptehnika.ru sexpartygirls.net
sfd-chess.ru shisha-swag.de
shakhtar-doneck.ru shop.xz618.com
sharebutton.net simul.co
signoredom.com site-auditor.online
silverage.ru siteimprove.com
snip.to sledstvie-veli.net
soietvousmaime.fr slowmacfaster.trade
sovinsteel.ru smadihome.com
spamnuker.com smailik.org
sr-rekneskap.no smartbalanceworld.com
steelmaster.lv snegozaderzhatel.ru
strag-invest.ru snowplanes.com
stroy-portal22.ru sobecjvuwa.com.ru
surflinksmedical.com soheavyblog.com
svetlotorg.ru spymac.net
szamponrevita.pl spywarespy.com
tecnoteakviareggio.it start.myplaycity.com
telegraf.by stathat.com
templates.radiodigital.co stmassage.ru
stroimajor.ru
studiofaca.com
sudexpert66.ru
svnuppsalaorebro.se
tacbibirfa.tk
tarad.com
tattoo33.ru
tdsing.ru
tengohydar.tk tengohydar.tk
the-torrent-tracker.blogspot.com tetracsaudi.com
thenetinfo.com thefarmergame.com
theplacetoupdating.pw thewebsitetemplate.info
thetattoohut.com tizanidine4mgstreetprice.blogspot.com
tizanidinecost.blogspot.com tizanidine4mguses.blogspot.com
tizanidinedrugtest.blogspot.com tizanidinehcl2mgtablet.blogspot.com
tizanidinehcl4mgtab.blogspot.com tizanidinehcl4mgtablet.blogspot.com
tizanidineonline.blogspot.com tizanidineshowupondrugtest.blogspot.com
tizanidinepills.blogspot.com tizanidinesideeffectsweightloss.blogspot.com
tizanidinesleepaid.blogspot.com tksn.ru
top-l2.com tn811.us
trkur.com topflownews.com
tubeline.biz topquality.cf
twittruth.com toxicwap.com
ukkelberg.no trainoffend.ml
ukrup.com treasuretrack-a.akamaihd.net
unlimitdocs.net tryrating.com
unrealcommander.org uhdtv.website
usdx.us usdx.us
validccseller.com uytmaster.ru
varikoz24.com v24s.net
varbergsvind.se
vbikse.com vbikse.com
videonsk.com venerologiya.com
vkonche.com viddyoze.com
voluumtracker1.com video-chat.cn
w7s.ru vielporno.net
wanker.us vod.com.ua
watracker.net volume-pills.biz
webmonetizer.net voluumtrk.com
wowcasinoonline.ooo vsesubwaysurfers.com
www.timer4web.com vsexkontakte.net
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai vykup-avto-krasnodar.ru
xn--80ahdheogk5l.xn--p1ai warningwar.ru
xn--h1ahbi.com.ua waterpurifier.club
xvideosbay.com watsonrealtycorp.com
xxxrus.org wdfdocando.com
xzlive.com wejdz-tu.pl
yaoguangdj.com wheelchairliftsarea.com
yatrk.xyz whereverdesperate.gq
yoshkarola.zrus.org winner7777.net
you-shall-not-pass.is74.ru workle.website
yubikk.info works.if.ua
zeikopay.com x5market.ru
zigarettenonl.canalblog.com xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai
znakomstva-moskva77.ru xn--80aikhbrhr.net
zrelaya.pw xn--l1aengat.xn--p1ai
xnxx-n.com
yougame.biz
yougetsignal.com
ypmuseum.ru
zaimite.ru
zhacker.net
zkjovpdgxivg.ga

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.61 0; 10.1.0.13 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2992 ### Version: V4.2022.03.2993
### Updated: Mon Mar 21 10:03:21 UTC 2022 ### Updated: Mon Mar 21 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2992 ### Version: V4.2022.03.2993
### Updated: Mon Mar 21 10:03:21 UTC 2022 ### Updated: Mon Mar 21 22:01:21 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##