vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 15:34:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3019 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-02 22:07:08 +00:00
parent 63de39b8fe
commit f2bbea613e
46 changed files with 77850 additions and 77850 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3018 #### Version: V4.2022.04.3019
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3018 #### Version: V4.2022.04.3019
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3018 #### Version: V4.2022.04.3019
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9596
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3018 #### Version: V4.2022.04.3019
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9600
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9600
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9600
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9600
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3018 3019

9600
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9600
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.162.154 0; 20.228.175.9 0;

9600
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

9600
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.162.154 0; 20.228.175.9 0;

9600
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.69.162.154 0; 20.228.175.9 0;

9600
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 1; 10.1.1.162 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BackStreet Crescent
CyotekWebCopy Iblog
FHscan MarkMonitor
Mr.4x3 Pimonster
NPbot Quick-Crawler
Offline Navigator SalesIntelligent
RankurBot Shodan
ScanAlert WebFetch
Web Pix WebSucker
sogouspider seoscanners

326
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com
360Spider 360Spider
AIBOT 404enemy
ASPSeek ADmantX
Abonti
Aboundexbot
Acunetix Acunetix
AfD-Verbotsverfahren AfD-Verbotsverfahren
AllSubmitter AiHitBot
AlphaBot AlphaBot
Anarchy99
Ankit Ankit
Anthill Aspiegel
Apexoo Asterias
Atomseobot Attach
AwarioSmartBot BBBike
BDCbot
BDFetch BDFetch
BLEXBot
BackDoorBot
BackWeb BackWeb
Badass Backlink-Ceck
Bandit Bandit
Barkrowler Barkrowler
Battleztar Bazinga BatchFTP
BetaBot BetaBot
Bitacle Bigfoot
Black Hole Blow
Blackboard Boardreader
Bolt BuzzSumo
BotALot
BuiltBotTough
BunnySlippers
CATExplorador
CCBot CCBot
CherryPicker CazoodleBot
ChinaClaw Cegbfeieh
Claritybot Claritybot
Cliqzbot
Cocolyzebot Cocolyzebot
Collector Copier
Copyscape Copyscape
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
CrunchBot CrunchBot
Curious
Custo Custo
CyotekWebCopy DatabaseDriverMysqli
DSearch Deusu
DTS Agent
DataCha0s
Demon
Devil
DigitalPebble DigitalPebble
Disco
Discobot Discobot
DittoSpyder DittoSpyder
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DnyzBot
DomCopBot DomCopBot
DomainCrawler
DomainStatsBot DomainStatsBot
Domains Project
Dotbot
EMail Siphon
EMail Wolf EMail Wolf
EasyDL EasyDL
Ebingbong
EroCrawler EroCrawler
Evil Express WebPictures
ExtLinksBot
Extractor Extractor
Ezooms ExtractorPro
FHscan Extreme Picture Finder
Firefox/7.0 EyeNetIE
Foobot FDM
FlashGet
FrontPage FrontPage
FyberSpider Fuzz
Fyrebot GT::WWW
GalaxyBot Genieo
GermCrawler
GetRight GetRight
GetWeb Gigabot
Getintent GridBot
Go!Zilla HEADMasterSEO
GoZilla HMView
Grabber
Grafula
GrapeFX
HTMLparser
HTTP::Lite
Haansoft Haansoft
Havij IDBot
Heritrix Id-search
Hloader IlseBot
HybridBot IndeedBot
IDBTE4M Indy Library
IRLbot Intelliseek
Image Fetch InterGET
Image Sucker Iria
InfoNaviRobot JamesBOT
IstellaBot Jbrofuzz
JOC Web Spider
JennyBot JennyBot
JetCar JetCar
Jetty Kenjin Spider
Jyxobot
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Kozmosbot LWP::Simple
LNSpiderguy Lanshanbot
LeechFTP LeechFTP
LexiBot Lftp
LibWeb
Lightspeedsystems
LinkScan LinkScan
LinkWalker LinkpadBot
Linkbot
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
Lipperhey LinqiaScrapeBot
Lipperhey Spider
Lmspider Lmspider
MFC_Tear_Sample MIDown tool
MTRobot MIIxpc
Mata Hari MJ12bot
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic-SEO
Mb2345Browser Mb2345Browser
MeanPath Bot MicroMessenger
MegaIndex.ru Microsoft Data Access
Metauri Moblie Safari
Minefield Mojolicious
Mozlila Msrabot
Mr.4x3
NICErsPRO NICErsPRO
NPbot NPbot
Name Intelligence Nameprotect
Navroad Navroad
NearSite NearSite
Needle
NetLyzer NetLyzer
Netcraft NextGenSearchBot
Nettrack
Netvibes
Niki-bot Niki-bot
Nikto Nikto
Ninja Ninja
Nutch Nuclei
Octopus Octopus
OnCrawl OpenLinkProfiler
OpenVAS OpenVAS
OutclicksBot OutclicksBot
OutfoxBot POE-Component-Client-HTTP
PECL::HTTP PageAnalyzer
PageThing.com PageGrabber
Pandalytics Petalbot
PeoplePal Picsearch
Picscout Piepmatz
PictureFinder Pimonster
Pixray Probethenet
ProPowerBot
Psbot Psbot
Pu_iN Pu_iN
Pump QueryN Metasearch
PxBroker RSSingBot
RankActive RankActiveLinkBot
RankingBot RankFlex
Re-re RankingBot2
RealDownload
RebelMouse RebelMouse
SEOlyticsCrawler RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOprofiler
SMTBot SMTBot
SalesIntelligent SalesIntelligent
ScanAlert Scanbot
ScoutJet ScoutJet
Seekport Scrapy
ScreenerBot
Searchestate
Semrush Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Shodan
Siphon Siphon
Site Sucker Site Sucker
Sitevigil SiteLockSpider
Snapbot SiteSucker
Sociscraper Sitebeam
Sottopop Siteimprove
SmartDownload
Snake
Snoopy
SpaceBison
Spammen Spammen
SpankBot
Spanner Spanner
Spbot Spbot
Spinn3r
Sqlmap Sqlmap
Sqworm Sqworm
Steeler
Stripper Stripper
SurveyBot Sucker
Suzuran SuperHTTP
Swiftbot
T0PHackTeam T0PHackTeam
T8Abot Telesoft
The Intraformant Telesphorep
TheNomad TheNomad
Thumbor Toweyabot
Titan
Toata
Trendictionbot
Turingos Turingos
Turnitin
TwengaBot TwengaBot
Upflow Twice
VB Project Typhoeus
Vacuum URLy.Warning
VelenPublicWebCrawler VCI
Vagabondo
VidibleScraper VidibleScraper
Virusdie
VoidEYE VoidEYE
Voil
Voltron Voltron
WBSearchBot WWW::Mechanize
WEBDAV WWWOFFLE
WISENutbot Wallpapers
WPScan WeSEE
WWW-Mechanize Web Collage
Web Sucker Web Enhancer
WebCollage Web Fetch
Web Pix
WebBandit
WebCopier WebCopier
WebFetch
WebGo IS WebGo IS
WebSauger
WebStripper WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wonderbot Wonderbot
Xaldon WebSpider Wotbox
Zauba Xaldon_WebSpider
Zermelo YoudaoBot
Zeus
Zitebot Zitebot
ZoomBot ZoominfoBot
archive.org_bot ZumBot
cah.io.community arquivo-web-crawler
clark-crawler autoemailspider
cognitiveseo backlink-check
com.plumanalytics crawl.sogou.com
crawler4j crawler4j
demandbase-bot
domainsproject.org
eCatch eCatch
heritrix gopher
isitwp.com ips-agent
lwp-request lwp-request
mediawords lwp-trivial
magpie-crawler
meanpathbot
oBot
page scorer page scorer
pcBrowser
plumanalytics
polaris version polaris version
probe-image-size ripz
scalaj-http s1z.ru
scan.lol scan.lol
seostar seocompany.store
sitechecker.pro serpstatbot
siteripz siteripz
spyfu tAkeOut
voyagerx.com trendiction.com
webgains-bot trendiction.de
ubermetrics-technologies.com
webmeup-crawler webmeup-crawler
webpros.com webprosbot
x09Mozilla x09Mozilla
xpymep1.exe

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
ADmantX 01h4x.com
Abonti 360Spider
ALittle Client
Aboundex Aboundex
Aboundexbot
AfD-Verbotsverfahren AfD-Verbotsverfahren
Alexibot AiHitBot
Alligator
Anarchie Anarchie
Anarchy
Anarchy99 Anarchy99
Ankit Ankit
Anthill Anthill
Aspiegel
Asterias Asterias
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDCbot BDFetch
BLEXBot
BackStreet BackStreet
BackWeb
BacklinkCrawler BacklinkCrawler
Battleztar Bazinga Badass
Black Hole Barkrowler
BatchFTP
BetaBot
Bigfoot
BlackWidow BlackWidow
Boardreader BlowFish
Bolt
BotALot
Brandprotect Brandprotect
Brandwatch Brandwatch
Buck Buddy
BuiltWith
Bullseye
BunnySlippers BunnySlippers
BuzzSumo Calculon
CATExplorador CheeseBot
CODE87 ChinaClaw
CSHttp Citoid
CheTeam Claritybot
CherryPicker Cliqzbot
Copier Cogentbot
CopyRightCheck CopyRightCheck
Copyscape Copyscape
Crawling at Home Project Crescent
CrazyWebCrawler
DBLBot DBLBot
DIIbot DIIbot
Demon DSearch
Devil DataCha0s
DatabaseDriverMysqli
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot Discoverybot
DittoSpyder
DnyzBot DnyzBot
DomCopBot
DomainAppender DomainAppender
Domains Project DomainCrawler
Dotbot
Download Wonder Download Wonder
ECCP/1.0 Dragonfly
EMail Wolf Ebingbong
Ecxi Ecxi
EroCrawler
Evil Evil
Exabot Exabot
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extractor
FHscan Ezooms
Flunky FemtosearchBot
Foobot Fimap
Fyrebot Firefox/7.0
G-i-g-a-b-o-t FyberSpider
GT::WWW GT::WWW
GalaxyBot
Genieo Genieo
GetRight
GetWeb
Getintent Getintent
Gigabot Go!Zilla
Go-Ahead-Got-It HEADMasterSEO
Grabber HMView
GrapeFX HTTrack
HTTP::Lite HaosouSpider
Harvest HonoluluBot
Heritrix
HybridBot HybridBot
IDBTE4M IRLbot
Iblog Iblog
Id-search Id-search
IndeedBot IndeedBot
InfoTekies InfoNaviRobot
Internet Ninja Jetty
InternetSeer
IstellaBot
Jbrofuzz
JennyBot
JetCar
JikeSpider
Joomla Joomla
Jorgee
JustView
Kenjin Spider
Keybot Translation-Search-Machine Keybot Translation-Search-Machine
Keyword Density
Kinza
Kozmosbot Kozmosbot
Leap Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot LexiBot
LibWeb Lftp
Libwhisker
Likse
LinkScan LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot LinkpadBot
LinksManager LinqiaRSSBot
LinqiaMetadataDownloaderBot Lipperhey
LinqiaScrapeBot
Lipperhey Spider
Lmspider Lmspider
Ltx71 Ltx71
MIDown tool MFC_Tear_Sample
MIIxpc
MQQBrowser MQQBrowser
MSIECrawler
MTRobot
Magnet
Majestic SEO Majestic SEO
Majestic12 MarkMonitor
MarkWatch MarkWatch
Masscan Mb2345Browser
MauiBot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri Metauri
Microsoft URL Control MicroMessenger
Minefield
Moblie Safari
Mojeek Mojeek
MolokaiBot
Mozlila Mozlila
NPbot Mr.4x3
Needle Name Intelligence
Nessus Nameprotect
NetMechanic
NetSpider NetSpider
Netcraft Netcraft
Nettrack Nettrack
Netvibes NextGenSearchBot
Nibbler Nibbler
Niki-bot
NimbleCrawler
Ninja Ninja
Nmap Not
Nuclei
Nutch Nutch
Offline Navigator Octopus
OpenVAS OnCrawl
OutfoxBot Openfind
PHPCrawl Openvas
POE-Component-Client-HTTP OrangeBot
Page Analyzer Pandalytics
PageGrabber
PageThing.com
Papa Foto
Pavuk Pavuk
PeoplePal
Petalbot
Pi-Monster Pi-Monster
Picscout
Piepmatz Piepmatz
Pimonster ProPowerBot
Pixray
Probethenet Probethenet
Pu_iN Pump
PxBroker PxBroker
RankActive QueryN Metasearch
RankFlex RankActiveLinkBot
RankingBot RankingBot
Rankivabot Rankivabot
SMTBot ReGet
Reaper
RebelMouse
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SalesIntelligent SalesIntelligent
ScanAlert ScoutJet
ScrepyBot ScreenerBot
Searchestate SemanticJuice
Semrush SentiBot
SemrushBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SeobilityBot
Siphon Siphon
Site Sucker SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam Sitebeam
Sitevigil Sitevigil
Snapbot
SocialRankIOBot SocialRankIOBot
SpankBot SpaceBison
Steeler Spbot
Spinn3r
SputnikBot
Sqlworm
Stripper
Swiftbot Swiftbot
Szukacz Szukacz
Telesoft Teleport
TeleportPro
Telesphoreo Telesphoreo
Telesphorep The Intraformant
Thumbor
TightTwatBot TightTwatBot
Titan Titan
Toata Toweyabot
Turnitin TurnitinBot
TwengaBot
Twice Twice
Typhoeus
URLy Warning URLy Warning
UnisterBot UnisterBot
V-BOT Upflow
VCI
VeriCiteCrawler VeriCiteCrawler
Voltron Voltron
WBSearchBot
WEBDAV WEBDAV
WISENutbot
WPScan WPScan
WWWOFFLE WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0 Wallpapers/3.0
WallpapersHD Web Enhancer
Web Auto
Web Fuck
Web Pix Web Pix
WebBandit Web Sauger
WebCopier WebFuck
WebGo IS
WebLeacher WebLeacher
WebPix
WebSauger WebSauger
WebSucker WebZIP
WebWhacker Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester Webster
Whatweb Whack
WinHTTrack
Wonderbot Wonderbot
Woobot Wotbox
Zade Wprecon
Zermelo Zauba
Zeus ZoomBot
Zitebot ZoominfoBot
ZumBot ZumBot
adscanner
archive.org_bot archive.org_bot
arquivo-web-crawler arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
cah.io.community cah.io.community
check1.exe check1.exe
crawl.sogou.com cognitiveseo
gopher com.plumanalytics
instabid dataforseo.com
demandbase-bot
evc-batch
heritrix
internetVista monitor
isitwp.com
iubenda-radar iubenda-radar
lwp-trivial lwp-trivial
meanpathbot
oBot
page scorer
plumanalytics plumanalytics
s1z.ru
scalaj-http scalaj-http
seobility seobility
seostar seocompany.store
sexsearcher sexsearcher
spyfu siteripz
sogouspider
sysscan sysscan
trendiction.com
webmeup-crawler webmeup-crawler
webpros.com xpymep1.exe
x09Mozilla
x22Mozilla
zauba.io zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
9icmzvn6.website 178evakuator178.ru
buy-forum.ru 4senses.co
dealitright.click barbourjackets.online
free-stock-illustration.com besthoro.ru
googglet.com cscwtalkto.site
kinobaks.com dvervmoskvu.ru
moyakuhnia.ru enbersoft.com
multgo.ru fxgallery.com
nvformula.ru mundoaberrante.com
pornogad.com templates.franklinfire.co

908
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
000free.us
00webcams.com 00webcams.com
11pikachu.ru 03e.info
21h2o.com 0daymusic.org
4webmasters.org 101flag.ru
5i2.net 101raccoon.ru
777-club.ru 214jaluwobapef.cf
aadroid.net 2daytrendingnews.com
above.com 2pxg8bcf.top
acmebtn.ml 3th.co.in
acortarurl.es 4senses.co
acunetix-referrer.com 5forex.ru
addtoadd.men 6128786.com
adexprts.com aad1f4acb0a373420d9b0c4202d38d94fa.com
adprotect.net activecampaign.dreamhosters.com
adservme.com adobereader-free.ru
adultwebhosting.info adserver-e7.com
agahinameh.com adtech.fr
air-edem.ru advertisingtag.net
alarmobninsk.ru aktobe.xkaz.org
alessandraleone.com albumsuper.info
allbizne.co.ua allboard.xobor.de
alphaforum.ru allcredits.su
aludecor.info alot.com
amoi.tn am-se.com
aosexkontakte.net anaksma.info
apioutoboxnet-a.akamaihd.net andpolice.com
apiqualitinknet-a.akamaihd.net anlimebel.kiev.ua
apple.com-webbrowsing-security.review anti-virus-removal.info
approvedlocal.co.za apibrowsesmartne-a.akamaihd.net
arabgirls.adultgalls.com apidigidocketnet-a.akamaihd.net
arabseyes.com apilinkswiftco-a.akamaihd.net
arate.ru apimegabrowsebiz-a.akamaihd.net
artel116.ru arcteryxsale.online
atley.eu.pn ardimobileinfo.ml
australia-opening-times.com artdestshop.eu
autowebmarket.com.ua asrvvv-a.akamaihd.net
avon-severozapad.ru atelielembrancaqueencanta.com.br
awency.com auspolice.com
autoplate.info
availit.weebly.com
avek.ru
aviapanda.ru
avtochehli.by
azartniy-bonus.com
azazaporn.com
azbuka-mo.ru azbuka-mo.ru
azbukadiets.ru baikaleminer.com
bala.getenjoyment.net belsetirehafi.tk
bamo.xsl.pt best-mam.ru
bannerads.de bestdraws.com
basedecor.ru bestempresas.es
beachdriveblog.com
beget.tech
bestcoin.cc
bestkfiledxd.cf
bestmarriages.com
bestpriceninja.com bestpriceninja.com
bif-ru.info bestssaker.com
binaryoptionscops.info bestwaystogetpaid.us
binomo.kz betune.onlinewebshop.net
bitcoinpile.com bget.ru
bitcoinremote.com bingoporno.com
bizcheapjerseyswholesalechina.com biographiya.com
biznesluxe.ru bizzliving.com
bjorkbacken.nu
bkns.vn bkns.vn
blogporn.in blog.remote-computer.de
blogs.rediff.com blogos.kz
blpmovies.com
boc.kz boc.kz
bonkers.name bocoarchives.org
bonky.biz bookmark4you.com
brains2.biz bookmark4you.com.biz
breastaugmentation.co.za braintobe.win
brendbutik.ru brendbutik.ru
briomotor.co
bronzeaid-a.akamaihd.net
brus.city brus.city
btnativenav.com butstrap.space
buehne-fuer-menschenrechte.de buyparajumpers.online
bukleteg.xyz buzzurl.jp
buzzonclick.com cakemediahq.com.au
candlehandmade.com californianews.cf
cannibalcheerleader.com callejondelpozo.es
carson.getenjoyment.net cand.jp
cartierlove2u.com candlewooddentalcentre.com.au
cdncash.net canvas.gloverid.site
cheapbelstaff.online cartierlove.xyz
cheapmoncler.win cartierlovebraceletreplica.xyz
cheapmoncler.xyz casablancamanor.co.za
cheapwebsitehoster.com catalogs-parts.com
checkhit.com cbcseward.com
checkm8.com cbozhe.com
chocoslim.pro cdn.walkme.com
christianlouboutinreplica.win cdncash.com
cienum.fr cejewelry.xyz
chlooe.com
choosecuisine.com
cindymatches.com cindymatches.com
citysecurity.nu cityadspix.com
cjs.com.ru cjmc.info
clean-virus-mac.com cleanallvirus.com
clubfashionista.com clickso.com
coaching-netz.info cmd.kz
compliance-andrew.top coldfilm.ru
compliance-barak.xyz compliance-barak.xyz
compliance-donald.xyz
compliance-irvin.xyz
compliance-jane.top
compliance-jessica.top
compliance-walter.top compliance-walter.top
concealthyself.com concealthyself.com
connectingsingles.com contextualyield.com
connectionstrenth.com
cookie-law-enforcement-aa.xyz
cookie-law-enforcement-ee.xyz
cookingmeat.ru
coolyarddecorations.com
coop-gamers.ru coop-gamers.ru
copblock.org coprofam.org
cowblog.fr corta.co
cscwtalkto.site csgo4.win
cwetochki.ru custodieva.ru
d2jsp.org cvety24.by
dafatiri.com cyse.tk
dairyindia.in dailyrank.net
daretodonate.co danceuniverse.ru
data-mining.tk darkages.info
date-withme.com datract.com
dawlenie.com dawlenie.com
ddlmega.net dekoration.us
dealitright.click descargar-musica-gratis.net
deda-moroza-zakaz.ru detmebel.su
delayreferat.ru detoxmed24.ru
dellalimov.com detsky-nabytek.info
destinationrealestate.com deutschland123.de
deutschehobbyhuren.net diffbot.com
dfwu1019.info digest-project.ru
dirtpics.pw dinkolove.ya.ru
dnepr-avtospar.com.ua directrev.com
doublepimp.com dogoimage.com
drupa.com doktoronline.no
dtnlyss.com domain-submit.info
e-commerce-seo.com domination.ml
duplicashapp.com
e-collantes.com
e-commerce-seo1.com
eandsgallery.com
earthmagic.info
ebooknovel.club
econom.co econom.co
elektronischezi.livejournal.com ecxtracking.com
elektrozigarettekaufen1.devhub.com eets.net
elektrozigaretten1.webs.com ege-essay.ru
elektrozigaretten2.yn.lt electronicadirect.com
elmacho.xyz elektronischezigarettekaufen1.beeplog.com
elvenmachine.com elektrozigarettekaufen2.blogse.nl
enskedesquashclub.se en.home-task.com
eredijovon.com es5.com
excaliburfilms.com eshop4u.jp
extractorandburner.com essayassist.com
estelight.ru
europages.com.ru
evrotekhservis.ru
exci.ru
excitacao.com
executehosting.com
extremepornos.net extremepornos.net
f07.de ezaz.info
falcoware.com ezigarettekaufen1.hpage.com
faptitans.com ezofest.sk
farmprofi.net factorynightclub.com
fba-mexico.com fashion-stickers.ru
fearcrow.com fearcrow.com
feargames.ru
feel-planet.com feel-planet.com
femdom.twiclub.in figuringmoneyout.com
fermersovet.ru
filesdatabase.net filesdatabase.net
filmgo.ru financetip.eu
fortevidyoze.net findpik.com
forum.tvmir.org fingerprintjs.com
fotopop.club firma-legion.ru
fotosfotos.eu firstdrugmall.ru
franklinfire.co footbalive.org
freecamdollars.com forex-indextop20.ru
freenom.link formseo.com
fres-news.com forpackningsutveckling.se
fsalas.com forum20.smailik.org
fuckbuddybestgilf.info frcls.fr
funnymama.com freewebs.com
g33.org freshdz.com
galleryawesome.com freshwallpapers.info
gallictures.com frvo.alptandem.ru
getlamborghini.ga fullfileaccess.com
getmyads24.com fym.com.ru
getprismatic.com gardene.ru
ghostvisitor.com gcup.ru
go2album.com getlaid-xxxhookupdirect.com
go2jump.org gombita.info
googglet.com goodly.pro
gsasearchengineranker.pw greatidea.marketing
gsasearchenginerankerdiscount.com greenshop.su
gsbs.com.ua growboxbl.ru
gstatey.net
gungamesz.com
gwagka.com
gwhwpxbw.bloger.index.hr gwhwpxbw.bloger.index.hr
hdimagegallery.net hard-porn.mobi
hdpixent.com hasshe.com
healbio.ru hatdc.org
histats.com hauleddes.com
hit-kino.ru hd-filmy.net
hitcpm.com hikesearch.net
histock.info
hol.es
home-task.com home-task.com
homedecoguide.info homedecorpicture.us
homeinns.com hornymatches.com
homik.pw horoshieokna.com
hotgirlhdwallpaper.com ideibiznesa2015.ru
hotkeys.com iflycapetown.co.za
houston-vikings.com importchinacoach-teach.com
hoverboard360.es inbabes.sexushost.com
howlongdoestizanidinestayinyoursystem.blogspot.com incomekey.net
hptwaakw.blog.fc2.com inet-traffic.com
hyiphunter.org intervsem.ru
i-hobot.ru iqoption.pro
i4track.net iqs.biz.ua
idegenvezeto.eu iskalko.ru
ideoworld.org jabimgo.pw
ifirestarter.ru javidol.site
igtools.club jerseysbizwholesalecheap.com
ikearugs.xyz
ilikevitaly.com
ilo134uloh.com
ilovevitaly.com
imagefinder.site
images-graphics-pics.com
impisr.edunsk.ru
infoupdate.org
insurple.com
interferencer.ru
investsuccess.org
ipornox.xxx
iradiology.ru
irunfar.com
jav-idol.com
javxxx18.com
je7.us
jillepille.com
jimmychoosale.online jimmychoosale.online
joingames.org justkillingti.me
justucalling32211123456789.tk justprofit.xyz
kakablog.net kakablog.net
ketrzyn.pl kakadu-interior.com.ua
keywordbasket.com kalandranis.gr
kalb.ru
kambasoft.com
kamorel.com
karadene.com
ketoanhanoi.info
keywordglobal.co.za keywordglobal.co.za
keywordteam.net kfon.eu
kino-rf.ru kino-fun.ru
kinogonew.ru kinostorm.net
kiwi237au.tk knowyournextmove.com
klejonka.info kostenloser-sex.com
kmd-pto.ru krasula.pp.ua
kmgamex.cf kvartira-sutochno.com
kollesa.ru kvartiry-remont.ucoz.ru
komp-pomosch.ru lawyersinfo.org
koronirealestate.gr leadwayau.com
kovesszucs.atw.hu
krasnodar.xrus.org
kskjco.club
larger.io
lawyers.cafe
ldrtrack.com
lenvred.org lenvred.org
li-er.ru lider-zhaluzi.kiev.ua
lietaer.com limads.men
light.ifmo.ru lionking-1994.blogspot.com
lineavabit.it listiseltemournlan.gq
lizace.com littleberry.ru
locatellicorretor.com.br loftdigital.eu
lombia.com loginduepunti.it
longlifelomilomi.info lomza.info
losangeles-ads.com love-baby.cz
ltvperf.com lovi-moment.com.ua
m0r0zk0-krava.ru luxmagazine.cf
m-google.xyz
m292.info m292.info
macdamaged.space m5home.ru
macdamaged.tech macresource.co.uk
machicon-akihabara.info magento-crew.net
mackeeper-center.club maladot.com
maglid.ru manve.info
mailemedicinals.com mebelcomplekt.ru
masturbate.co.uk meble-bogart.info
matb3aa.com medispainstitute.com.au
mcnamaratech.com meetlocalchicks.com
meccadumps.net metarip.ru
medicineseasybuy.com mex-annushka.ru
meendo-free-traffic.ga michaelkorsoutlet.store
memberty.com minet.club
metascephe.com mjchamonix.org
minecraft-rus.org mmstat.com
minegam.com mobplayer.ru
misswell.net
mister-shop.com
mobsfun.net
mockupui.com mockupui.com
mole.pluto.ro mossmesi.com
monclerjacketsoutlet.pw mundoaberrante.com
moscow-region.ru musicpro.monster
mosrif.ru my-aladin.com
mowser.com mycaf.it
mozello.ru myghillie.info
mrlmedia.net
msk.afora.ru
mydirtyhobby.com
myfreetutorials.com
myhealthcare.com myhealthcare.com
myhitmp3.club mymobilemoneypages.com
myonlinepayday.co mysexpics.ru
myperiod.club national-today-winning-winner.club
myplaycity.com naval.jislaaik.com
nero-us.com neodownload.webcam
newfilmsonline.ru net-profits.xyz
nextlnk12.com
nfljerseysforsalewholesaler.com nfljerseysforsalewholesaler.com
nmrk.ru nfvsz.com
nodding-passion.tk nicefloor.co.uk
nordvpn.com northfacestore.online
notaria-desalas.com novodigs.com
novosibirsk.xrus.org
ntic.fr
o-o-6-o-o.com o-o-6-o-o.com
o.light.d0t.ru o-o-6-o-o.ru
oakridgemo.com
oballergiya.ru
obiavo.kz
obiavo.ru
odesproperty.com
odoratus.net odoratus.net
okeinfo.online omgtnc.com
online-hd.pl one-gear.com
online-templatestore.com online-zaymy.ru
onlinemegax.com onlinewritingjobs17.blogspot.ru
onlythegames.com onstrapon.purplesphere.in
ons-add.men
ooomeru.ru ooomeru.ru
oops-cinema.ru orhonit.com
ovirus.ru otbelivanie-zubov.com
ownshop.cf panamaforbeginners.com
owohho.com
paparazzistudios.com.au paparazzistudios.com.au
partner-host.men partner-pop.men
parvezmia.xyz partnerads.men
pertlocogasilk.tk pc-test.net
physfunc.ru penisvergrotendepillennl.ovh
pics-group.com photorepair.ru
pila.pl pobeiranie.pl
piratecams.com poems.com.ua
pirateday.ru pokemon-go-play.online
pix24x7.com poquoson.org
pk-services.ru portside.cc
pliks.pl pozdrawleniya.ru
pochemychka.net prchecker.info
pogodnyyeavarii.gq preg.marketingvici.com
pogosh.com pricheski-video.com
pontiacsolstice.info princevc.com
popander.mobi printingpeach.com
pornofeuer.com privatov-zapisi.ru
pornohd1080.online prod2016.com
pornoreino.com professionalwritingservices15.blogspot.ru
portal-eu.ru progress-upakovka.ru
pr0fit-b0x.com prostitutki-almata.org
presleycollectibles.com pshare.biz
prizestohandle.club qwesa.ru
profitwithalex.info rada.ru
profolan.pl razamicroelectronics.com
psvita.ru rcb101.ru
pussyfleet.com reckonstat.info
pussyspace.net redhotfreebies.co.uk
putitin.me refads.pro
quickbuck.com registry-cleaner.net
quickloanbank.com remont-komputerov-notebook.ru
ranking2017.ga renecaovilla.online
rapidokbrain.com
raschtextil.com.ua
realmonte.net
reimageplus.com
relax.ru
rentaremotecomputer.com rentaremotecomputer.com
replicaclub.ru restaurantlescampi.com
rethinkwasteni.info
retreatia.com retreatia.com
rfid-locker.co ric.info
ribieiendom.no richinvestmonitor.com
ringtonepartner.com ringporno.com
rique.host.sk risparmiocasa.bz.it
rossmark.ru rockma.se
rootandroid.org
ruf777.com ruf777.com
rus-pornuha.com runofilms.ru
sad-torg.com.ua rusprostitute.com
samo-soznanie.ru rusvideos.su
sarafangel.ru sabaapress.com
sarm.tk sabizonline.com
saugatuck.com saddiechoua.com
sc-specialhost.com saltspray.ru
santasgift.ml
savetubevideo.com
sbricur.com
scanner-don.top
scanner-jack.top
scanner-jess.top scanner-jess.top
scmor.ilxc.cc scanspyware.net
scrapy.org scripted.com
search-goo.com search-error.com
search.pch.com searchmywindow-a.akamaihd.net
segol.tv securesmrt-dt.com
seminarykansas904.ml seinterface.com
seoboxes.com semprofile.com
seocheki.net semrush.com
service.adtech.fr seo-2-0.com
sextracker.com seojokes.net
shillyourcoins.com seorankinglinks.xyz
shmetall.com.ua serptehnika.ru
shoesonlinebuy.xyz serw.clicksor.com
sibdevice.ru sexyteens.hol.es
sibtest.ru shareyards.com
signoredom.com shijian.ac.cn
sim-service.net shopfishing.com.ua
sisiynas.ru shymkent.xkaz.org
siteaero.com sicfor.bcu.cc
skanninge.se sideeffectsoftizanidine.blogspot.com
skyway24.ru simply.net
sloopyjoes.com site.ru
slujbauborki.ru skuteczna-dieta.co.pl
smadihome.com slowmac.tech
smartbalanceworld.com smartadserver.com
smsactivator.ru smartshoppymac.com
social-buttons.xyz social-button.xyz
softonicads.com softonicads.com
softwaretrend.net sonnikforme.ru
soviet-portal.do.am souvenir.cc
spacash.com spasswelt.net
space2019.top spbchampionat.ru
spymac.net spin2016.cf
start.myplaycity.com sport-video-obzor.ru
stats-public.grammarly.io spy-app.info
steame.ru stairliftstrue.com
stoki.ru streetfire.net
studiokamyk.com.pl sukirgenk.dvrlists.com
supermama.top svolze.com
svnuppsalaorebro.se t-bygg.com
swsociety.se td-l-market.ru
symbaloo.com telegramdownload10.com
tabletkinaodchudzanie.com.pl telemetryverification.net
talant-factory.ru theautoprofit.ml
taraz.xkaz.org theguardlan.com
taxi-v-eisk.ru themestotal.com
telesvoboda.ru thruport.com
templates.radiodigital.co tiandeural.ru
teslathemes.com timdreby.com
thegolfclub.info titangel-vietnam.com
theprofitsmaker.net tizanidine4mguses.blogspot.com
thexart.club tizanidineonline.blogspot.com
titelhelden.eu tizanidinestreetprice.blogspot.com
tizanidine4mgstreetprice.blogspot.com tizanidineusedfor.blogspot.com
tizanidinefibromyalgia.blogspot.com tizanidinewithdrawal.blogspot.com
tizanidineinteractions.blogspot.com tjkckpytpnje.com
tootoo.to top250movies.ru
topbestgames.com
topcar-krasnodar.ru topcar-krasnodar.ru
torontoplumbinggroup.com topflownews.com
tpu.ru topmira.com
topvidos.ru
traderzplanet.in
traffic-club.info traffic-club.info
trafficreceiver.club traffictrade.life
trahic.ru tramadolandtizanidine.blogspot.com
trkur.com trkur.com
tt-ipd.info trustedmaccleaner.com
tuckpointingmasonrysystems.com tsyndicate.com
turbo-suslik.org tvand.ru
twelvevisionspartyofcolorado.com tversvet.ru
twitlinks.com tvorozhnaja-zapekanka-recept.ru
twittrading.com twu.com.ua
ukkala.xyz tzritel.tk
ultimatesetnewfreeallsoftupgradesystems.pw ucsol.ru
umityangin.net ufa.xrus.org
uhodzalijami.ru
ukrtvory.in.ua
umnovocaminho.com umnovocaminho.com
unitexindia.com
uogonline.com uogonline.com
uptimechecker.com uptime-alpha.net
ural-buldozer.ru urlopener.com
urldelivery.com vacances-voyages.info
vacuumcleanerguru.com vadimkravtcov.ru
valueclick.com valoresito.com
ventelnos.com vapsy.com
vesnatehno.ru vedomstvo.net
via-energy-acquistare.com vgoloveboli.net
video-woman.com viagroid.ru
videojam.tv viberdownload10.com
visionwell.com.cn videochat.life
vksaver-all.ru videochaty.ru
vmnmvzsmn.over-blog.com vietimgy.pw
voloomoney.com vip-parfumeria.ru
voltrknc1.com vipms.ru
virtuagirl.com
vkontaktemusic.ru
voloo.ru
volume-pills.biz volume-pills.biz
wahicbefa31.soup.io vrotike.ru
vtc.pw
vzlomfb.com
vzlomsn.org
walpaperlist.com walpaperlist.com
warning.or.kr waysbetter.cn
wejdz-tu.pl wdfdocando.com
webenlace.com.ar
webix.biz
webjam.com
website-stealer.nufaq.com
weprik.ru weprik.ru
winner7777.net westvilletowingservices.co.za
withstandingheartwarming.com wfb.hatedriveapart.com
wordkeyhelper.com wildworld.site
wowas31.ucoz.ru wnhjavlhezp.gq
wpthemedetector.co.uk woman-orgasm.ru
xaijo.com ws.ampower.me
xbaboon.com www.arenda-yeisk.ru
xjlottery.com www.get-free-traffic-now.com
xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai x-diesel.com
xn--80aanaardaperhcem4a6i.com x-rates.ru
xn--80ahvj9e.xn--p1ai xn----ctbbcjd3dbsehgi.xn--p1ai
xn--b1addnj3cah.xn--p1ai xn--90acenikpebbdd4f6d.xn--p1ai
xn--d1acah0c.xn--p1ai xn--b1agm2d.net
xrus.org xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xvideospornoru.com xtube.com
xxxmania.top yellowstonesafaritours.com
yaoguangdj.com youandcredit.ru
yoursearch.me youbrainboost.asia
youtubologia.it youporn-forum.ga
youtuhe.com yourads.website
zaapplesales.blogspot.com yourporngay.com
zagadki.in.ua zakazfutbolki.com
zambini.ru zarabotok--doma.ru
zeroredirect12.com zeroredirect12.com
znakom.sibtest.ru zeroredirect5.com
zrizvtrnpale.tk zhongwenlink.com
zhuravlev.info
zirondelli.it
zoodrawings.com
zootoplist.com
zvezdagedon.ru
zzlgxh.com

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1001desert.com 23kw.ru
3w24.com 24-ak.ru
5elementov.ru 4kpics.rocks
5kstore.com 4pp13.com
76brighton.co.uk aasoldes.fr
abwa.tk absolutelyanalog.com
actices.com acc.eu.org
adrenalin-stk.ru
adrunnr.com
adsloads.com
advancedsoftwaresupport.com advancedsoftwaresupport.com
aghanyna.com aero2.ru
amung.us afmuseum.com
albumsuper.info
alekseevec.ru
all4invest.info
alphavisions.net
anapa-inns.ru anapa-inns.ru
andpolice.com apioutoboxnet-a.akamaihd.net
angry-fermi-7633.arukascloud.io applicationg29.com
animal-drawings.com aramaicmedia.org
animal36.com arclk.net
apiappenableinfo-a.akamaihd.net asdfz.pro
apxeo.info atleticpharm.org
arkartex.ru autonew.biz
artel116.ru awency.com
asrv-a.akamoihd.net bablonow.ru
azazaporn.com babyguns.ru
bagcionderlab.com
bashtime.ru
bcmp.org bcmp.org
beetpics.pw beauty-bracelet.com
bensbargains.net benchmarkcommunications.co.uk
bestssaker.com bestcoin.cc
bioscorp.ru bestpriceninja.com
bitnote.co bestwebsiteawards.com
bloggedporn.com betteroffers.review
bluesalt.co bigcareer.info
bonzibuddi.com blavia.00author.com
butstrap.space blog-hits.com
calstaterealty.us brainboosting.club
buyk.host.sk
buynorxx.com
bvlgariring.xyz
bytimedance.ru
candycrushshop.com candycrushshop.com
cardsharp1.ru canoncdriverq3.pen.io
cbb1smartlist12.click cartierloveringreplica.xyz
chastnoeporno.com cartierwatch.xyz
chiblackhawks-jerseys.com cbozhe.com
cienum.fr checkhit.com
cjs.com.ru checktext.org
clayvasedesigns.tk chinaelitecheapjerseys.com
clickhype.com chocoslim.pro
clickzzs.nl clickcash.com
collegerentals.com commoncrawl.org
compliance-nelson.top creams.makeforum.eu
computernetworksonline.com credit-respect.ru
cookie-law-enforcement-ff.xyz crest3d.ru
cordstrap.cc darkbooks.org
costablue.xyz
countbertwistdisp26.soup.io
cymbaltaandtizanidine.blogspot.com
dawlenie.com dawlenie.com
dekorkeramik.ru deniven.1bb.ru
detki-opt.ru detmebel.su
detskie-konstruktory.ru diminishedvalueoforegon.com
dojki365.online donna7753191.ru
doktoronline.no download-of-the-warez.blogspot.com
domainroam.win downloader12.ru
downloadme.life eas-seo.com
ed-shop01.ru ebonyporn.site
editmedios.com elektrozigarette1.dreamwidth.org
ekosmetyki.net.pl englishgamer.com
emergencyneeds.org eonpal.com
erectile.bid evening-dating-club.info
expdom.com ezigarettenkaufen1.deviantart.com
exportshop.us
f1nder.org f1nder.org
factorynightclub.com face.hostingx.eu
farmingworm.com facecup.top
farmprofi.net familyholiday.ml
forpackningsutveckling.se faz99.com
fortevidyoze.net filefilter.weebly.com
foto-basa.com flprog.com
franklinfire.co foodcrafts.website
frustrated-favorable.gq foodgid.net
fym.com.ru forum.tvmir.org
garciniaxt.us forumprofi.de
golfresa.lucania.se free-share-buttons.top
googlsucks.com freejabs.com
gpms.org.my fuel-gas.com
guardlink.com galeria-zdjec.com
gamedayassist.com
gay.adultgalls.com
gdebestkupit.ru
gemgrab-a.akamaihd.net
gepezz.info
gk-atlant.info
glopages.ru
golaya.pw
grupografico-pilar.com.ar
gsasearchengineranker.pw
gwhwpxbw.bloger.index.hr
hawaiielectriclight.com hawaiielectriclight.com
hexpilot.com hdseriale.pl
hifidesign.ru high-speed1.net
hobbyhuren-datenbank.com highland-homes.com
hornymatches.com ictizanidinehcl4mg.blogspot.com
hotloans.ru ifmo.ru
howmuchdoestizanidinecost.blogspot.com images.gyffu.com
hybrid.ru inboundlinks.win
hyipmanager.in infowarcraft.ru
i-hobot.ru insomniagamingfestival.com
increasewwwtraffic.info intim-uslugi.info
instakink.com invest-pamm.ru
integritylandscapeservices.com karadene.com
isitpaleo.info kino-filmi.com
javitas.info kinoflux.net
jerseysbizwholesalecheap.com kinohit1.ru
jetsli.de kiwi237au.tk
karachev-city.ru konkursov.net
karaganda.xkaz.org koopilka.com
kfon.eu kretpicf.pw
kinoduh.ru kskjco.club
kinozapas.org letolove.ru
kometars.xyz
kostenloser-sex.com
ks1234.com
lacave.ntic.fr
lalalove.ru
lanadelreyfans.us
leadn.pl
lennatin.info
levaquin750mg.blogspot.com
life.biz.ua
likesdesign.com likesdesign.com
linksharingt.com lisque.batcave.net
lion.misba.us littlecity.ch
listiseltemournlan.gq lizace.com
live-sexcam.tk ljusihus.se
liver-chintai.org long-beach-air-conditioning.com
luxup.ru ltvperf.com
lyngdalhudterapi.no m4ever.net
map028.com magnetpress.sk
marketland.ml mahnwachen-helfen.info
maslenka.kz makis.nu
mastershef.club marmitaco.cat
mebel-ekb.com maxthon.com
medi-fitt.hu meccadumps.net
mediafresh.online mesbuta.info
medizinreisen.de mielec.pl
meds-online24.com mmostrike.ru
meet-flirt-dating.com mobile.ok.ru
mensandals.xyz mobot.site
michaelkorssaleoutletonline.net monetizationking.net
minyetki.ru mosrif.ru
mncrftpcs.com mriyadh.com
mnogabukaff.net mydoctorok.ru
monthlywinners.com mydownloadengine.com
mrinsidesales.com mygameplus.ru
muizre.ru newstraveller.ru
musicstock.me nudo.ca
mywallpaper.top olvanto.ru
napalm51.nut.cc online-hd.pl
nikitabuch.com online-hit.info
nippon-bearings.ru online-templatestore.com
njpalletremoval.com online-x.ru
nmrk.ru onlinemeetingnow.com
no-fuel.org optikremont.ru
novgorod.xrus.org ovirus.ru
nuup.info oxotl.com
obiavo.in pensplan.com
offergroup.info pictures-and-images.net
onescreen.cc pinwallpaper.xyz
online247.ml pl-vouchers.com
online7777.com popup-jdh.xyz
ontargetseo.us pornoforadult.com
onthemarch.co predominant-invent.tk
optom-deshevo.ru productarium.com
orion-code-access.net profitkode.com
osoznanie-narkotikam.net profitsport.club
partner-high.men projectforte.ru
phormchina.com prosmibank.ru
picsforkeywordsuggestion.com pssucai.info
pierrehardysale.online qcstrtvt.bloger.index.hr
pistonclasico.com rabot.host.sk
pizza-tycoon.com redbottomheels.xyz
pornoblood.com refudiatethissarah.info
pornohub.me reyel1985.webnode.fr
pornoplen.com ru-dety.ru
pregnant.guru russian-postindex.ru
presleycollectibles.com russkie-gorki.ru
pricheskaonline.ru sammlungfotos.online
privhosting.com sampleletters.net
prpops.com scalerite.co.za
qualitymarketzone.com scanner-donald.top
realitykings.com scenicmissouri.us
rentehno.ru sevendays.com.ua
resellerclub.com sex-watch.com
rique.host.sk sexpornotales.com
rostov.xrus.org sexsearch.com
rozalli.com sextracker.be
rumamba.com shikiso.info
rvtv.ru shoppytoolmac.com
ryetaw.com shymkent.xkaz.org
savefrom.com sicfor.bcu.cc
scanner-george.top sideeffectsoftizanidine.blogspot.com
scanner-mark.top sientalyric.co
shama-rc.net signal03.ru
sibtest.ru simple-image.com.ua
site-speed-checker.site skincrate.net
skatestick.bid sklad-24.ru
slavic-magic.ru slavic-magic.ru
slim.sellany.ru smartbalanceworld.com
snow.nvr163.com soc-econom-problems.ru
social-s-ggg.xyz softomix.com
soft1.ru sohoindia.net
solinf.co sovinsteel.ru
solution4u.com space4updating.win
spylog.com spinazdrav.ru
stevemonsen.com sport7777.net
stopnarco.ru spy-sts.com
superfish.com srgwebmail.nl
surcentro.com starpages.net
taximytishi.ru svtrd.com
thefds.net tarad.com
thegolfclub.info tasteidea.com
thejournal.ru textads.men
tizanidine4mgstreetprice.blogspot.com thebestphotos.eu
tizanidinehcl2mgsideeffects.blogspot.com thenetinfo.com
tizanidinesleepaid.blogspot.com timecrimea.ru
tizanidinestreetvalue.blogspot.com tizanidinedruginteractions.blogspot.com
tksn.ru tnaionline.org
torture.ml tnctrx.com
tripper.de tootoo.to
tuberkulezanet.ru torrnada.ru
tuberkuleznik.ru trafficcentr.xyz
turbodsp.com trafficmania.com
tvory.predmety.in.ua trudogolik.net
ublaze.ru ugogo.info
umg-stroy.ru underthesite.com
uroki.net unitexindia.com
via-energy-cumpara.com vchulkah.net
vipps.com.my video--production.com
visa-china.ru vzlom-na-zakaz.com
vizag.kharkov.ua walkme.com
vod.com.ua watchdogs-2.ru
vpnhowto.info westen-v.life
vsdshnik.com winner7777.net
wallpaperaccess.com worldmusicfests.com
watracker.net wtsindia.in
webalan.ru
webextract.profound.net
websiteaccountant.de
wholesalejerseychinaoutlet.com
winwotgold.pl
witclub.info
wordpresscore.com
wttavern.com
ww2awards.info ww2awards.info
xn----7sbifcamovvfggw9d.xn--p1ai www.jbetting.com
xn--80ahdheogk5l.xn--p1ai xdoza.com
xrus.org xingzi-vision.com
xtubeporno.net xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xuki.us xxx-cam.webcam
xxxguitars.com yellowproxy.net
yebocasino.com yopoint.in
yur-p.ru youjizz.com
zaloro.com youresponsive.com
zeroredirect12.com youtube-downloader.savetubevideo.com
zed21.net
zeikopay.com
zionstar.net
zoodrawings.com

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.112 0; 10.1.1.162 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3018 ### Version: V4.2022.04.3019
### Updated: Sat Apr 2 10:03:23 UTC 2022 ### Updated: Sat Apr 2 22:01:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3018 ### Version: V4.2022.04.3019
### Updated: Sat Apr 2 10:03:23 UTC 2022 ### Updated: Sat Apr 2 22:01:17 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##