vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-14 17:19:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.03.2969 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-03-09 22:07:22 +00:00
parent 2af1e8861c
commit 36cb069e18
46 changed files with 85657 additions and 85657 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2968 #### Version: V4.2022.03.2969
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.03.2968 #### Version: V4.2022.03.2969
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.03.2968 #### Version: V4.2022.03.2969
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10572
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.03.2968 #### Version: V4.2022.03.2969
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

10576
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10576
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

10576
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

10576
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2968 2969

10576
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

10576
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.150.29.137 0; 23.99.176.220 0;

10576
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

10576
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.150.29.137 0; 23.99.176.220 0;

10576
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
52.150.29.137 0; 23.99.176.220 0;

10576
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 1; 10.1.0.74 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
AIBOT LexiBot
Abonti Microsoft URL Control
Evil NetZIP
Harvest PECL::HTTP
LinkextractorPro POE-Component-Client-HTTP
Mag-Net ReGet
Not Web Sauger
SMTBot coccocbot
Xenu xpymep1.exe
plumanalytics zauba.io

286
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
404enemy 404enemy
80legs 80legs
ADmantX AIBOT
ALittle Client
ASPSeek
Abonti
AhrefsBot AhrefsBot
AiHitBot
Aipbot
Alexibot Alexibot
Alligator
AlphaBot AlphaBot
Anarchie
Anarchy99 Anarchy99
Ankit Anthill
Apexoo
Asterias
Attach Attach
BBBike BDFetch
BLEXBot BackDoorBot
BackStreet BackStreet
BackWeb
Backlink-Ceck Backlink-Ceck
Badass Badass
Battleztar Bazinga BatchFTP
Bigfoot
Bitacle Bitacle
BlowFish
Boardreader
Buck Buck
Buddy BuiltBotTough
BuiltWith BuiltWith
Bullseye
BunnySlippers BunnySlippers
Cegbfeieh CATExplorador
CensysInspect CODE87
Claritybot CheTeam
Cloud mapping
Collector Collector
Custo Crawling at Home Project
Crescent
CrunchBot
CyotekWebCopy CyotekWebCopy
DSearch DSearch
DTS Agent Disco
DataCha0s DomainCrawler
DatabaseDriverMysqli Drip
Demon ECCP/1.0
DigitalPebble EirGrabber
Discobot EroCrawler
DittoSpyder Evil
DomainStatsBot
Domains Project
EasyDL
Ebingbong
Extractor
ExtractorPro ExtractorPro
EyeNetIE
FDM FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0 Firefox/7.0
FlashGet Flunky
FyberSpider Foobot
GT::WWW Freeuploader
Fuzz
Fyrebot
GalaxyBot GalaxyBot
Genieo GetRight
GermCrawler
GetWeb
Getintent Getintent
Gigabot Gigabot
Go-Ahead-Got-It
GoZilla GoZilla
Grabber Grafula
GrapeFX GrapeshotCrawler
HTMLparser HEADMasterSEO
HTTrack HMView
HTTP::Lite
Haansoft
Harvest Harvest
Havij
Heritrix Heritrix
Hloader Hloader
HonoluluBot
Humanlinks Humanlinks
IDBTE4M IDBot
IRLbot IRLbot
Iblog
Id-search Id-search
IlseBot
Image Sucker Image Sucker
IndeedBot IndeedBot
InfoNaviRobot Indy Library
Internet Ninja InfoTekies
Intelliseek
Iskanie Iskanie
IstellaBot
JamesBOT
Jbrofuzz Jbrofuzz
JennyBot JennyBot
JetCar JetCar
Jetty Joomla
Jorgee Jorgee
JustView Jyxobot
Keyword Density Kozmosbot
Lanshanbot LWP::Simple
Leap Larbin
LeechFTP LeechFTP
LeechGet
Lftp
Libwhisker Libwhisker
Linkbot LinkScan
LinksManager LinkWalker
LinqiaRSSBot Linkdexbot
LinkpadBot
LinqiaScrapeBot LinqiaScrapeBot
Lipperhey Spider Lipperhey Spider
Litemage_walker
Lmspider Lmspider
MIDown tool
MIIxpc MIIxpc
MSIECrawler MJ12bot
MTRobot
Mail.RU_Bot
MarkMonitor MarkMonitor
MarkWatch Mass Downloader
Mata Hari Mb2345Browser
MeanPath Bot MeanPath Bot
Meanpathbot Meanpathbot
Metauri Mediatoolkitbot
Microsoft Data Access MegaIndex.ru
Minefield MicroMessenger
MolokaiBot MolokaiBot
Morfeus Fucking Scanner
Msrabot Msrabot
Musobot Musobot
NPbot NPbot
Name Intelligence Name Intelligence
NearSite Nameprotect
NetAnts Net Vampire
NetLyzer NetSpider
NetMechanic
Nettrack
Netvibes Netvibes
NextGenSearchBot Niki-bot
Nibbler
Nikto Nikto
Nimbostratus
Ninja Ninja
Nmap
Not Not
Nuclei Nuclei
Nutch Nutch
Offline Explorer Octopus
Offline Navigator Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS OpenVAS
PECL::HTTP Openfind
Page Analyzer Openvas
PageAnalyzer OrangeBot
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber PageGrabber
PageScorer
PageThing.com PageThing.com
Piepmatz Papa Foto
Pavuk
Petalbot
Pi-Monster
PictureFinder
Pimonster Pimonster
ProPowerBot Pixray
ProWebWalker ProWebWalker
Pu_iN Probethenet
Pump
PxBroker PxBroker
PyCurl
QueryN Metasearch QueryN Metasearch
Quick-Crawler Quick-Crawler
RankFlex
Rankivabot Rankivabot
Re-re
Recorder Recorder
RedesScrapy Ripper
Rogerbot SBIder
SEOkicks
SEOkicks-Robot SEOkicks-Robot
SISTRIX SEOprofiler
SMTBot
Scrapy Scrapy
Screaming ScreenerBot
SearchmetricsBot
Semrush
SeoSiteCheckup
SeobilityBot SeobilityBot
Seomoz
Siphon Siphon
Site Sucker SiteExplorer
SiteCheckerBotCrawler SiteLockSpider
SiteSnagger
SiteSucker SiteSucker
Siteimprove Sitebeam
Sitevigil
SlySearch
Snapbot Snapbot
Sosospider Sociscraper
Sottopop
Spbot Spbot
SputnikBot SputnikBot
Sqlmap
Sucker
Sucuri Sucuri
SuperHTTP Suzuran
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Teleport Teleport
The Intraformant Toweyabot
TheNomad
Titan
Tracemyfile Tracemyfile
Trendictionbot
True_Robot
Turnitin Turnitin
TwengaBot
Twice
Upflow Upflow
V-BOT Virusdie
Vagabondo
VeriCiteCrawler
VoidEYE VoidEYE
Voil Voil
WBSearchBot WBSearchBot
WWW-Collector-E WWW-Collector-E
WallpapersHD WWW::Mechanize
Web Fetch Wallpapers
Wallpapers/3.0
Web Enhancer
Web Fuck Web Fuck
Web Pix
Web Sauger Web Sauger
WebAuto Web Sucker
WebCollage WebCopier
WebEnhancer WebFetch
WebFuck
WebGo IS WebGo IS
WebImageCollector WebImageCollector
WebSauger WebLeacher
WebStripper WebReaper
WebWhacker WebWhacker
WebZIP WebmasterWorldForumBot
WebsiteExtractor Whack
Whacker
Who.is Bot
Wonderbot
Wotbox Wotbox
Wprecon Wprecon
YoudaoBot Xaldon WebSpider
Xaldon_WebSpider
Zade
Zauba Zauba
Zeus
ZmEu
ZoomBot ZoomBot
ZumBot
ZyBorg ZyBorg
archive.org_bot archive.org_bot
arquivo.pt autoemailspider
check1.exe
clark-crawler clark-crawler
coccocbot coccocbot
com.plumanalytics cognitiveseo
crawl.sogou.com crawler.feedback
demandbase-bot demandbase-bot
domainsproject.org domainsproject.org
gopher evc-batch
heritrix isitwp.com
ips-agent iubenda-radar
lwp-request magpie-crawler
netEstate NE Crawler mediawords
oBot
plumanalytics
polaris version polaris version
probe-image-size
ripz ripz
scan.lol s1z.ru
seobility satoristudio.net
seocompany.store
seoscanners
sexsearcher sexsearcher
sitechecker.pro sogouspider
spyfu spyfu
trendiction.de sysscan
voyagerx.com ubermetrics-technologies.com
webmeup-crawler webmeup-crawler
x09Mozilla x09Mozilla
xpymep1.exe xpymep1.exe

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 404enemy
ADmantX
AIBOT AIBOT
ALittle Client ASPSeek
Acunetix Acunetix
AfD-Verbotsverfahren AhrefsBot
AiHitBot
Aipbot
AlphaBot
Anarchie Anarchie
Anarchy Anarchy
Ankit Anarchy99
Apexoo
Aspiegel
Asterias
Atomseobot Atomseobot
Attach AwarioRssBot
AwarioSmartBot BBBike
BDCbot BLEXBot
BackWeb BackStreet
BacklinkCrawler
Bandit Bandit
BatchFTP Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot Bigfoot
BlackWidow
Blackboard Blackboard
Boardreader Boardreader
BotALot BuiltWith
Buck Bullseye
BunnySlippers BunnySlippers
CSHttp CCBot
CheeseBot CazoodleBot
CensysInspect
CheTeam
CherryPicker CherryPicker
Claritybot Claritybot
Cliqzbot Collector
CopyRightCheck
Cosmos Cosmos
Craftbot
Crawling at Home Project
Crescent Crescent
CrunchBot
Curious
Custo
CyotekWebCopy CyotekWebCopy
DataCha0s
DatabaseDriverMysqli
Deusu Deusu
Devil
Digincore Digincore
DittoSpyder Dirbuster
Dispatch
DnBCrawler-Analytics
DnyzBot DnyzBot
DomainSigmaCrawler DomCopBot
Download Wonder Download Wonder
ECCP/1.0
EMail Wolf
EasyDL EasyDL
Ebingbong
EirGrabber
EroCrawler EroCrawler
Evil Evil
Express WebPictures
ExtLinksBot ExtLinksBot
Extractor Extreme Picture Finder
EyeNetIE Ezooms
FDM
FHscan FHscan
FemtosearchBot FemtosearchBot
Firefox/7.0 Fimap
FlashGet FrontPage
Flunky
Freeuploader
Fuzz Fuzz
GetRight G-i-g-a-b-o-t
Getintent GT::WWW
GalaxyBot
Gigabot
Go!Zilla
GoZilla
Gotit
GrabNet
Grabber Grabber
GridBot HEADMasterSEO
Haansoft Haansoft
HaosouSpider Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot IDBot
Id-search Image Fetch
Indy Library Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InterGET InterGET
Internet Ninja Iria
InternetSeer
IstellaBot IstellaBot
JOC Web Spider JOC Web Spider
Jbrofuzz Jbrofuzz
JennyBot Jetty
Jorgee JikeSpider
Joomla
Keyword Density Keyword Density
Kozmosbot
Lanshanbot Lanshanbot
Larbin Leap
LeechFTP LeechFTP
LeechGet LexiBot
Libwhisker
LieBaoFast LieBaoFast
LinkScan Likse
Linkdexbot
LinkextractorPro LinkextractorPro
Ltx71 LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Lmspider
MIDown tool MIDown tool
MQQBrowser
MSFrontPage MSFrontPage
MTRobot MSIECrawler
Magnet
Majestic SEO Majestic SEO
Majestic12 Majestic12
Mb2345Browser MarkMonitor
Mass Downloader
MeanPath Bot MeanPath Bot
MicroMessenger Mediatoolkitbot
Mister PiX Minefield
MolokaiBot Mojolicious
Morfeus Fucking Scanner Msrabot
Mozlila
NICErsPRO NICErsPRO
NPbot Nameprotect
Needle NearSite
Nessus Nessus
Net Vampire
NetAnts NetAnts
NetSpider NetSpider
Nettrack Nettrack
Netvibes Netvibes
NextGenSearchBot Niki-bot
Nibbler NimbleCrawler
Nikto
Nimbostratus
Ninja Ninja
Not OrangeSpider
Nuclei POE-Component-Client-HTTP
Nutch Page Analyzer
Offline Explorer
Offline Navigator
OnCrawl
Openvas
OrangeBot
OutfoxBot
PageAnalyzer
PageGrabber
PageThing.com PageThing.com
Pandalytics Pi-Monster
Papa Foto Picsearch
Pavuk Piepmatz
PeoplePal Pimonster
Picscout
PictureFinder
Pockey Pockey
ProPowerBot ProPowerBot
Probethenet Psbot
Pu_iN Pump
PxBroker PxBroker
PyCurl QueryN Metasearch
Quick-Crawler
RankActive
RankFlex RankFlex
RankingBot RankingBot
Rankivabot
RebelMouse RebelMouse
Recorder Recorder
RepoMonkey RedesScrapy
Rogerbot
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOlyticsCrawler
SEOstats
SISTRIX SISTRIX
SMTBot SMTBot
SalesIntelligent SalesIntelligent
Scanbot Scanbot
ScoutJet ScreenerBot
Screaming
ScrepyBot ScrepyBot
SearchmetricsBot Searchestate
Seekport Seekport
SemanticJuice SemanticJuice
SemrushBot SemrushBot
SentiBot SentiBot
SeoSiteCheckup
Seomoz Seomoz
Shodan SiteSucker
SiteExplorer
Sitebeam
Sitevigil Sitevigil
Snake
Snapbot
Sociscraper Sociscraper
Sottopop Sosospider
Spammen SpaceBison
Spbot
Spinn3r Spinn3r
Sqworm SputnikBot
Sqlworm
SuperBot
SuperHTTP
Suzuran Suzuran
Swiftbot Swiftbot
T0PHackTeam T0PHackTeam
T8Abot
Teleport Teleport
Telesoft TeleportPro
Thumbor Trendictionbot
TightTwatBot Twice
Toata UnisterBot
Toweyabot V-BOT
Trendiction VB Project
True_Robot VCI
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
Vacuum Vacuum
VelenPublicWebCrawler Vagabondo
VeriCiteCrawler VidibleScraper
Voltron Voltron
WASALive-Bot
WBSearchBot WBSearchBot
WPScan WWW-Mechanize
Wallpapers WWW::Mechanize
WallpapersHD WallpapersHD
WeSEE Web Collage
Web Enhancer
Web Fuck Web Fuck
Web Pix
WebBandit WebBandit
WebFetch WebEnhancer
WebSauger WebFuck
WebWhacker WebPix
WebZIP
Webshag Webshag
Website Quester
WebsiteExtractor WebsiteExtractor
WebsiteQuester Whacker
Whack
Whatweb Whatweb
Who.is Bot Who.is Bot
Widow
WinHTTrack WinHTTrack
WiseGuys Robot Wonderbot
Wotbox
Wprecon Wprecon
Xaldon WebSpider Xenu
YoudaoBot YoudaoBot
Zermelo
Zeus Zeus
ZmEu ZmEu
ZoomBot ZoomBot
ZoominfoBot
ZyBorg ZyBorg
adscanner adscanner
archive.org_bot arquivo-web-crawler
autoemailspider arquivo.pt
backlink-check check1.exe
clark-crawler
coccocbot
cognitiveseo cognitiveseo
crawl.sogou.com com.plumanalytics
crawler4j heritrix
domainsproject.org internetVista monitor
evc-batch isitwp.com
iubenda-radar iubenda-radar
lwp-trivial lwp-trivial
muhstik-scan magpie-crawler
meanpathbot
oBot oBot
plumanalytics pcBrowser
polaris version
probe-image-size probe-image-size
s1z.ru ripz
satoristudio.net scan.lol
seoscanners seocompany.store
serpstatbot serpstatbot
spyfu sexsearcher
trendiction.de siteripz
trendiction.com
voyagerx.com
webgains-bot webgains-bot
webpros.com zauba.io
webprosbot zgrab
xpymep1.exe

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
5kstore.com blog.axant.it
dostavimvdom.ru ecommerce-seo.com
easycommerce.cf elektrozigarette2.webs.com
elektrischeziga.livejournal.com free-share-buttons.com
iboss.com kchaxton.com
kometars.xyz kovesszucs.atw.hu
pekori.to petitions.whitehouse.gov
privetsochi.ru phuketscreen.com
xjrul.com ribieiendom.no
xmladserver.com website-audit.com.ua

940
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
123cha.com 1001desert.com
13tabs.com 123movies.love
2015god.org 18ps.ru
1kinobig.ru
1qingdao.com
2345.com 2345.com
4k-player.pl 51unlim.ru
4rent.ru 5forex.ru
7xc4n.com 5tey7463.weebly.com
7yue.org 8gold.com
8xv8.com 8si.ru
98oi.ru aa8780bb28a1de4eb5bff33c28a218a930.com
abcdefh.xyz aad1f4acb0a373420d9b0c4202d38d94fa.com
abctoppictures.net aarbur.com
adanih.com acgs.tk
addtoadd.men addray.pro
adloads.com adidas.frwebs.fr
adrunnr.com adultactioncam.com
adsland.men adventureparkcostarica.com
adverster.com ahrefs.com
advertex.info aktivator-windows10.blogspot.com
advocatemsk.ru allesohnegirls.net
aibolita.com allforminecraft.ru
alborzan.com allkrim.com
allboard.xobor.de allornamenti.com
allnews24.in amehdaily.com
alphaforum.ru amoi.tn
alpharma.net an-donut.com
aludecor.info animalrank.com
anal-acrobats.hol.es ap.senai.br
android-systems.ru
android4fun.org
anjalika.co.in
anonymousfox.co
apartmentratings.com
apiadanaknet-a.akamaihd.net apiadanaknet-a.akamaihd.net
apibetweenlinesn-a.akamaihd.net apimountainbikei-a.akamaihd.net
apidiamondatanet-a.akamaihd.net apispringsmartne-a.akamaihd.net
appearance-cool.com appartement-stumm.at
apple.com-cleaner.systems appfastplay.com
apps-analytics.net appsaurus.com
apptester.tk arcteryxsale.online
asiavirtualsolutions.com arendas.net
atlant-auto.info artdestshop.eu
atofilms.com aruplighting.com
ausergrubhof.info asophoto.com
auspolice.com astana.xxxkaz.org
avto-oligarh.ru atleticpharm.org
avkzarabotok.com
avtolombard-krasnodar.ru
azte.ch
babosas.com babosas.com
backiee.com babyguns.ru
balkanfarma.org baixar-musicas-gratis.com
bambi.ck.ua bangla-chat-uk-paralud.ga
bannerpower.com barbourjackets.online
bannerspace.com bcmp.org
bayareaaeroclub.org beatifullandscape.co
beachtoday.ru beauty-bracelet.com
belinvestdom.by beauty-clinic.ru
bestimagecoollibrary.com bedandbreakfast.com
bestpriceninja.com berdasovivan.ru
bestprofits-there.com best-mam.ru
besthomemadepornsites.com
bestwebsitesawards.com bestwebsitesawards.com
bet-prognoz.com bezlimitko.xyz
bet365.com biglistofwebsites.com
beztuberkuleza.ru
bg6s0.com
bget.ru
bharatdefencekavach.com
biketank.ga biketank.ga
bimatoprost-careprost.com.ua bimmerpost.com
binomo.kz bioinnovate.co
bio-market.kz bitporno.sx
bkgr.se blackbabesporn.com
blackplanet.com blagovest-med.ru
blog.yam.com blavia.00author.com
bloggen.be blogos.kz
blogporn.in bobba.dzaba.com
bluerobot.info bodybuilding-shop.biz
bluesman.nu bolezniorganov.ru
bmsco.co boltalko.xyz
breget74.ru brainboosting.club
brimstonehillfortress.org brakehawk.com
btnativenav.com bravegirlsclub.com
bronzeaid-a.akamaihd.net
buigas.00it.com buigas.00it.com
buttons-for-website.com buyantiviralwp.com
buy-cheap-pills-order-online.com buzzsumo.com
buypanicdisorderpill.com buzzurl.jp
buyparajumpers.online bvlgariring.xyz
buytizanidineonline.blogspot.com cablecar.us
c-gainsbourg.com cacheimages.com
candlehandmade.com callcafe.info
cannibalcheerleader.com calvet.altervista.org
cardsdumps.com capsderfudd.tk
cardsharp1.ru cbozhe.com
cartierjusteunclou.xyz ccbill.com
cartierlove2u.xyz cdnanalytics.xyz
cartiertrinity.xyz chocolateslim-original.com
cdncash.com christianlouboutinoutlet.win
cheapmoncler.win christianlouboutinsaleonline.us
checkm8.com cialischstgerts.com
chelyabinsk.xrus.org cleanallvirus.com
chinaelitecheapjerseys.com clickprotects.com
cialischmrx.com clickzzs.nl
cindymatches.com cocolyze.com
cjmc.info codq.info
cleanallspyware.com companies-catalog.com
clickbanksites.info compliance-jess.top
clickcash.com compliance-mark.top
clipartnew.com counter.bloke.com
clksite.com countercrazy.com
coinsspb.com country-chic.ru
com-onlinesupport.host covadhosting.biz
compliance-donald.xyz cowblog.fr
conboy.us
contentlook.co
coolbar.pro
copenergo.ru
copypaste.traderzplanet.in
cottageofgrace.com
counterbot.com
cowlmash.com
cpabegins.ru
cpajunkies.com cpajunkies.com
cranly.net cranly.net
creditwell.ru crystalslot.com
crest3d.ru cvety24.by
crynet.cc czat.wp.pl
custom-electric-guitar.com
czeshop.info czeshop.info
dailystrength.org dailyfinancefix.com
daooda.com danceuniverse.ru
ddospanel.com data-mining.tk
degerlund.net datadepths.com
delfin-aqua.com.ua dating-time-now.com
deluxedumps.com davidovic.info
den-noch24.ru dealwifi.com
dentfidemountpreach.tk design-lands.ru
destinationrealestate.com designdevise.com
detki-opt.ru dfiles.me
deutschehobbyhuren.net dickssportinggoods.com
deutschland123.de digitalfaq.com
digilander.libero.it docstoc.com
dimkino.ru domination.ml
dinosaurus.site donvito.unas.cz
divatraffic.com dostavka-v-krym.com
djonwatch.ru dpihatinh.gov.vn
domainroam.win drev.biz
domik-derevne.ru driving.kiev.ua
dosugrostov.site dumpsmania24.com
droidlook.net e-commerce-seo1.com
e-commerce-seo.com ec-file.info
eager-nash.188-93-233-196.plesk.page ednorxmed.com
eas-seo.com ee77ee.com
easyukraine.com eets.net
ebooknovel.club ege-essay.ru
ekspertmed.com ekaterinburg.xrus.org
elektrischezi.canalblog.com ekto.ee
elektronischezigarette2.mex.tl electro-prom.com
eropornosex.ru elektrischezigarettekaufen2.cowblog.fr
essayassist.com elitepcgames.com
eugenevaultstorage.com elitesportsadvisor.com
event-tracking.com etenininrade.ga
everflora.ru
exdocsfiles.com
exoclick.com exoclick.com
exonline.info exportshop.us
ezaz.info ezigarettekaufen2.yolasite.com
f012.de ezigarettenkaufen1.deviantart.com
femmesdenudees.com ezigaretteshop.webs.com
ferrotodo.com ezigaretteshop2.mywapblog.com
fidelityfunding.com falopicm.pw
figuringmoneyout.com fanrto.com
flashahead.info fealq.com
forensicpsychiatry.ru feargames.ru
formularz-konkurs.tk fickenbumsen.net
foto-weinberger.at fillmewithhappiness.com
fotopop.club filmi-onlain.info
fotzen-ficken.com financeloan.us
fr-bearings.ru findanysex.com
franch.info findpics.pw
free-deals.faith fiuxy.com
freegamesplay.online fix-website-errors.com
freelinkbuilding.website.tk flashlarevista.com
freenom.link flytourisme.org
freshwallpapers.info fodelsedagspresenter.nu
forex-indextop20.ru
forex21.ru
forexunion.net
forums.d2jsp.org
foxtechfpv.com
foxydeal.com
free-share-buttons.com
freevpn.space
freshsuperbloop.com
frvo.alptandem.ru
fsalas.com
ftns.ru ftns.ru
g7m.pl fusoradio.info
galaxys6manual.info fxgallery.com
gameonasia.com fyxabomiw.ru
gamerextra.com gabeshop.ru
gaming-journal.com galleryawesome.com
gepezz.info gay.adultgalls.com
getmyads24.com germes-trans.com
getresponse.com getoutofdebtfree.org
girlporn.ru getprismatic.com
gkvector.ru gg.zzyjxs.com
given2.com
global-ics.co.za
glopages.ru glopages.ru
goldpanningtools.com goatse.ru
golmau.host.sk goldandcard.ru
gombita.info google-liar.ru
gotorussia.com googlemare.com
greatidea.marketing goroda-vsego-mira.ru
gribokstop.com gq-catalog.gq
guitar-master.org greatzip.com
gungamesz.com gsasearchengineranker.site
hao123.com gsbs.com.ua
hatedriveapart.com handsandlegs.ru
hd-film.pl hard-porn.mobi
headpress.ru haveinc.xyz
helicalpile.us hdhc.ru
hidefiles.org hdxnxxtube.mobi
hkladys.com historichometeam.com
hopeonthestreet.co.uk homelygarden.com
hotblognetwork.com hop.clickbank.net
hotchatdate.com hosting-tracker.com
hotel-mkad.ru hotxnights.info
hotkeys.com
hoverboard360.at
hoverboard360.nl
hplaserjetpdriver8y.pen.io
husky-shop.cz husky-shop.cz
hystersister.com ideawheel.com
iboss.com ifirestarter.ru
imadedinner.net impisr.edunsk.ru
incomekey.net impisr.ru
infowarcraft.ru
insta-add.pro
insurple.com insurple.com
intimshop-fantasy.ru intelhdgraphicsgtdrive6w.metroblog.com
iphantom.com internetartfair.com
iskalko.ru iomoio.net
itsdp3.com itag.pw
iwantmyfreecash.com ix20.ru
iwanttodeliver.com jackwolfskinoutlet.online
janettabridal.com jerseyschinabizwholesale.us
jaxcube.info jetsli.de
jbl-charge.info jo24news.com
jerseysbizwholesalecheap.com
johnrobertsoninc.com
jongose.ninja
junketjuice.blogspot.com junketjuice.blogspot.com
justucalling32211123456789.tk jurajskie.info
kaidalibor.de kam-dom.ru
kalandranis.gr
karadene.com karadene.com
karaganda.xkaz.org kerei.ru
karting196.ru keywordsking.com
katushka.net kinocccp.net
kazan.xrus.org kinoflux.net
kazrent.com kinozapas.com
kerch.site kiwi237au.tk
ketoanhanoi.info klikbonus.com
kollekcioner.ru klin3952.ru
krasivye-devushki.net kolotiloff.ru
ks1234.com kongruan.com
kupit-adenu.ru koronirealestate.gr
kursy-ege.ru larose.jb2c.me
kvartiry-remont.ucoz.ru lashstudia.ru
lacapilla.info law-check-seven.xyz
landoftracking.com leboard.ru
lapolis.it lifeinsurancekb.com
larchik.net limads.men
layola.biz.tc listiseltemournlan.gq
legalrc.biz liverpool.gsofootball.com
lineavabit.it lkbennettoutlet.online
littleberry.ru loadopia.com
livejasmin.com localmatchbook.com
llastbuy.ru lolnex.us
lordzfilmz.me lostfilm-online.ru
lrac.info luckyshop.net.ua
m-google.xyz macdamaged.tech
mafa-free.com maglid.ru
mamasuper.prom.ua mainlinehobby.net
marblestyle.ru mantramusic.ru
marcoislandvacations.net
marktforschung-stuttgart.com marktforschung-stuttgart.com
mcar.in.ua matematikus.info
metascephe.com mature.free-websites.com
meteocast.net medicovi.com
michaelkorsoutlet.store meduza-consult.ru
migente.com members.ghanaweb.com
mikrobiologies.ru mil-stak.com
millionare.com mobile-appster.ru
mindbox.co.za mobilemedia.md
mindeyegames.com mobplayer.net
minecraft-rus.org mockupui.com
minegam.com moncleronline.xyz
mobifunapp.weebly.com money-for-placing-articles.com
monclerjacketsoutlet.win
montredemarque.nl montredemarque.nl
moyakuhnia.ru moscow-region.ru
mrmoneymustache.com moscow.online-podarki.com
muschisexbilder.com most.gov.iq
muycerdas.xxx mrsdalloways.com
muz-shoes.ru msk.afora.ru
mydirtyhobby.com mydoctorok.ru
myhitmp3.club myindospace.com
mymercy.info mysex21.com
mystats.xyz nerudlogistik.ru
nakrutka.cc nextconseil.com
nalogovyy-kodeks.ru nfljerseysforsalewholesaler.com
naughtyconnect.com nibbler.silktide.com
neks.info nuup.info
netvouz.com
newstaffadsshop.club
nextbackgroundcheck.gq
nfvsz.com
njpalletremoval.com
novatech.vn
nudejapan.net
nudo.ca
o-o-8-o-o.com o-o-8-o-o.com
oakleyglassesonline.us o.light.d0t.ru
oconto.ru obsessionphrases.com
odoratus.net ofanda.com
offer.camp offer.wpsecurity.website
okuos.com okel.co
onetravelguides.com okout.ru
online-hit.info olympescort.com
ooo-olni.ru oneclickfiles.com
osb.se11.ru oneminutesite.it
onlainbesplatno.ru
online-hd.pl
online-podarki.com
online247.ml
onload.pw
onlythegames.com
open-odyssey.org
ordernorxx.com
orel-reshka.net
ostrovtaxi.ru ostrovtaxi.ru
ourville.info owohho.com
ovirus.ru pagesense.com
p-business.ru paidonlinesites.com
pandroid.co paleohub.info
panouri-solare-acoperis.com panchro.xyz
paparazzistudios.com.au paparazzistudios.com.au
partner-trustworthy.men peekyou.com
pastaleads.com pelfind.me
pateaswing.com pepperstyle.ru
pdn-4.com perederni.net
pensplan.com phelissota.xyz
perosan.com php-market.ru
photosaga.info physfunc.ru
platezhka.net picturesfrom.com
play.leadzupc.com pihl.se
pliks.pl piluli.info
pizdeishn.com
ploenjitmedia.azurewebsites.net ploenjitmedia.azurewebsites.net
poiskzakona.ru poisk-zakona.ru
popserve.adscpm.net polcin.de
popugaychiki.com polimga.pw
pornhive.org popunder.net
pornogad.com popup-jdh.xyz
pornokajf.com pornoelita.info
pornokorol.com pornogig.com
pornotubs.com pornosee.info
portadd.men pornosmola.info
pornoted.com
pornoxxx.com.mx
pornstartits.xblog.in
portal-eu.ru portal-eu.ru
preparevideosafesystem4unow.space poshiv-chehol.ru
pro-okis.ru positive2b.ru
productarium.com priceg.com
promodj.com pricheski-video.com
prostitutki-kharkova.org princeadvantagesales.com
prostitutki-tolyatti.org printdirectforless.com
putevka24.ru privatefx-in.ru
putitin.me pro-poly.ru
randki-sex.com pronorm.fr
rapidokbrain.com prostitutki-tyumeni.org
raschtextil.com.ua pussyspace.net
rasteniya-vs-zombi.ru quangcaons.com
realmonte.net queerspace.com
refudiatethissarah.info rankexperience.com
regionshop.biz rankings-analytics.com
restorator-msk.ru ranksonic.info
rewardit.com reeyanaturopathy.com
ribieiendom.no registrationdomainsite.com
ringporno.com relax.ru
royal-investments.net remybutler.fr
royalvegascasino.com rep-am.com
rumamba.com rfd-split.hr
rusoft-zone.ru rogervivierforsale.com
russintv.fr roll123.com
samo-soznanie.ru roma-kukareku.livejournal.com
sanjosestartups.com rubbed.us
sc-specialhost.com runofilms.ru
scanner-barak.top ruscopybook.com
scanner-margo.top russkoe-zdorovie.ru
se-welding.ru satoristudio.net
see-your-website-here.com scanner-don.top
sendearnings.com scanner-elena.top
seo-traffic-ranking.info scanner-jess.top
seojokes.net scanner-john.top
sevenstars7.com scrapinghub.com
sex-sex-sex5.com searchimpression.com
sexs-foto.top sei80.com
sexvideo-sex.com seksvideoonlain.com
shariki-zuma-lines.ru seoboxes.com
shemale-sex.net sevendays.com.ua
shoesonlinebuy.xyz sexkvartal.com
shop.xz618.com shemalegalls.blogporn.in
shopsellcardsdumps.com shillyourcoins.com
sigmund-freud.co.uk ship-marvel.co.ua
silvercash.com shmetall.com.ua
shtaketniki.ru
signal03.ru
simpoed.ufop.br simpoed.ufop.br
sitechecker.pro sisiynas.ru
skanninge.se sizeplus.work
skladvaz.ru skutecznetabletkinaporostwlosow.pl
slavkokacunko.de skyway24.ru
snjatie-geroinovoy-lomki.ru slim.sellany.ru
soc-econom-problems.ru sloopyjoes.com
socialsignals24.com slowmacfaster.trade
songoo.wz.cz slujbauborki.ru
sophang8.com smart-balancewheel.com
soserfis.com snsdeainavi.info
spb.afora.ru solnplast.ru
spravka130.ru sonata-arctica.wz.cz
srgwebmail.nl songplanet.ru
statoutlook.info spbchampionat.ru
stoki.ru spyfu.com
storehouse.ua storehouse.ua
superkanpo.com strangeduckfilms.com
sureone.pro strongsignal-a.akamaihd.net
tacbelarus.ru stuff-about-money.com
tam-gde-more.ru sugarlyflex.pw
tattooha.com surffoundation.nl
td-33.ru svetlotorg.ru
terraclicks.com swagbucks.com
thecounter.com swingerseiten.com
thegolfclub.info syvertsen-da.no
theheroes.ru tamada69.com
themestotal.com telefonsexsofort.tk
thenews-today.info tetracsaudi.com
threecolumnblogger.com tgtclick.com
timer4web.com theallgirlarcade.com
thebluffs.com
thedownloadfreeonlinegames.blogspot.com
tizanidineandcipro.blogspot.com
tizanidineandgabapentin.blogspot.com
tizanidineandhydrocodone.blogspot.com tizanidineandhydrocodone.blogspot.com
tizanidinehclsideeffects.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidinehydrochloride4mgstreetvalue.blogspot.com tizanidinehcl4mgtab.blogspot.com
tkanorganizma.ru tongkatmadura.info
tmtrck.com topbestgames.com
tobeyouday.win tourismvictoria.com
top1-seo-service.com track2.shop
top10registrycleaners.com
topcasinoratings.ru
topflownews.com
toxicwap.com
traffic100.com traffic100.com
traffic2money.com trafficgenius.xyz
trafficmania.com trafficmonetize.org
trafficmp.com trafficshaper.com
turn-up-life.life traffmonster.info
uac.net.au tramadolandtizanidine.blogspot.com
uchetunet.su trk-4.net
uhdtv.website truebeauty.cc
ultramart.biz turbabitload.weebly.com
umg-stroy.ru tytoona.com
umekana.ru
unblocksit.es
universals.com.ua universals.com.ua
uptime-gamma.net uogonline.com
urlopener.com uprour.com
vandrie-ict.nl url-extractor.xyz
vbtracker.net url-img.link
vekzdorov.ru urldelivery.com
velen.io uroffer.link
vepad.com velpanex.ru
verymes.xyz video-chat.love
vezuviy.su video-production.com
video-chat.in videooko.weebly.com
videogamesecrets.com videtubs.pl
videojam.tv vilingstore.net
virtuagirl.com vkgaleria.com
visitcambridge.org vltai.com
vita.com.hr vzlom-na-zakaz.com
vkontaktemusic.ru w7s.ru
vodkoved.ru warezkeeper.com
watsonrealtycorp.com watch-movies.ru
webcamdevochka.com waysbetter.cn
webextract.profound.net webalan.ru
weblo.com website-analytics.online
website-datenbank.de website-speed-up.site
weprik.ru website-stealer.nufaq.com
westen-v.life westum.se
wfb.hatedriveapart.com whiteelephantwellington.com
wieseversa.no wholesalejerseychinashop.com
whos.amung.us
wildworld.site
williamrobsonproperty.com williamrobsonproperty.com
windowssearch-exp.com witclub.info
wnhjavlhezp.gq ww2awards.info
wnoz.de www.arenda-yeisk.ru
womama.ru www.jbetting.com
wordkeyhelper.com xn--80ahdheogk5l.xn--p1ai
world-mmo.com xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
wormix-cheats.ru xn--80ak6aa92e.com
wosik-dach.service-for-web.de xn--d1acah0c.xn--p1ai
wowcasinoonline.ooo xn--h1ahbi.com.ua
woweb.com.ua xn--l1aengat.xn--p1ai
x-lime.com xnxxandxvideos.com
xcc24.pl yaderenergy.ru
xedserver.com yaminecraft.ru
xev.ru yeartwit.com
xn----9sbubg3ambdfl1j.xn--p1ai yougetsignal.com
xn----ctbigni3aj4h.xn--p1ai youghbould.wordpress.com
xn--80atua3d.xn--p1ai youjizz.vc
xn--d1aifoe0a9a.top yoursearch.me
xtraffic.plus yurgorod.ru
xtrafficplus.com zastenchivosti.net
xuki.us zdesoboi.com
xxxnatelefon.ru
youradexchange.com
za-fun-offer.com
zatjmuzu.info
zebradudka.com zebradudka.com
zkjovpdgxivg.ga zeroredirect6.com
zlatnajesen.com zigzog.ru
zoosexart.com zooggames.com
zootoplist.com zootravel.com
zvetki.ru zryydi.com
zx6.ru
zytpirwai.net

486
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01apple.com 1-99seo.com
101raccoon.ru 214jaluwobapef.cf
12bet.com
1hwy.com
202ch.com
2ads.co.uk 2ads.co.uk
3dracergames.com 3weekdiet.com
4kpics.rocks 4pp13.com
51unlim.ru 9icmzvn6.website
7makemoneyonline.com DomainStatsBot
7xc4n.com aanapa.ru
aac52006ec82a24e08b665f4db2b5013f7.com acheterviagrafr24.com
actices.com adman.gr
activecampaign.dreamhosters.com adnotbad.com
adclickservice.com adserver-e7.com
adrunnr.com ahmedabadwebs.com
agecheckadult.com allmarketsnewdayli.gdn
airmaxshoes-2016.com animal36.com
all4wap.ru anonymousfox.co
alphahoverboards.com apple.com-webbrowsing-security.review
amospalla.es arenda-avtoprokat-krasnodar.ru
anaseracresar.tk arraty.altervista.org
androids-store.com asseenontv.ru
animal-drawings.com atout-energie-69.com
apimossnetinfo-a.akamaihd.net autorn.ru
apiwebwebgetcom-a.akamaihd.net avkzarabotok.com
app-ready.xyz bamo.xsl.pt
arenda-yeisk.ru banksrf.ru
autotop.com.ua battleforupdating.site
avtolombard-krasnodar.com bestfortraders.com
azbukafree.com bezlimitko.xyz
baersaratov.ru bloglag.com
bang-hotties.com bmw-ark.ru
beauty-b0x.pl bonvillan.com
best-businessman.ru brandedleadgeneration.com
best-seo-offer.com bristolhotel.com.ua
bio.trade-jp.net brus.city
blavia.00author.com buigas.00it.com
blog.yam.com buyscabiescream.com
blogos.kz canzoni.ru
bnt-team.com cdncash.net
bookmark4you.com.biz
breastaugmentation.co.za
brk-rti.ru
browserprotecter.com
builtwith.com
burger-imperia.com
buttons-for-your-website.com
buy-forum.ru
buzzurl.jp
callejondelpozo.es
canrioloadm.gq
carsdined.org
cartierlove2u.xyz
cartierreplica.top
centrdebut.ru centrdebut.ru
cheapjerseysbizwholesale.us cezartabac.ro
christianlouboutinsaleoutletonline.us charmstroy.info
coldfilm.ru cheapmoncler.pw
community.allhiphop.com cherubinimobili.it
countbertwistdisp26.soup.io citysecurity.nu
counter.bloke.com compliance-brian.xyz
compliance-nelson.top
compliance-olga.top
compliance-walter.top
coolwallpapers-hd.com
copenergo.ru
cottageofgrace.com
crest-poloski.ru crest-poloski.ru
crest3d.ru culturevie.info
dairyindia.in customerpromos-a.akamaihd.net
dangphoto.trade cwetochki.ru
diusyawiga.tk cxpromote.com
dnepr-avtospar.com.ua darmebel.com.ua
dogbreedspicture.net dawlenie.com
dojki365.online db.speedup.gdn
donna7753191.ru deplim.com
driving.kiev.ua descargar-musica-gratis.net
drupa.com dev33.dioniqlabb.se
duplicashapp.com dfwu1013.info
en.altezza.travel e-biznes.info
essay-writing.work ebooknovel.club
essayservicewriting.org eduinfosite.com
extstat.com enews.tech
ezigarettekaufen2.blox.pl enternet.ee
f0815.de ertelecom.ru
fashion.stellaconstance.co exlarseva.webblog.es
fashionavenuegame.com ezigarettenkaufen1.deviantart.com
feeriaclub.ru ezigaretteshop2.mywapblog.com
fidelityfunding.com f5mtrack.com
fifa-coins.online fable.in.ua
financeloan.us fashionindeed.ml
flagcounter.me fenoyl.batcave.net
find1friend.com
fiverr.com
flavors.me flavors.me
foodgid.net flipper.top
footbalive.org floridamhca.org
forex21.ru
forpostlock.ru forpostlock.ru
freewebs.com free-deals.faith
freshwallpapers.info free-gluten.ru
fuckbuddybestgilf.info freelotto.com
fusoradio.info freza-sverlo.ru
gagrasector.ru galeon.com
galeria-zdjec.com gallerily.com
get-free-social-traffic.com gamedayhouse.com
getridofstretchmarks.org gaygalls.net
gfaq.ru gembird.com
ggiaro.com generalporn.org
globatur.ru generousdeal-a.akamaihd.net
gettpromos.com
glastecfilms.com.my
goo.ne.jp goo.ne.jp
gourcy.altervista.org growshop.es
grtyi.com hccoder.info
guarrasdelporno.xxx healgastro.com
gwhwpxbw.bloger.index.hr heliko.no
hawaiielectriclight.com helpmymacfaster.trade
homedo.fabpage.com hotchatdate.com
hundejo.com hoverboardforsaledirect.com
interfucks.net hoztorg-opt.ru
ipchicken.com i4track.net
iqbazar.ru ibmdatamanagement.co
izismile.com idegenvezeto.eu
jamiembrown.com ifmo.ru
janavibekken.no iloveitaly.ru
keywordspay.com imgarit.pw
kino-rf.ru incolors.club
kountrylife.com insider.pro
krasivoe-hd.net internetartfair.com
kupiproday.com.ua investsuccess.org
larchik.net invivo.hu
lazy-z.com iskalko.ru
leadn.pl islamtoday.co.za
lernur.net iusstf.org
letslowbefast.site ivearchenceinflu.cf
liran-locks.com javspace.net
liverpool.gsofootball.com johnrobertsoninc.com
lodki-pvh.dp.ua kadashihotel.com
lombia.com kasino-money.pw
lovelycraftyhome.com kchaxton.com
magda-gadalka.ru kollekcioner.ru
managerpak204.weebly.com kwzf.net
mcadamssupplyco.com languagecode.com
mebel-alait.ru leadwayau.com
medi-fitt.hu leftofcentrist.com
mediaoffers.click legionalpha.com
medicine-4u.org life-instyle.com
member-quiz.com life.biz.ua
mixx.com lifehacĸer.com
mmostrike.ru likesdesign.com
moetomnenie.com linkpulse.com
moje-recenze.cz livesex-amateure.info
mojowhois.com loadingpages.me
musirc.com locksmith.jp
my-floor.in.ua lol-smurfs.com
networkcheck.xyz low-format.ru
nfljerseysforsalewholesaler.com marcogrup.com
nfvsz.com marsgatan.com
nikhilbahl.com masthopehomes.com
niroo.info mcar.in.ua
no-rx.info medispainstitute.com.au
nomuos.it microsoftportal.net
okeinfo.online mister-shop.com
okmedia.sk mobot.site
omoikiri-japan.ru money-every-day.com
ooo-gotovie.ru multgo.ru
ownshop.cf myperiod.club
paidonlinesites.com nac-bearings.ru
pateaswing.com national-today-winning-winner.club
pathwhelp.org nl.netlog.com
pay2me.pl northfacestore.online
peekyou.com nullrefer.com
perosan.com obesidadealgarve.com
photokitchendesign.com of-ireland.info
phuketscreen.com onlainbesplatno.ru
picmoonco.pw openmediasoft.com
pontiacsolstice.info outrageousdeal-a.akamaihd.net
potoideas.us parajumpersjakkesalgnorge.info
pourvous.info parlament.biz
profitfx.online patterntrader-en.com
proposal-engine.com perederni.net
pulseonclick.com perfection-pleasure.ru
quelle.ru pillscheap24h.com
quickbuck.com pokerniydom.ru
rainbowice.ru pons-presse.com
rent2spb.ru porngalleries.top
rentalcarnavi.info pornophoto.xyz
reversing.cc pornoslive.net
rfserial.net pornosok.ru
richinvestmonitor.com preparevideosafesystem4unow.site
russintv.fr printdirectforless.com
rutor.vip progonrumarket.ru
sa-rewards.co.za pron.pro
salutmontreal.com r-control.ru
sanatorrii.ru rank-checker.online
sarahmilne.top research.ifmo.ru
scanner-don.top rn-to-bsn.com
scanner-fred.top rogervivierforsale.com
scanner-jack.top rospromtest.ru
scanner-mark.top royal-betting.net
scat.porn sammlungfotos.online
sdrescher.net sampleletters.net
search.xtconnect.com searchlock.com
seksotur.ru semaltmedia.com
seo-smm.kz sexpornotales.com
seoexperimenty.ru sexvporno.ru
sexspornotub.com site-analyzer.com
sharpchallenge.com sitechecker.pro
sildenafilcitratemed.com sitevalued.com
soc-proof.su smadihome.com
socialtrade.biz smart-scripts.com
sockshare.net softlinesolutions.me
solitaire-game.ru sribno.net
sosdepotdebilan.com stmassage.ru
souvenir.cc strana-krasoty.ru
stair.registrydomainservices.com stroyhelp-dv.ru
statoutlook.info superstarfloraluk.com
sterva.cc taraz.xkaz.org
streamin.to tedxrj.com
stroiminsk.org templates.radiodigital.co
stroy-portal22.ru tengohydar.tk
suggest-keywords.com thelottosecrets.com
surcentro.com thepokertimer.com
surfbuyermac.com thewomenlife.com
tacbelarus.ru tizanidinehydrochloride2mg.blogspot.com
takethatad.com tizanidineonline.blogspot.com
tattooha.com tizanidinepain.blogspot.com
telegramdownload10.com tizanidinesideeffects.blogspot.com
thepornsex.org tour-line.net
tizanidinedosage.blogspot.com tracksz.co
tizanidinerestlesslegsyndrome.blogspot.com trkdf.com
topcasinoratings.ru tubeoffline.com
toursmaps.com tula.howotorg.ru
tovaroboom.vast.ru turbo-suslik.org
trustedhealthtips.com turvgori.ru
typer.one tvand.ru
u555u.info tvteleport.ru
unitexindia.com unitexindia.com
upstore.me uptime-alpha.net
valmetrundan.se utiblog.fr
vegascosmetics.ru velen.io
veselokloun.ru venerologiya.com
videochat.ph verymes.xyz
vip-file.com videtubs.pl
vonradio.com vikistars.com
wheelchairliftsarea.com vipms.ru
wholesalejerseys-cheapest.com voloo.ru
windowssearch-exp.com vremya.eu
womensplay.net webpromotion.ae
xgames-04.com wemedinc.com
xn----7sbho2agebbhlivy.xn--p1ai whiteelephantwellington.com
xn--80aaagvmjabrs1aoc9luc.xn--p1ai whiteproduct.com
xtraffic.plus wholesalejerseychinaoutlet.com
xxxrus.org word-vorlagen.xyz
yaaknaa.info wovis.site
yginekologa.com www.jbetting.com
youtubedownload.org www.pinnacle-bets.com
youtubologia.it xingzi-vision.com
za-music.mymobiplanet.com xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xn--80ahvj9e.xn--p1ai
xrus.org
xsion.net
yellowfootprints.com
youdao.com
youtoner.it

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.204 0; 10.1.0.74 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2968 ### Version: V4.2022.03.2969
### Updated: Wed Mar 9 10:03:37 UTC 2022 ### Updated: Wed Mar 9 22:01:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.03.2968 ### Version: V4.2022.03.2969
### Updated: Wed Mar 9 10:03:37 UTC 2022 ### Updated: Wed Mar 9 22:01:30 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##