vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-02 18:50:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.02.2946 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-02-26 22:07:22 +00:00
parent 23ab0061a4
commit 4bbc6480b3
46 changed files with 91439 additions and 91439 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2945 #### Version: V4.2022.02.2946
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.02.2945 #### Version: V4.2022.02.2946
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -13,7 +13,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.02.2945 #### Version: V4.2022.02.2946
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11294
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.02.2945 #### Version: V4.2022.02.2946
#### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7092](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [636](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11298
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11298
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11298
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11298
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
2945 2946

11298
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11298
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.15.89 0; 20.114.40.123 0;

11298
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

11298
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.15.89 0; 20.114.40.123 0;

11298
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.114.15.89 0; 20.114.40.123 0;

11298
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 1; 10.1.1.112 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
BunnySlippers Alexibot
GrapeFX AwarioRssBot
JOC Web Spider DomainSigmaCrawler
Lightspeedsystems HTMLparser
Linkbot Humanlinks
Minefield PeoplePal
PageGrabber Sosospider
WebEnhancer ZoominfoBot
WebZIP crawler4j
zgrab x09Mozilla

314
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
404checker 360Spider
404enemy 404enemy
ALittle Client 80legs
AIBOT
ASPSeek ASPSeek
Aboundex Abonti
Aboundexbot
Aipbot Aipbot
AlphaBot Alexibot
BBBike AllSubmitter
BLEXBot Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BackWeb BackWeb
BacklinkCrawler Backlink-Ceck
Badass Badass
Barkrowler Barkrowler
BatchFTP
Battleztar Bazinga Battleztar Bazinga
BetaBot
Bigfoot Bigfoot
BlackWidow Black Hole
Blow
BlowFish BlowFish
Bolt BotALot
Brandprotect BuiltBotTough
Brandwatch BuiltWith
Bullseye
CATExplorador CATExplorador
CCBot
CODE87 CODE87
CSHttp Cegbfeieh
CherryPicker CensysInspect
Claritybot CheTeam
Cliqzbot Citoid
Cloud mapping
Cocolyzebot Cocolyzebot
Cogentbot Cogentbot
Collector CyotekWebCopy
Copier DSearch
CopyRightCheck Demon
Copyscape Devil
Cosmos Digincore
Curious DigitalPebble
DBLBot Dirbuster
DTS Agent
Deusu
Disco
Discobot Discobot
DittoSpyder DnyzBot
DomainAppender DomCopBot
Dotbot Domains Project
Download Wonder EroCrawler
Drip Express WebPictures
EasyDL Extractor
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
ExtractorPro ExtractorPro
Extreme Picture Finder Extreme Picture Finder
EyeNetIE EyeNetIE
FDM FDM
FemtosearchBot
Fimap Fimap
Firefox/7.0
FlashGet FlashGet
Freeuploader Flunky
FyberSpider GT::WWW
Genieo
GermCrawler
GetRight
GetWeb GetWeb
Getintent
Gigabot Gigabot
Go!Zilla HMView
GoZilla HTTP::Lite
Gotit
GridBot
HTMLparser
HTTrack HTTrack
Haansoft Haansoft
Havij Harvest
Heritrix Hloader
IDBTE4M HonoluluBot
HybridBot
IlseBot IlseBot
Image Fetch
IndeedBot
Indy Library
Intelliseek
InterGET InterGET
InternetSeer
Iskanie Iskanie
IstellaBot IstellaBot
JOC Web Spider JetCar
Jbrofuzz
Jetty Jetty
JustView Joomla
Jyxobot Kenjin Spider
Lanshanbot Kozmosbot
Leap LexiBot
LeechGet Libwhisker
LibWeb Lightspeedsystems
Likse LinkScan
LinkWalker LinkWalker
Linkbot
LinkextractorPro LinkextractorPro
LinksManager
Lipperhey Lipperhey
Lmspider Lipperhey Spider
Ltx71 Litemage_walker
MIDown tool MIDown tool
MSFrontPage MIIxpc
MSIECrawler MJ12bot
MTRobot MTRobot
Magnet Mag-Net
Mail.RU_Bot Majestic-SEO
Majestic SEO Majestic12
MarkMonitor
Masscan Masscan
MauiBot Mata Hari
Mb2345Browser Mb2345Browser
MeanPath Bot Mediatoolkitbot
MegaIndex.ru MicroMessenger
Mister PiX Microsoft Data Access
Mojeek
Mojolicious
MolokaiBot MolokaiBot
Mozlila Mr.4x3
Msrabot
Musobot Musobot
NICErsPRO Navroad
NPbot
Name Intelligence
NearSite NearSite
Needle Net Vampire
NetSpider NetSpider
Netcraft NetZIP
Nettrack
NextGenSearchBot NextGenSearchBot
Nikto Not
Ninja Nutch
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler OpenLinkProfiler
Openfind OpenVAS
OrangeSpider
OutclicksBot OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
PageScorer
Pandalytics Pandalytics
Panscient Panscient
Petalbot Papa Foto
Pavuk
PeoplePal
Pi-Monster Pi-Monster
Piepmatz Picscout
PictureFinder
Pockey
Probethenet Probethenet
Psbot Psbot
Pu_iN
Pump Pump
QueryN Metasearch PxBroker
RankActiveLinkBot Quick-Crawler
RSSingBot
RankFlex RankFlex
Re-re
ReGet ReGet
RealDownload
RebelMouse RebelMouse
Recorder Recorder
RepoMonkey RepoMonkey
SEOkicks-Robot SEOkicks-Robot
SEOprofiler SEOlyticsCrawler
SEOstats SEOstats
SISTRIX
ScanAlert ScanAlert
Scanbot Scanbot
Screaming
ScrepyBot
SearchmetricsBot SearchmetricsBot
SentiBot
SeoSiteCheckup SeoSiteCheckup
SeobilityBot SiteSnagger
Siphon
SiteSucker SiteSucker
SiteSucker SocialRankIOBot
SlySearch
Snapbot
Snoopy
SpaceBison SpaceBison
Spinn3r SpankBot
Sqlworm Stripper
Sqworm SuperBot
Steeler SuperHTTP
Sucker
Surfbot Surfbot
Suzuran Szukacz
T8Abot T8Abot
Telesoft Telesoft
TheNomad The Intraformant
Tracemyfile TightTwatBot
Turingos
TurnitinBot TurnitinBot
TwengaBot Twice
Typhoeus VB Project
URLy Warning VCI
URLy.Warning Vacuum
UnisterBot Vagabondo
Upflow VidibleScraper
VeriCiteCrawler Virusdie
Voil Voil
WBSearchBot WASALive-Bot
WEBDAV WWW-Collector-E
WISENutbot WWW::Mechanize
WPScan
WWWOFFLE
Wallpapers Wallpapers
WallpapersHD Wallpapers/3.0
WeSEE WeSEE
Web Fetch
Web Fuck
Web Collage Web Collage
WebEnhancer Web Fuck
WebFetch Web Sauger
WebBandit
WebCopier
WebGo IS WebGo IS
WebLeacher
WebPix WebPix
WebWhacker WebReaper
WebZIP WebSucker
Webalta WebmasterWorldForumBot
Whacker Webshag
WebsiteQuester
Who.is Bot
Widow
Wonderbot Wonderbot
Woobot Woobot
Wotbox Wprecon
YoudaoBot Xaldon WebSpider
Zauba Xenu
Zitebot
ZoomBot ZoomBot
ZyBorg adscanner
archive.org_bot arquivo-web-crawler
arquivo.pt arquivo.pt
autoemailspider check1.exe
cognitiveseo coccocbot
com.plumanalytics
crawl.sogou.com
crawler4j crawler4j
dataforseo.com domainsproject.org
evc-batch eCatch
facebookscraper facebookscraper
instabid instabid
iubenda-radar internetVista monitor
lwp-request lwp-request
lwp-trivial lwp-trivial
magpie-crawler magpie-crawler
muhstik-scan meanpathbot
page scorer mediawords
pcBrowser netEstate NE Crawler
plumanalytics polaris version
probe-image-size probe-image-size
satoristudio.net
scalaj-http scalaj-http
seobility
seoscanners
seostar
serpstatbot serpstatbot
sexsearcher siteripz
sitechecker.pro spyfu
sp_auditbot sysscan
ubermetrics-technologies.com ubermetrics-technologies.com
voyagerx.com voyagerx.com
webprosbot webmeup-crawler
webpros.com
xpymep1.exe xpymep1.exe
zauba.io
zgrab zgrab

298
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
01h4x.com 01h4x.com
360Spider
404checker 404checker
80legs
AIBOT AIBOT
ALittle Client ALittle Client
Abonti
Aboundexbot Aboundexbot
Acunetix
AhrefsBot AhrefsBot
Aipbot Aipbot
AllSubmitter AllSubmitter
Anarchie
Anthill
Aspiegel
Asterias
Atomseobot Atomseobot
Attach Attach
BackDoorBot BDFetch
BLEXBot
BackStreet BackStreet
BackWeb Backlink-Ceck
Bandit Badass
Bitacle BatchFTP
Black Hole Black Hole
BlackWidow Brandwatch
Blackboard Buck
Blow
Buddy Buddy
BuiltBotTough BuiltWith
BuzzSumo BunnySlippers
CensysInspect CODE87
CheTeam CSHttp
CazoodleBot
Cegbfeieh
CherryPicker CherryPicker
Chlooe Claritybot
Citoid
Cliqzbot
Cloud mapping Cloud mapping
Cocolyzebot CopyRightCheck
Collector Copyscape
CrazyWebCrawler Crawling at Home Project
CrunchBot
Curious
Custo
DBLBot
DataCha0s
Devil Devil
Digincore
DigitalPebble
Disco
Discobot
Discoverybot Discoverybot
Dispatch DnyzBot
DnBCrawler-Analytics DomCopBot
DomainAppender
DomainCrawler DomainCrawler
DomainSigmaCrawler DomainSigmaCrawler
DomainStatsBot Domains Project
Dotbot Dotbot
EMail Wolf Drip
Ebingbong ECCP/1.0
EMail Siphon
Ecxi Ecxi
EirGrabber
EroCrawler EroCrawler
Exabot
ExtLinksBot ExtLinksBot
ExtractorPro ExtractorPro
EyeNetIE FDM
FlashGet Firefox/7.0
Foobot Flunky
Freeuploader Freeuploader
Fuzz GT::WWW
FyberSpider
Fyrebot
GalaxyBot
GermCrawler GermCrawler
Gigabot
Go!Zilla Go!Zilla
Gotit GoZilla
GrapeFX Grabber
HEADMasterSEO HEADMasterSEO
HTMLparser HTTP::Lite
HTTrack HybridBot
Haansoft
Havij
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot IRLbot
Iblog Iblog
Image Fetch Image Fetch
IndeedBot Image Sucker
Indy Library Indy Library
InterGET InfoNaviRobot
Intelliseek
Internet Ninja Internet Ninja
Iria InternetSeer
Iskanie IstellaBot
JOC Web Spider
JamesBOT JamesBOT
Jbrofuzz Jbrofuzz
Jetty JetCar
Keyword Density JustView
Lanshanbot Jyxobot
Larbin Kenjin Spider
Leap LNSpiderguy
LeechFTP LeechFTP
Libwhisker LexiBot
Likse Lftp
LinkWalker
Linkbot Linkbot
LinkpadBot LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot LinqiaMetadataDownloaderBot
LinqiaRSSBot Lipperhey Spider
LinqiaScrapeBot Ltx71
Lipperhey MFC_Tear_Sample
MIDown tool MQQBrowser
MJ12bot
MSFrontPage MSFrontPage
Mag-Net
Magnet Magnet
Majestic SEO MarkMonitor
Majestic-SEO
Mass Downloader Mass Downloader
Masscan Masscan
Mata Hari Mata Hari
MegaIndex.ru MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield Minefield
Moblie Safari Mister PiX
Mojolicious Morfeus Fucking Scanner
MolokaiBot
Mr.4x3
Msrabot Msrabot
Musobot Musobot
NICErsPRO NICErsPRO
Nameprotect
Navroad
NearSite
NetLyzer NetLyzer
NetZIP NetMechanic
NetSpider
Netcraft Netcraft
Netvibes
Nibbler
Nikto
Ninja
Nmap Nmap
Nutch Nuclei
Offline Explorer Offline Explorer
Openvas
OrangeBot
OrangeSpider
OutfoxBot OutfoxBot
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageThing.com PageAnalyzer
Pavuk PageScorer
Pandalytics
Picsearch
PictureFinder
Pixray Pixray
PleaseCrawl Pockey
Pu_iN ProPowerBot
RankActive Probethenet
Pump
PxBroker
RSSingBot
RankingBot
RankingBot2 RankingBot2
Rankivabot Reaper
ReGet SEOkicks-Robot
Recorder
SEOkicks
SEOlyticsCrawler
SEOprofiler SEOprofiler
SMTBot SISTRIX
Searchestate
SearchmetricsBot
Seekport Seekport
SemanticJuice Semrush
SeobilityBot SentiBot
SeoSiteCheckup
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker SiteSucker
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil Sitevigil
Sogou web spider SlySearch
SputnikBot Snake
Snoopy
Sociscraper
SpaceBison
Spammen
Spinn3r
Sqlmap Sqlmap
Sqworm Steeler
Sucker Sucker
Sucuri SuperBot
Swiftbot SuperHTTP
SurveyBot
T8Abot T8Abot
Teleport
TeleportPro TeleportPro
Telesoft Telesphorep
Thumbor
Toata Toata
Toweyabot
Trendiction
Trendictionbot Trendictionbot
True_Robot Turnitin
Twice
URLy.Warning URLy.Warning
UnisterBot Upflow
VB Project VB Project
Vagabondo VCI
VelenPublicWebCrawler Vacuum
VeriCiteCrawler
VidibleScraper VidibleScraper
Virusdie Voil
Voltron
WASALive-Bot WASALive-Bot
WWW-Collector-E WWW-Collector-E
WWW::Mechanize WWW::Mechanize
WWWOFFLE
Wallpapers Wallpapers
WeSEE WallpapersHD
Web Collage Web Collage
Web Fetch
Web Fuck Web Fuck
Web Sucker
WebCollage
WebCopier
WebEnhancer
WebFuck
WebLeacher
Web Sauger Web Sauger
WebAuto
WebCollage
WebGo IS
WebImageCollector
WebSucker
WebWhacker WebWhacker
Webalta WebZIP
Website Quester WebmasterWorldForumBot
Webshag
Webster
Whack
Whacker Whacker
Widow Widow
Woobot Woobot
Wotbox
Xaldon WebSpider Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot YoudaoBot
Zauba Zauba
Zermelo Zermelo
Zitebot
ZmEu
ZoomBot ZoomBot
ZoominfoBot
ZyBorg ZyBorg
arquivo-web-crawler archive.org_bot
arquivo.pt
autoemailspider autoemailspider
backlink-check
cah.io.community cah.io.community
coccocbot cognitiveseo
crawl.sogou.com crawl.sogou.com
crawler4j crawler4j
dataforseo.com
demandbase-bot
eCatch eCatch
evc-batch evc-batch
gopher instabid
ips-agent ips-agent
iubenda-radar iubenda-radar
lwp-request
lwp-trivial lwp-trivial
magpie-crawler muhstik-scan
mediawords netEstate NE Crawler
oBot plumanalytics
page scorer probe-image-size
polaris version scan.lol
satoristudio.net seobility
seocompany.store
serpstatbot serpstatbot
sp_auditbot sexsearcher
trendiction.com sitechecker.pro
trendiction.de sogouspider
webmeup-crawler sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com webpros.com
webprosbot webprosbot
x09Mozilla x09Mozilla
zgrab zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
awaybird.ru allbizne.co.ua
break-the-chains.com binomo.kz
cam-kontakte.org dgfitness.co
geilehausfrauen.net dodlive.mil
moscow-region.ru gelezki.com
shopsellcardsdumps.com ivoiretechnocom.ci
sientalyric.co kongruan.com
thegolfclub.info map028.com
videokrik.net pistonclasico.com
westermarkanjou.se try-rx.com

934
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
101flag.ru 1-free-share-buttons.com
12u.info 2015god.org
24-ak.ru 21h2o.com
2x2fan.ru 51.la
7ooo.ru aa9d046aab36af4ff182f097f840430d51.com
7yue.org aac500b7a15b2646968f6bd8c6305869d7.com
991mostfm.co.id aanapa.ru
999webdesign.com academiacsmendoza.org
aa81bf391151884adfa3dd677e41f94be1.com acads.net
absolutelyanalog.com actices.com
addtoadd.men actulite.com
ads.gold adinterax.com
ads.tremorhub.com ads-seo.men
adsland.men adtech.us
advokat-grodno.by adultactioncam.com
aero2.ru adultnet.in
agapovdg.ru advertex.info
agroeconom.kz afmuseum.com
agysya.ru ald2014.org
air-edem.ru alevinefesleri.com
aksonural.ru allmarketsnewdayli.gdn
alekseevec.ru alphahoverboards.com
alfa-img.com alphavisions.net
all4invest.ru amoi.tn
alldownload.pw aosheng-tech.com
allesohnegirls.net apioasisspacenet-a.akamaihd.net
alloysteel.ru apispringsmartne-a.akamaihd.net
altamayoztourism.com asia-forum.ru
alveris.ru asociatia-tipografilor-transilvania.ro
am-se.com auto-moto-elektronika.cz
anabolics.shop autobudpostach.club
android-style.com automobile-spec.com
apartmentratings.com aversis.net
apelsinnik.website avon-ukraine.com
apiluckyleapnet-a.akamaihd.net avtointeres.ru
apioutoboxnet-a.akamaihd.net ayanaspa.com
appsaurus.com azartmsl.com
apxeo.info balkanfarma.org
arius.tech balla-boo.se
asrvvv-a.akamaihd.net balois.worldbreak.com
atlasvkusov.ru bangla-chat-uk-paralud.ga
audiobangout.com
australia-opening-times.com
autoloans.com
autoseo-traffic.com
azarttoto.com
bablonow.ru
balook.com
basisches-wasser.net basisches-wasser.net
beauty-clinic.ru bbtec.net
becuo.com best-seo-offer.com
bikini-image.com best-seo-solution.com
billiard-classic.com.ua bestadbid.com
bimatoprost-careprost.com.ua bestbrainprod.win
bitcoinpile.com bet365.com
beta.hotkeys.com
betonka.pro
bgviagrachrx.com
bigpictures.club
bio-market.kz
biznesschat.net biznesschat.net
bjorkbacken.nu
boanonihaca.tk boanonihaca.tk
bolegapakistan.com bolitgorlo.net
boleznikogi.com bonux.nextview.ru
bolezniorganov.ru boobsimge.com
bongiornos.info brains2.biz
bonzibuddi.com brainsandeggs.blogspot.com
bpro1.top brandimensions.com
brandehk.dk brendbutik.ru
brianhenry.co brewdom.ru
brk-rti.ru bristolhotel.com.ua
brothers-smaller.ru
btvn.ru
buehne-fuer-menschenrechte.de buehne-fuer-menschenrechte.de
buketeg.xyz bum.com.ru
buy-loft.ru bumble.cheapwebsitehoster.com
buyclomidonlaine.com burn-fat.ga
buydissertation.net bytimedance.ru
buyessayonline19.blogspot.ru cakesplus.com.au
buzz-porno.info callejondelpozo.es
bzero1jewelry.net capsderfudd.tk
c1.onedmp.com cardsdumps.com
calcularpagerank.com cartechnic.ru
candiceloves.us cascadelink.org
candy-glam-hp.com casinopinup-wins.com
cannibalcheerleader.com ccjp.eu
canrioloadm.gq changde.58.com
cardiosport.com.ua cherrypointplace.ca
cardul.ru christianlouboutinshoes.xyz
carloans.com
cartierlovestore.com
cartierreplica.top
cartierreplica.win
cartiertrinity.xyz
celebsopics.com
chocoslim.pro
christianlouboutinsaleoutletonline.us
cialischstgerts.com cialischstgerts.com
cinemaflix.website cicaki.net
click2pawn.com cienum.fr
clickintext.net clevernt.com
clksite.com clodo.ru
coderstate.com club-lukojl.ru
concordexoticrentals.com cmhomestayagency.com
conocer-sanabria.com compliance-jess.top
cool-wedding.net conciergegroup.org
coolbar.pro confib.ifmo.ru
cowlmash.com coolingoods.com
customsua.com.ua counterbot.com
cwetochki.ru creativehutindia.com
cypernhuset.se creditwell.ru
cyse.tk crirussian.ru
ddsoldes.fr cubs-jerseys.us
defenderxtactical.com customerguru.in
dentfidemountpreach.tk daptravel.com
derevesendeco.com datadepths.com
dfwu1013.info dataloading.net
digitalassetmanagement.site dbmkfhqk.bloger.index.hr
dimfour.com deanmoore.ie
diusyawiga.tk dekoration.us
diy-handmade-ideas.com deluxedumps.com
documentbase.net design-ideas.info
doeco.ru designdevise.com
domaincdn.xyz deutschehobbyhuren.net
dostavka-v-ukrainu.ru dev.citetick.com
downvids.net dignitasdata.se
doyouknowtheword-flummox.ml dinkolove.ya.ru
drillsaw.ru directrev.com
drugs-no-rx.info docstoc.com
dvr.biz.ua dojki365.online
ebonyporn.site domain-submit.info
ebooknovel.club dominateforex.ml
eduserver.net domination.ml
downloads-whatsapp.com
dyshagi.ru
e-c.al
e-collantes.com
e-poker-2005.com
eager-nash.188-93-233-196.plesk.page
ecxtracking.com
edwinkonijn.com.au
egovaleo.it
ekaterinburg.xrus.org ekaterinburg.xrus.org
ekto.ee
el-nation.com
elektronischezigarettekaufen1.beeplog.com
elektrozigaretten1.postbit.com elektrozigaretten1.postbit.com
elitepcgames.com emediate.eu
enpolis.ru energy-ua.com
eupornstar.info eropornosex.ru
euromasterclass.ru essay-edu.biz
ezb.elvenmachine.com european-torches.ru
f-loaded.de europeanwatches.ru
familienzahnaerzte.com executehosting.com
fanrto.com exoneration-project.us
farmprofi.net extener.org
fba-mexico.com extrabot.com
feargames.ru ezaz.info
ff30236ddef1465f88547e760973d70a.com f5mtrack.com
fickenprivat.info fable.in.ua
fifa-coins.online familyholiday.ml
filmidivx.com fantasticpixcool.com
findthe.pet fashion.stellaconstance.co
fm-upgrade.ru fenoyl.batcave.net
footballfarrago.com fetroshok.ru
forums.d2jsp.org fettefrauen.net
foxweber.com financeloan.us
franecki.net financepoints.eu
free-deals.faith findsexguide.com
free-traffic.xyz fishtauto.ru
frvo.alptandem.ru fitnesspiks.com
fsalas.com flowwwers.com
fullgirl.ru fodelsedagspresenter.nu
game-mmorpg.net forex21.ru
gamedayassist.com forms-mtm.ru
gamerextra.com forpostlock.ru
geckoandfly.com forum.poker4life.ru
geileweiber.tk foto-telok.net
genericlowlatencyasiodriverhq.aircus.com free-fb-traffic.com
get-free-traffic-now.com free-fbook-traffic.com
gg-arena.ru free411games.com
girlgamerdaily.com freefoto.ca
freelifetimefuckbook.com
freelinkbuilding.website.tk
freeuploader.ml
freevpn.space
fuckmill.com
funcrushgames.com
fusoradio.info
g33.org
gamewrath.com
gamingspark.com
gepezz.info
girls-ufa.ru girls-ufa.ru
girlsatgames.ru gkvector.ru
girlsfuckdick.com globatur.ru
glavtral.ru go2jump.org
glogow.pl go2mike.ru
goldandcard.ru goodly.pro
gombita.info googglet.com
gratuitbaise.com gribokstop.com
greamimgo.pw guardlink.org
greatgrace.ru gunsvicceadadebt.tk
gta-top.ru hd-film.pl
gwebtools.com hdimagelib.com
handsandlegs.ru hesteel.pl
hanink.biz.ly highstairs-a.akamaihd.net
harmonyglen.us histats.com
hdimagegallery.net hmywwogw.bloger.index.hr
healbio.ru hoholikik.club
hentaiheroes.com homedecorpicture.us
hit-men.men homedo.fabpage.com
hjaoopoa.top host-tracker.com
hobbyhuren-datenbank.com
hobbyhuren24.net
homeart.space
hornymatches.com
hoste.octopis.com
hotblognetwork.com hotblognetwork.com
hoverboard360.nl hotkeys.com
htmlcorner.com hscsscotland.com
hyhj.info hulfingtonpost.com
ifmo.ru humanelydrew.com
ilbe.club hyipmanager.in
imagecoolpub.com iideaidekonkatu.info
imgata.com ilo134uloh.com
imk.com.ua imagefinder.site
infazavr.ru imagine-ex.co
insider.pro imguramx.pw
inspiring-desperate.tk incanto.in.ua
iskalko.ru incep.imagine-ex.co
istizanidineanopiate.blogspot.com inet-traffic.com
itrevolution.cf inome.com.ua
iweblist.info intimshop-fantasy.ru
janettabridal.com investyb.com
jav-idol.com ipornox.xxx
javitas.info isotoner.com
jaxcube.info ispaniya-costa-blanca.ru
junketjuice.blogspot.com itbc.kiev.ua
jus0wil.pp.ua itsdp3.com
justprofit.xyz ivearchenceinflu.cf
katadhin.co ix20.ru
kazan.xrus.org izhevsk.zrus.org
kchaxton.com kareliatobacco.ru
kerei.ru kerei.ru
keywordhut.com kino-key.info
keywords-monitoring-success.com kinofak.net
khafre.us kirov.zrus.org
kihi.gdn kliksaya.com
kit-opt.ru konpax.com
klitimg.pw koronirealestate.gr
konteiner24.com kountrylife.com
kovesszucs.atw.hu
krafte.ru krafte.ru
kraljeva-sutjeska.com krasnodar.ru
kurwa.win krasnodar.zrus.org
lecbter-relationships.ga kutikomi.net
lesbian.xyz kuzinsp.ru
lietaer.com lacapilla.info
lifeinsurancekb.com ladov.ru
lignofix.ua lancheck.net
link.ac landinez.co
linkrr.com landscaping.center
lasvegaslockandsafe.com
laxdrills.com
leadwayau.com
lennatin.info
linkbolic.com
linksharingt.com
lirunet.ru lirunet.ru
livingcanarias.com
localflirtbuddies.com localflirtbuddies.com
lovelycraftyhome.com locimge.pw
lovi-moment.com.ua lolnex.us
lsp-awak-perikanan.com lombia.com
lumb.co lonfon.xyz
maladot.com longgreen.info
malls.com lotto6888.com
mamasuper.prom.ua louboutinreplica.xyz
manimpotence.com lowephotos.info
map028.com lrac.info
mastershef.club mafa-free.com
matchpal-a.akamaihd.net magda-gadalka.ru
max-p.men malwareremovalcenter.com
meccadumps.net manipulyator-peterburg.ru
medi-fitt.hu martlinker.com
mediafresh.online masterseek.com
mediawhirl.net masturbate.co.uk
matsdale.com
mazda-roadsters.com
mcadamssupplyco.com
mearns-tractors.co.uk
mebel-ekb.com
medanestesia.ru
megahdporno.net megahdporno.net
menetie.ru
mesto-x.com
metaxalonevstizanidine.blogspot.com
mexicotravelnet.com mexicotravelnet.com
middlerush-a.akamaihd.net mielec.pl
mikrobiologies.ru minecraft-neo.ru
minegam.com mir-business-24.ru
mir-limuzinov.ru misslike.ru
misterjtbarbers.com mmgq.ru
mmoguider.ru mokrayakiska.com
mobile-appster.ru monclerjacketsoutlet.win
mobplayer.ru mowser.com
moi-glazki.ru mrsdalloways.com
money-every-day.com muz-shoes.ru
moneymaster.ru
morpicert.pw
mountainstream.ms
mrmoneymustache.com
msk.afora.ru
muabancantho.info
musezone.ru
music7s.me
musicdaddy.net
mvpicton.co.uk mvpicton.co.uk
mybinaryoptionsrobot.com mybackgroundlandscape.blogspot.com
mykings.pw mymobilemoneypages.com
myliveblog.ru nakozhe.com
naturalbreakthroughsresearch.com nelc.edu.eg
needtosellmyhousefast.com net-radar.com
neodownload.webcam nextlnk12.com
netvouz.com nfvsz.com
nextrent-crimea.ru nicovideo.jp
nikhilbahl.com nikitsyringedrivelg.pen.io
nomuos.it nina.az
notfastfood.ru noclegonline.info
o-o-11-o-o.com nsatc.net
obsessionphrases.com nvformula.ru
offers.bycontext.com o.light.d0t.ru
officedocuments.net obnal.org
one-gear.com oconto.ru
online-sbank.ru ok-ua.info
online-x.ru okel.co
onlinewritingjobs17.blogspot.ru oktube.ru
open-odyssey.org oneclickfiles.com
otbelivanie-zubov.com oneminutesite.it
oynat.info openstat.com
oz-offers.com optitrade24.com
papasdelivery.ru outrageousdeal-a.akamaihd.net
par-fallen.ga oxford-book.com.ua
parajumpersjakkesalgnorge.info paccohichetoti.ml
pc-services.ru paceform.com
pcimforum.com paclitor.com
pdamods.ru painting-planet.com
perosan.com panouri-solare-acoperis.com
pestomou.info paperwritingservice17.blogspot.ru
picsforkeywordsuggestion.com paradontozanet.ru
piluli.info partner-cdn.men
pio.polytopesexempt.com patol01.pw
pixelrz.com pensplan4u.com
php-market.ru
piccdata.com
pillscheap24h.com
pintattoos.com
piter.xrus.org
pixshark.com pixshark.com
placid-rounded-coast.glitch.me
plastgranar.nu plastgranar.nu
poem-paying.gq platinumdeals.gr
pons-presse.com pobeiranie.pl
poppen-nw.net pochtovyi-index.ru
pokemon-go-play.online
polybuild.ru
popup-hgd.xyz popup-hgd.xyz
porno-transsexuals.ru popup-jdh.xyz
pornofeuer.com pornhub-ru.com
pornoklad.ru pornogig.com
pornophoto.xyz pornoreino.com
pospr.waw.pl pornotubs.com
preventheadacheguide.info portal-eu.ru
potoideas.us
pozdrawleniya.com
pozvonim.com
praisong.net
printdirectforless.com printdirectforless.com
printingpeach.com printingpeach.com
prod2016.com privatbank46.ru
prodess.ru prodess.ru
producm.ru proftests.net
prokotov.com
prostitutki-kharkova.org
psa48.ru psa48.ru
py100.ru puzo2arbuza.ru
qexyfu.bugs3.com rangoman.date
quebec-bin.com redirlock.com
qwarckoine.com referencemoi.com
r-e-f-e-r-e-r.com registry-clean-up.net
rapevideosmovies.com relayblog.com
rarbg.to resant.ru
rating-casino2021.ru responsive-test.net
razamicroelectronics.com retailwith.com
realnye-otzyvy.info rewardit.com
regdefense.com riders.ro
registry-cleaner.net rocketchange.ru
remmling.de rostov.xrus.org
remont-fridge-tv.ru ruex.org.ua
remont-ustanovka-tehniki.ru russian-postindex.ru
rfd-split.hr russkie-gorki.ru
rfserial.net sa-rewards.co.za
rome2rio.com sady-urala.ru
rossmark.ru santasgift.ml
royalcar-ufa.ru sbf441.com
rp9.ru scanner-barak.top
rvi.biz scanner-julianna.top
samara.rosfirm.ru scat.porn
saneyes.com searchaddis.com
sanjosestartups.com sell-fb-group-here.com
sarf3omlat.com semalt.com
satellite.maps.ilovevitaly.com semxiu.com
scanner-alex.top seo-smm.kz
scanner-fred.top seoboxes.com
scanner-mark.top sex-sex-sex5.com
scanner-marwin.top sex-watch.com
scrapinghub.com sharebutton.net
search.1and1.com sharebutton.to
searchengineranker.email shijian.ac.cn
searchkut.com shmetall.com.ua
searchtooknow-a.akamaihd.net shohanb.com
secretscook.ru sibtest.ru
seinterface.com sibvitr.ru
seksotur.ru simple-share-buttons.com
selectads.men simplepooltips.com
seoexperimenty.ru sindragosa.comxa.com
seolab.top sitiz.club
serialsway.ucoz.ru sivs.ru
seryeznie-znakomstva.ru slomm.ru
sex-foto.pw slutloadlive.com
sexblog.pw snip.to
sexfreepornoxxx.com socas.pluto.ro
sexgalleries.top softonicads.com
sexs-foto.com souvenir.cc
shikiso.info space4updating.win
shitmovs.com spymac.net
shitting.pro stard.shop
sierraapps.com startufa.ru
sigmund-freud.co.uk sterva.cc
sildenafil-tadalafil.info storehouse.ua
sinestesia.host.sk
sisiynas.ru
sklad-24.ru
skutecznetabletkinaporostwlosow.pl
sledstvie-veli.net
slowmacfaster.trade
sluganarodu.ru
smartshoppymac.com
snts.shell-pmr.ru
socialmadesimple.com
sogimlecal.tk
solution4u.com
sonnikforme.ru
spywarespy.com
srdrvp.com
stair.registrydomainservices.com
stardevine.com
steelmaster.lv
strongholdsb.ru strongholdsb.ru
stroyhelp-dv.ru
strv.se strv.se
students-cheapskate.ml students-cheapskate.ml
supermesta.ru success-seo.com
superstats.com sweepstakes.rewardit.com
surffoundation.nl techart24.com
surflinksmedical.com teenfuck.tv
svarkagid.com telefonsex-ohne0900.net
svetodiodoff.ru terrafootwear.us
taxi-v-eisk.ru
td-33.ru
technopellet.gr
thebestphotos.eu thebestphotos.eu
theendivechronicles.com theplacetoupdating.pw
tizanidine4mg.blogspot.com timeallnews.ru
tizanidineinteractions.blogspot.com tizanidineduringpregnancy.blogspot.com
tizanidinepain.blogspot.com tizanidinehydrochloride4mgstreetvalue.blogspot.com
tksn.ru tizanidinesideeffects.blogspot.com
top10registrycleaners.com tizanidinesleepaid.blogspot.com
topads.men tmearegion26.com
topanasex.com tobeyouday.win
top10-online-games.com
toproadrunner5.info
torrentdownloadhub.com torrentdownloadhub.com
tourcroatia.co.uk toxicwap.com
toys.erolove.in traffic2money.com
tpu.ru trafficgenius.xyz
tracxn.com tt-ipd.info
trafficjunky.net tupper-posuda.ru
trichizobswiv.agddns.net tupper-shop.ru
tuberkuleznik.ru turvgori.ru
turbabitload.weebly.com tvorozhnaja-zapekanka-recept.ru
u17795.netangels.ru u555u.info
ultimatesetnewfreeallsoftupgradesystems.pw ultimateclassicrock.com
unitexindia.com ultramart.biz
urdoot.win undergroundcityphoto.com
us-america.ru unece.org
usswrite.com univerfiles.com
ustion.ru upstore.me
vchulkah.net urccvfmc.bloger.index.hr
vchulkax.com uytmaster.ru
vegan-foods.us uzungil.com
velen.io vadimkravtcov.ru
via-energy-cumpara.com vapomnoncri.tk
viagra.pp.ua vasileostrovsky-rayon.ru
video-hollywood.ru vekzdorov.ru
videogamesecrets.com viagengrarx.com
videooko.weebly.com viagroid.ru
videospornogratisx.net videosbox.ru
viel.su
vietimgy.pw vietimgy.pw
vkmusics.ru vip-parfumeria.ru
vodaodessa.com vipps.com.my
vseigru.one virtualbb.com
vzlomfb.com visa-pasport.ru
webcamdevochka.com vonradio.com
weekes.biz.tc vroze.com
westen-v.life vseuznaem.com
westvilletowingservices.co.za vzlom-na-zakaz.com
wfb.hatedriveapart.com w-journal.ru
whengirlsgowild.com webadvance.club
wildnatureimages.com wechatdownload10.com
wladimirpayen.com whatsappbot.flyland.ru
wma-x.com where-toget.com
woman-tampon.ru wholesalejerseysgaa.com
wordpresscore.com womama.ru
worldoffiles.ru wonderfulflowers.biz
wosik-dach.service-for-web.de worldinternetauthority.com
woweb.com.ua wovis.site
www.888.com wtsindia.in
x-lime.net ww2awards.info
xn------7cdbapdecfd4ak1bn0amjffj7afu3y.xn--p1ai x-mix.info
xev.ru
xn-----6kcaacnblni5c5bicdpcmficy.xn--p1ai
xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai xn----7sbaaabaei0cc8aj5bj0bncejx.xn--p1ai
xn----btbdvdh4aafrfciljm6k.xn--p1ai xn----btbdvdh4aafrfciljm6k.xn--p1ai
xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai xn--80aanaardaperhcem4a6i.com
xn--80ak6aa92e.com xn--b1addnj3cah.xn--p1ai
xn--b1ag5cfn.xn--p1ai xn--b1ag5cfn.xn--p1ai
xn--e1aggki3c.xn--80adxhks xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
xn--hxazdsfy.blogspot.com xtrafficplus.com
xolodremont.ru xuki.us
xxxmania.top xvideosbay.com
xxxtubesafari.com yoopsie.com
you-shall-not-pass.is74.ru youdesigner.kz
youtuhe.com yuarra.pluto.ro
zacreditom.ru zatjmuzu.info
zajm-pod-zalog-nedvizhimosti.ru zeroredirect.com
zajm-zalog-krasnodar.ru zigarettenonlinekaufen2.drupalgardens.com
zaobao.com.sg zixizop.net.ru
zarajbuilders.com zlatnajesen.com
zazagames.org zolotoy-lis.ru
zdesoboi.com zona-aqua.ru
zeroredirect6.com
zigarettenonlinekaufen1.bloog.pl
zigzog.ru
zoolubimets.ru
zophim.me zophim.me
zscalertwo.net zreloeporno.tv
zvooq.eu zytpirwai.net

476
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1-free-share-buttons.com 0c47f8422d3f.com
3-letter-domains.net 214jaluwobapef.cf
23kw.ru
2kata.ru
4istoshop.com 4istoshop.com
55wmz.ru 5-steps-to-start-business.com
5forex.ru 5elementov.ru
7a2rnuey1tw9ar.ru 8xv8.com
abbanreddy.com aa625d84f1587749c1ab011d6f269f7d64.com
acc.eu.org abctoppictures.net
acheterviagrafr24.com actionnooz.com
adconscious.com adexprts.com
adultfriendfinder.com adzpower.com
adventureparkcostarica.com akama.com
adverster.com alert-fdm.xyz
adviceforum.info algerianembassy.co.in
agahinameh.com allknow.info
alarmobninsk.ru alpharma.net
analytics-ads.xyz alyeskaresort.com
ananumous.ru ampower.me
anniemation.com apibatbrowsecom-a.akamaihd.net
artparquet.ru apiitsthirteende-a.akamaihd.net
atlant-auto.info apioutoboxnet-a.akamaihd.net
aucoinhomes.com apispringsmartne-a.akamaihd.net
azlex.uz appsecurityr.com
bagcionderlab.com arcteryxstore.online
bambi.ck.ua arenanews.com.ua
bestcalovebracelet.cn arendovalka.xyz
bezsporno.ru asmxsatadriverin.aircus.com
bg6s0.com autogrep.ru
bio-optomarket.ru avtointeres.ru
bioca.org awaybird.ru
bizlist.com.de axbocz.net
blagovest-med.ru baditri.com
blavia.00author.com balkanfarma.ru
bannerspace.com
beachtoday.ru
berlininsl.com
bjetjt.com
board.f00d.de board.f00d.de
boeuklad.com bochemit.com.ua
brg8.com bonanza-fortune.men
brianhenry.co bookhome.info
browsepulse-a.akamaihd.net bpro1.top
budpost.com.ua brateg.xyz
bumble.cheapwebsitehoster.com
buqyxa.rincian.info
buy-cheap-pills-order-online.com buy-cheap-pills-order-online.com
buyessaynow.biz buy-forum.ru
bvlgaribracelet.xyz buytizanidineonlinenoprescription.blogspot.com
carina-sy.de bycontext.com
cartierwatch.xyz candiceloves.us
cdncash.net checkhit.com
cheap-pills-norx.com clips.ua.ac.be
cheapjerseysa.com compliance-don.xyz
chidporn.com compliance-julianna.top
choice-credit.ru continent-e.tv
christianlouboutinoutlet.win countbertwistdisp26.soup.io
cicaki.net creams.makeforum.eu
ciekawinki.pl cscwtalkto.site
compliance-ivan.xyz culad.com
compliance-willy.top
cookie-law-enforcement-ff.xyz
cutt.us
cymbaltaandtizanidine.blogspot.com cymbaltaandtizanidine.blogspot.com
dailyfinancefix.com dailystrength.org
deanmoore.ie datract.com
dentalpearls.com.au dayibiao.com
detoxmed24.ru dealwifi.com
dentfidemountpreach.tk
destinationrealestate.com
detective01.ru
detsky-nabytek.info
deutschland123.de deutschland123.de
dogclothing.store dichvuvesinhhanoi.com
dogsrun.net dms-sw.ru
doska-vsem.ru dokfilms.net
dotnetdotcom.org dosug-lux.ru
downtuptv.gq doublepimp.com
dpihatinh.gov.vn download-of-the-warez.blogspot.com
dtm-spain.com druzhbany.ru
e90post.com e-commerce-seo1.com
eachdayisagift.review ebonyporn.site
econom.co eloxal.ru
ecxtracking.com ezigaretteshop2.vefblog.net
emailaccountlogin.co ezrvrentals.com
erotische-geschichten-xxl.com falopicm.pw
eupornstar.info family1st.ca
euroskat.ru faz99.com
exchangeit.gq film-one.ru
ezigarettenkaufen1.deviantart.com firma-legion.ru
fapgon.com fishtauto.ru
farm26.ru fitness-video.net
fickluder69.com floridahuntingfishingadventures.com
fikasound.tk forex.osobye.ru
filmgo.ru forum.doctissimo.fr
fiverr.com forums.d2jsp.org
flowersbazar.com free-stock-illustration.com
focalink.com freesitetest.com
fortevidyoze.net
foto-sisek.porngalleries.top
free-video-tool.com
freewhatsappload.com
frustrated-favorable.gq frustrated-favorable.gq
fuckbuddybestgilf.info galaxy-family.ru
game-mmorpg.net galaxyflowers.ru
gay.adultgalls.com galeon.com
gov.yanao.ru gaz-voshod.ru
graphics8.info get-seo-domain.com
graphicwe.org ggiaro.com
gsasearchengineranker.top global-ics.co.za
gwhwpxbw.bloger.index.hr gribokstop.com
gyffu.com guiadeserraazul.com
hdfreeporno.net haikuware.com
hotsocialz.com hamptonoaks.ca
howopen.ru havepussy.com
howtowhitenteethfast.xyz hem.passagen.se
huimin764128.com homemade.gq
hydropump.su ie.57883.net
ihc2015.info images.gyffu.com
iideaidekonkatu.info infektsii.com
iqoption-bin.com internet-apteka.ru
it-max.com.ua iradiology.ru
jaxcube.info isistaylorporn.info
kaac.ru ivanovo.zrus.org
kabbalah-red-bracelets.com izhevsk.zrus.org
keywordsuggest.org javidol.site
kinostorm.net jerseychinabizwholesale.com
kiwi237au.tk jestr.org
kopihijau.info jewelryandfiligree.com
kovrenok.ru karusel-market.ru
lacapilla.info kemerovo.zrus.org
levaquin750mg.blogspot.com kinobest.pl
lifeinsurancekb.com klumba55.ru
knigonosha.net
knowyournextmove.com
koopilka.com
ladsblue.com
liveinternet.ru liveinternet.ru
lkbennettoutlet.online
longlifelomilomi.info
lordzfilmz.me
lottospring.com
louisvuittonoutletstore.net
lovi-moment.com.ua lovi-moment.com.ua
lyrics.home-task.com magiadinamibia.blogspot.com
m4ever.net masturbate.co.uk
madot.onlinewebshop.net mega-bony2017.pl
malls.com menetie.ru
manve.info mesbuta.info
marketland.ml mikozstop.com
masterseek.com milblueprint.com
meccadumps.net mindeyegames.com
medicinacom.ru miniads.ca
medicovi.com mobstarr.com
medmajor.ru monclerjacketsoutlet.win
meetlocalchicks.com moncleroutletonline.xyz
megagrabber.ru mouselink.co
megahdporno.net msk.afora.ru
mir-betting.ru myphotopipe.com
misterjtbarbers.com namecrumilchlet.tk
mobifunapp.weebly.com negociosdasha.com
mrcsa.com.au neobux-bg.info
mrinsidesales.com nerudlogistik.ru
musicspire.online newstraveller.ru
musicstock.me nfljerseyscheapchinabiz.com
muz-tracker.net nhl17coins.exblog.jp
myfreetutorials.com nightvision746.weebly.com
myra.top notebook-pro.ru
mzdish.site novgorod.xrus.org
nastroyke.net onemactrckr.com
o.light.d0t.ru opinionreelle.com
okonich.com.ua oranga.host.sk
onefilms.net ororodnik.goodbb.ru
orhonit.com outrageousdeal-a.akamaihd.net
pagesense.com owathemes.com
pandroid.co ownshop.cf
parajumpersjakkesalgnorge.info
park.above.com
pcboa.se
pewit.pw pewit.pw
photosaga.info pillscheap24h.com
picurams.pw pisanieprac.info
pk-pomosch.ru piter.xrus.org
play.leadzupc.com
playfortuna-play.ru
porno.simple-image.com.ua
pornoforadult.com
pornoslive.net pornoslive.net
positive2b.ru pr0fit-b0x.com
preconnubial.usuby.site profitkode.com
pregnant.guru prospekt-st.ru
preparevideosafesystem4unow.site pshare.biz
printie.com quizzitch.net
raschtextil.com.ua razvratnoe.org
richinvestmonitor.com redhotfreebies.co.uk
rixpix.ru relax.ru
rock-cafe.info rockma.se
rootandroid.org
ros-ctm.ru ros-ctm.ru
ruf777.com rrutw.com
s-forum.biz rutor.vip
savetubevideo.com sa-live.com
scanner-jack.top sarafangel.ru
scansafe.net sarf3omlat.com
sdrescher.net scanspyware.net
searchimage.co search-error.com
searchtooknow-a.akamaihd.net sell-fb-group-here.com
semrush.com seocdvig.ru
sex-znakomstva.online sex-sex-sex5.com
sexgalleries.top shop.xz618.com
shitmovs.com shopfishing.com.ua
shop-electron.ru shopsellcardsdumps.com
shop.acim.org silvercash.com
sibvitr.ru sinel.info
sitevaluation.org sitevaluation.org
sky-mine.ru sitopreferito.it
skypasss.com slim.sellany.ru
smailik.org social-fun.ru
small-games.biz sovetogorod.ru
socas.pluto.ro spb.afora.ru
socialtrade.biz stariy-baku.com
sport-video-obzor.ru strigkaomsk.ru
stathat.com support.nopeas.sk
streetfire.net svarkagid.com
stroiminsk.com swinginwithme.ru
superkanpo.com swiped.su
surffoundation.nl swsociety.se
survival.betteroffers.review telefonsexkostenlos.tk
svtrd.com templates.radiodigital.co
symbaloo.com terraclicks.com
telefonsexsofort.tk the-trader.net
thebitcoincode.com theporndude.com
thetoiletpaper.com tongkatmadura.info
tizanidinecapsules.blogspot.com tourcroatia.co.uk
tizanidinestreetprice.blogspot.com toursmaps.com
toloka.hurtom.com tracklead.net
toolsky.com twelvevisionspartyofcolorado.com
top-study.work uginekologa.com
top10registrycleaners.com upupa.net
traffic2cash.org vchulkah.net
trafficfactory.biz videochat.world
trafficshaper.com vilingstore.net
triplepanda.xyz vremya.eu
typimga.pw warezaccess.com
u-cheats.ru weboptimizes.com
ua.tc websiteaccountant.de
uhdtv.website webstatsdomain.org
umg-stroy.ru welck.octopis.com
wapsite.me wingsoffury2.com
wareseeker.com wjgony.com
waterefficiency.co www.wohnkabinen-shop.de
webix.biz wyniki-lista.pl
wedding-salon.net xblog.in
whatsupinfoley.com xn--80atua3d.xn--p1ai
winner7777.net xolodremont.ru
witherrom55.eklablog.fr xxxsiterips.xyz
worldhistory.biz yeartwit.com
x-mix.info yellocloud.be
xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai yellowstonesafaritours.com
xn--h1ahbi.com.ua yurgorod.ru
xn--oogle-wmc.com zacreditom.ru
xtubeporno.net znakomstva-moskva77.ru
xxxdatinglocal.us zooggames.com
xxxmania.top
xz618.com
yellowads.men
yoshkarola.zrus.org
youporn-forum.ga
youraticles.pl
zapatosenventa.info
zx6.ru

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.1.147 0; 10.1.1.112 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2945 ### Version: V4.2022.02.2946
### Updated: Sat Feb 26 10:04:01 UTC 2022 ### Updated: Sat Feb 26 22:01:31 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.02.2945 ### Version: V4.2022.02.2946
### Updated: Sat Feb 26 10:04:01 UTC 2022 ### Updated: Sat Feb 26 22:01:31 UTC 2022
### Bad Bot Count: 636 ### Bad Bot Count: 636
################################################### ###################################################
### Version Information ## ### Version Information ##