vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-04 03:29:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.11.3453 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-11-05 22:07:02 +00:00
parent 16e1e4eb45
commit aca1cc5854
46 changed files with 92353 additions and 92353 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3452 #### Version: V4.2022.11.3453
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.11.3452 #### Version: V4.2022.11.3453
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.11.3452 #### Version: V4.2022.11.3453
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11410
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.11.3452 #### Version: V4.2022.11.3453
#### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7097](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

11414
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11414
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

11414
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

11414
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3452 3453

11414
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

11414
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.172.155.249 0; 20.253.134.77 0;

11414
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

11414
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.172.155.249 0; 20.253.134.77 0;

11414
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
20.172.155.249 0; 20.253.134.77 0;

11414
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 1; 10.1.1.78 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
IDBTE4M Microsoft Data Access
Mass Downloader MolokaiBot
OutfoxBot NimbleCrawler
RankurBot Reaper
ScrepyBot SmartDownload
VCI Spinn3r
WebPix Thumbor
oBot VelenPublicWebCrawler
serpstatbot Xaldon_WebSpider
sitechecker.pro eCatch

292
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
360Spider 80legs
404enemy
ADmantX
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot AiHitBot
Alexibot Aipbot
Alligator Anarchie
AlphaBot
Anarchy99 Anarchy99
Asterias Anthill
Aspiegel
Atomseobot
AwarioRssBot AwarioRssBot
BDFetch BDFetch
BLEXBot
BackDoorBot BackDoorBot
BackWeb BackStreet
Backlink-Ceck
BacklinkCrawler BacklinkCrawler
Bandit Bandit
Barkrowler Barkrowler
Bigfoot BatchFTP
Blackboard Blackboard
Blow Bolt
BotALot
Brandprotect
Brandwatch
Buck Buck
Bullseye Bullseye
BunnySlippers CCBot
CATExplorador CODE87
Cegbfeieh CazoodleBot
CensysInspect ChinaClaw
Citoid Citoid
Claritybot Cliqzbot
Cloud mapping
Collector
CopyRightCheck CopyRightCheck
Copyscape
Cosmos
Craftbot Craftbot
Crawling at Home Project Crawling at Home Project
CrunchBot Curious
CyotekWebCopy
DBLBot
DTS Agent DTS Agent
DataCha0s
DatabaseDriverMysqli DatabaseDriverMysqli
Demon Demon
Deusu Deusu
Digincore Digincore
DigitalPebble
Dispatch Dispatch
DomCopBot DittoSpyder
DomainSigmaCrawler
Domains Project Domains Project
Dragonfly Drip
Ebingbong EasyDL
Ecxi
EirGrabber
EroCrawler EroCrawler
Exabot Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
Ezooms Ezooms
FHscan FHscan
FemtosearchBot
Fimap Fimap
Firefox/7.0 Firefox/7.0
Flunky FlashGet
Foobot
Freeuploader Freeuploader
FrontPage FrontPage
FyberSpider Fuzz
Fyrebot Fyrebot
GalaxyBot G-i-g-a-b-o-t
GetRight GT::WWW
Gigabot Getintent
Go!Zilla
GoZilla GoZilla
GrabNet
Grabber Grabber
Grafula
GrapeFX
GrapeshotCrawler GrapeshotCrawler
GridBot
HTTP::Lite HTTP::Lite
HTTrack
Harvest Harvest
Hloader Hloader
HybridBot Iblog
IDBot Indy Library
IRLbot InfoNaviRobot
Id-search InfoTekies
IndeedBot
Intelliseek Intelliseek
InterGET
Internet Ninja Internet Ninja
Iria InternetSeer
Iskanie IstellaBot
JamesBOT JetCar
JennyBot
Jetty Jetty
Joomla JikeSpider
Jorgee Jorgee
Kenjin Spider Kenjin Spider
Keybot Translation-Search-Machine Keyword Density
Kozmosbot Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
Lftp
LibWeb LibWeb
Libwhisker
Lightspeedsystems
LinkScan LinkScan
Linkbot
LinkextractorPro LinkextractorPro
LinqiaMetadataDownloaderBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey
Litemage_walker Litemage_walker
Lmspider
MJ12bot MJ12bot
MQQBrowser MQQBrowser
MTRobot MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
MeanPath Bot MeanPath Bot
Metauri Meanpathbot
Microsoft URL Control MegaIndex.ru
MolokaiBot Minefield
Mister PiX
Moblie Safari
Mojeek
Msrabot
Musobot
NICErsPRO
NPbot NPbot
Nameprotect
NearSite NearSite
Nessus Nessus
NetAnts Net Vampire
NetMechanic NetMechanic
NetSpider Netvibes
Nettrack Not
NextGenSearchBot Nuclei
Nibbler
Niki-bot
Nmap
Nutch Nutch
OpenVAS Octopus
OrangeSpider OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl PHPCrawl
POE-Component-Client-HTTP POE-Component-Client-HTTP
PageAnalyzer PageGrabber
PageThing.com
Papa Foto Papa Foto
Pavuk
Petalbot Petalbot
Picsearch Pi-Monster
Piepmatz
Pixray Pixray
ProWebWalker Pockey
ProPowerBot
Pu_iN Pu_iN
Pump Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot RSSingBot
RankActive
RankActiveLinkBot RankActiveLinkBot
RankingBot2 RankingBot
RankurBot
Re-re
RealDownload RealDownload
Reaper Reaper
RebelMouse
Recorder Recorder
RedesScrapy
RepoMonkey RepoMonkey
Ripper Rogerbot
RocketCrawler
SBIder SBIder
SEOstats SEOkicks
ScanAlert ScanAlert
Scanbot ScoutJet
Scrapy Scrapy
Screaming
Searchestate Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot SemrushBot
SeobilityBot SeobilityBot
Shodan Siphon
SiteLockSpider Site Sucker
SiteSnagger SiteSucker
Sitebeam Sitebeam
Sitevigil Siteimprove
SmartDownload SmartDownload
Snapbot Sosospider
Snoopy
Sociscraper
Sottopop
SpaceBison SpaceBison
Spammen
SpankBot
SputnikBot
Sqlmap
Sqlworm Sqlworm
Sqworm
Steeler
Sucker Sucker
Sucuri Sucuri
SuperBot
SurveyBot
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo Telesphoreo
Telesphorep
TheNomad
Thumbor
TightTwatBot TightTwatBot
Toweyabot Toata
True_Robot Tracemyfile
Turnitin Trendictionbot
TwengaBot VB Project
Twice Vagabondo
UnisterBot
V-BOT
VCI
VelenPublicWebCrawler VelenPublicWebCrawler
VeriCiteCrawler VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WEBDAV WEBDAV
WWW-Mechanize
WWWOFFLE
Wallpapers Wallpapers
Wallpapers/3.0
WallpapersHD WallpapersHD
Web Pix WeSEE
Web Auto
Web Sucker Web Sucker
WebBandit
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebPix WebPix
WebSauger WebsiteQuester
WebStripper Webster
WebmasterWorldForumBot Whacker
Website Quester
Whack
Widow Widow
WiseGuys Robot WiseGuys Robot
Wonderbot
Woobot
Wotbox Wotbox
Wprecon Xenu
Xaldon WebSpider YoudaoBot
Zauba ZumBot
Zitebot
ZmEu
ZyBorg ZyBorg
arquivo-web-crawler arquivo-web-crawler
clark-crawler autoemailspider
coccocbot backlink-check
crawler4j check1.exe
crawler.feedback
dataforseo.com dataforseo.com
domainsproject.org demandbase-bot
evc-batch eCatch
instabid facebookscraper
ips-agent isitwp.com
linkdexbot lwp-request
meanpathbot lwp-trivial
magpie-crawler
mediawords mediawords
netEstate NE Crawler polaris version
plumanalytics ripz
s1z.ru
satoristudio.net satoristudio.net
scan.lol scan.lol
seobility seoscanners
seostar seostar
sitechecker.pro sitechecker.pro
sogouspider
spyfu spyfu
webgains-bot sysscan
webmeup-crawler ubermetrics-technologies.com
webpros.com voyagerx.com
x09Mozilla x09Mozilla
x22Mozilla
xpymep1.exe xpymep1.exe

304
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
360Spider 404checker
80legs
ADmantX
AIBOT
ALittle Client ALittle Client
ASPSeek Aboundex
Abonti Acunetix
AhrefsBot AfD-Verbotsverfahren
AiHitBot
Aipbot Aipbot
AllSubmitter Alexibot
AlphaBot
Anarchie Anarchie
Anarchy99 Anarchy
Apexoo
Atomseobot
AwarioRssBot
AwarioSmartBot AwarioSmartBot
BDCbot BBBike
BackWeb BLEXBot
BacklinkCrawler BackStreet
Barkrowler Backlink-Ceck
Bigfoot Bigfoot
Blackboard Black Hole
BlowFish BlowFish
Boardreader Boardreader
Bolt Bolt
Brandprotect
Buddy Buddy
BuiltBotTough BuiltBotTough
BuiltWith BuiltWith
Bullseye Bullseye
BuzzSumo BuzzSumo
CazoodleBot CATExplorador
Cegbfeieh CCBot
CensysInspect CODE87
CheeseBot CSHttp
Calculon
CherryPicker
ChinaClaw ChinaClaw
Chlooe
Citoid Citoid
Cliqzbot Claritybot
Cloud mapping Cogentbot
Cocolyzebot
Copier Copier
CopyRightCheck CyotekWebCopy
Cosmos DSearch
Crescent Deusu
CrunchBot Dispatch
Custo DittoSpyder
DIIbot
DataCha0s
Demon
Devil
Digincore
DigitalPebble
Dirbuster
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot
DomCopBot DomCopBot
DomainCrawler Domains Project
Dotbot Dotbot
Download Wonder Download Wonder
Dragonfly
EMail Wolf EMail Wolf
EasyDL
EirGrabber EirGrabber
Express WebPictures
ExtLinksBot
ExtractorPro ExtractorPro
Fimap Ezooms
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader Freeuploader
Fuzz FyberSpider
GalaxyBot GalaxyBot
Genieo Genieo
GetRight
Getintent
Go!Zilla
GoZilla
Grabber
Grafula
GrapeshotCrawler GrapeshotCrawler
HaosouSpider GridBot
Havij HMView
Heritrix HTTP::Lite
HTTrack
Haansoft
Hloader Hloader
HonoluluBot Humanlinks
HybridBot
IDBTE4M IDBTE4M
Iblog Iblog
Id-search
IlseBot IlseBot
Image Fetch
Image Sucker Image Sucker
Indy Library Iskanie
InfoNaviRobot IstellaBot
Intelliseek JamesBOT
InterGET JennyBot
Internet Ninja JetCar
Jbrofuzz Jetty
Jorgee
Jyxobot Jyxobot
Kenjin Spider Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy LNSpiderguy
Lanshanbot
Leap
Lftp
LibWeb LibWeb
Lightspeedsystems Libwhisker
LinkScan
LinkextractorPro LinkextractorPro
LinkpadBot LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot LinqiaRSSBot
LinqiaScrapeBot Lipperhey
Litemage_walker
MFC_Tear_Sample MFC_Tear_Sample
MIIxpc MJ12bot
MSIECrawler MQQBrowser
MSFrontPage
Magnet Magnet
Mail.RU_Bot Mail.RU_Bot
Majestic SEO
Majestic12 Majestic12
MarkMonitor
MarkWatch MarkWatch
Mass Downloader Mass Downloader
Masscan
Mata Hari
Mediatoolkitbot
MegaIndex.ru MegaIndex.ru
Metauri MicroMessenger
Microsoft URL Control Microsoft URL Control
Mister PiX Minefield
NICErsPRO Moblie Safari
MolokaiBot
Mr.4x3
NPbot
Name Intelligence Name Intelligence
NearSite NearSite
Needle
Nessus Nessus
Net Vampire NetMechanic
NetSpider NetZIP
Netcraft
Nettrack
Netvibes Netvibes
Nibbler Niki-bot
Nimbostratus Nimbostratus
Ninja
Not Not
Nuclei
Octopus
Offline Navigator Offline Navigator
OpenLinkProfiler OpenVAS
Openfind Openvas
OrangeSpider OrangeBot
OutclicksBot
OutfoxBot OutfoxBot
PHPCrawl PECL::HTTP
PageAnalyzer Pandalytics
PageGrabber Panscient
PageScorer PeoplePal
Picscout
Picsearch
Pimonster Pimonster
PleaseCrawl
Pockey
ProPowerBot ProPowerBot
Psbot ProWebWalker
Pu_iN Pu_iN
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot RankActiveLinkBot
RankFlex RankingBot2
Rankivabot Re-re
RankurBot
ReGet ReGet
RealDownload Reaper
RebelMouse RebelMouse
Recorder RepoMonkey
Ripper Ripper
RocketCrawler SBIder
SEOkicks
SEOlyticsCrawler SEOlyticsCrawler
SEOprofiler SEOprofiler
SEOstats
SMTBot SMTBot
ScrepyBot ScanAlert
Scrapy
Screaming
Searchestate Searchestate
Seekport
SemanticJuice
Semrush Semrush
SentiBot SentiBot
Seomoz SeoSiteCheckup
Site Sucker Siphon
SiteCheckerBotCrawler SiteLockSpider
SiteExplorer
SiteSnagger SiteSnagger
SiteSucker Siteimprove
Sitebeam Snoopy
SlySearch SocialRankIOBot
SmartDownload
Snake
Sociscraper
Sosospider Sosospider
SpaceBison Spinn3r
Spanner
Spbot
SputnikBot
Sqworm Sqworm
Steeler
Stripper Stripper
Sucker SuperBot
SuperHTTP Surfbot
SurveyBot T0PHackTeam
Szukacz T8Abot
TheNomad Teleport
Toata Telesphoreo
TightTwatBot
Titan
Toweyabot Toweyabot
Tracemyfile
Trendiction
Trendictionbot Trendictionbot
Turingos
TurnitinBot TurnitinBot
TwengaBot TwengaBot
URLy.Warning
UnisterBot
Upflow Upflow
Vagabondo Voil
Voltron WBSearchBot
WEBDAV
WWW-Mechanize WWW-Mechanize
Wallpapers Wallpapers
Web Collage WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Pix Web Pix
Web Sucker WebEnhancer
WebAuto
WebCollage
WebFetch
WebFuck WebFuck
WebGo IS WebLeacher
WebReaper WebStripper
WebSucker WebWhacker
Webalta WebZIP
Website Quester Website Quester
WebsiteQuester Woobot
Wotbox Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu
Zade Zade
Zauba Zauba
Zermelo
ZmEu
ZoomBot ZoomBot
ZoominfoBot ZoominfoBot
ZyBorg
backlink-check backlink-check
cah.io.community
check1.exe check1.exe
coccocbot clark-crawler
cognitiveseo
com.plumanalytics
dataforseo.com dataforseo.com
domainsproject.org demandbase-bot
evc-batch
gopher
heritrix heritrix
ips-agent iubenda-radar
isitwp.com meanpathbot
lwp-request
lwp-trivial
mediawords mediawords
oBot netEstate NE Crawler
pcBrowser plumanalytics
scalaj-http scalaj-http
scan.lol scan.lol
seocompany.store seoscanners
seostar
serpstatbot
sexsearcher
sogouspider sogouspider
spyfu sp_auditbot
tAkeOut tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot webprosbot
x22Mozilla x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io zgrab

18
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
compliance-jess.top ayodhya.co
digest-project.ru com-onlinesupport.host
oda.as kongruan.com
onlinefilmz.net macdamaged.tech
pestomou.info pc-virus-d0l92j2.pw
porno-transsexuals.ru porno-transsexuals.ru
strangeduckfilms.com waterpurifier.club
toursmaps.com whereiskentoday.com
wheelchairliftsarea.com xgames-04.com
xitjw.info zhorapankratov7.blogspot.com

920
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
0lovespells0.blogspot.com 11pikachu.ru
123cha.com 1adult.com
1kdailyprofit.me
1stat.ru
20pascals.nl
23kw.ru 23kw.ru
2drittel.de 40cg.com
2itech.ru 5i2.net
2pxg8bcf.top 66cpwgln.space
4ureyesonly.com 72-news.com
5u.com aa9bd78f328a6a41279d0fad0a88df1901.com
5ws.dating-app.ru abtasty.com
70casino.online abusora.com
7minuteworkout.com abwa.tk
8jn.dating-app.ru academia-nsk.org
a96527gi.beget.tech acmebtn.ml
aa625d84f1587749c1ab011d6f269f7d64.com
aa8780bb28a1de4eb5bff33c28a218a930.com
aac52006ec82a24e08b665f4db2b5013f7.com
aad1f4acb0a373420d9b0c4202d38d94fa.com
aanapa.ru
abctoppictures.net
absolutelyanalog.com
acunetix-referrer.com
addbin.men
addtoadd.men
adhome.biz adhome.biz
adman.se admatic.com.tr
adrunnr.com adultfullhd.com
adtech.fr aerogo.com
adtology.com agecheckadult.com
adult-shop.com.ua alfa-img.com
advertisingtag.net allbizne.co.ua
alarmobninsk.ru allmarketsnewdayli.gdn
alevinefesleri.com alphaforum.ru
allornamenti.com amateurgalls.com
aludecor.info anonymous-redirect.com
angel1777.kz
aosexkontakte.net aosexkontakte.net
apartment.ru apifasterlightin-a.akamaihd.net
apiadanaknet-a.akamaihd.net apilinkswiftco-a.akamaihd.net
apidigidocketnet-a.akamaihd.net apioasisspacenet-a.akamaihd.net
apiitsthirteende-a.akamaihd.net
apiportalmorecom-a.akamaihd.net
apiwoodensealcom-a.akamaihd.net
app-ready.xyz app-ready.xyz
appfixing.space appfixing.space
aproposde.com arenda-avtoprokat-krasnodar.ru
arcadeplayhouse.com artdeko.info
arenda-yeisk.ru artel116.ru
arvut.org arvut.org
asacopaco.tk asacopaco.tk
atmagroup.ru asociatia-tipografilor-transilvania.ro
autoplate.info asscenihotosidea.blogspot.com
atleticpharm.org
atovh.local-finders.com
audiobangout.com
autodo.info
automobile-spec.com
autovideobroadcast.com
avek.ru
aviav.ru.com
avtointeres.ru
avtovolop.ru avtovolop.ru
azadnegar.com bbsoldes.fr
azartclub.org bear.gotcher.us
babs.com.ua belinvestdom.by
badavit.com.ua best-seo-solution.com
bannerspace.com bestempresas.es
basisches-wasser.net bigpenisguide.com
beachfix.co bigpictures.club
beclean-nn.ru bimatoprost-careprost.com.ua
beetpics.pw biocn.dx.am
benchmarkcommunications.co.uk biznesluxe.ru
berdasovivan.ru
besthomemadepornsites.com
bestofferswalkmydogouteveryday.gq
bet-prognoz.com
betonka.pro
bezsporno.ru
bg6s0.com
blackwitchcraft.ru blackwitchcraft.ru
blue-square.biz blog.axant.it
bluesalt.co bluejays-jerseys.us
bookhome.info bonzibuddi.com
bpro1.top boostmyppc.com
braip.com.br bradleylive.xyz
brandbucket.com buehne-fuer-menschenrechte.de
brianhenry.co bukleteg.xyz
budpost.com.ua
bumskontakte.org
burkesales.com burkesales.com
businesxxl.com businesn.men
buzzonclick.com buyparajumpers.online
bwlx.prepedu.cn buypuppies.ca
cacheimages.com bvlgaribracelet.xyz
callawaygolfstore.online camdenmemorials.com
camdolls.com camsex.xxx-cam.webcam
canrioloadm.gq capture-room.com
carfax.com.ua cartierreplica.xyz
cartierreplica.pw certifywebsite.win
cartiertrinity.xyz cheapbarbour.online
cb.iphantom.com chiblackhawks-jerseys.com
cfacarrosserie74.com chimiver.info
cheapbelstaff.online chocolateslim-en-espana.com
cheapsergiorossi.online citysecurity.nu
checktext.org civilwartheater.com
chelnytruck.ru clash-clans.ru
christianlouboutinreplica.pw clicksor.com
cialgenisrx.com
cineacademy.ru
clickaider.com
clickintext.net
clicksor.net
clicksotrk.com
clickzzs.nl clickzzs.nl
clipartnew.com club-lukojl.ru
clmforexeu.com com-onlinesupport.host
club-musics.ru
compiko.info
compliance-elena.top
compliance-fred.xyz compliance-fred.xyz
compliance-george.xyz compliance-julia.top
compliance-julianna.top compliance-margo.top
concealthyself.com compliance-willy.top
cracksplanet.com contentlook.co
creativehutindia.com contentsexpress.com
cscwtalkto.site coolwallpapers-hd.com
cubs-jerseys.us cottageofgrace.com
culad.com countercrazy.com
custodieva.ru creatives.adbetclickin.pink
custom-product-labels.com creditmoney.com.ua
dalavia.ru culturevie.info
daneshetabiat.com custom-electric-guitar.com
dangphoto.trade cyclobenzaprinevstizanidine.blogspot.com
dataloading.net cypernhuset.se
daymusam.com data-ox.com
dellalimov.com date-withme.com
demian.kz decorazilla.com
demon-tweeks.com delitime.info
detsky-nabytek.info depositfiles-porn.ga
deutschehobbyhuren.net designdevise.com
deutschland123.de
dev-seo.blog
devochki.top
dfwu1013.info dfwu1013.info
dignitasdata.se diamond-necklace.info
disruptingdinnerparties.com digital-video-processing.com
doktoronline.no docstoc.com
dscaas.website doctissimo.fr
dynainbox.com documentbase.net
earn-from-articles.com dodlive.mil
easycommerce.cf downloadme.life
easync.io dtnlyss.com
ecommerce-seo.org duawitchrarato.tk
el-nation.com dumpsmania24.com
electro-prom.com dvd-famille.com
eleimgo.pw dwomlink.info
elektrischezigarette2.devhub.com dyt.net
elkacentr.ru eager-nash.188-93-233-196.plesk.page
elmacho.xyz eduserver.net
elstal.com.pl election.interferencer.ru
englishdictionaryfree.com electricwheelchairsarea.com
envaseslotusama.com elektrozigarette2.wordpressy.pl
etenininrade.ga elektrozigaretten1.tumblr.com
eyemagination.com empis.magix.net
ezrvrentals.com escort-russian.com
f-online.de esnm.ru
factorynightclub.com exci.ru
falcon-images.blogspot.com eyes-on-you.ga
feorina.ru eywords-monitoring-your-success.com
figuringmoneyout.com ezigarettekaufen.myblog.de
finuse.com failingmarriege.blogspot.com
firstdrugmall.ru familyphysician.ru
flagcounter.me fatmaelgarny.com
forum.poker4life.ru femmesdenudees.com
freakycheats.com fetroshok.ru
free-stock-illustration.com fighrofacciufreesig.ga
freemags.cc filerockstar298.weebly.com
freenode.info film-one.ru
freewlan.info findacheaplawyers.com
fitnesspiks.com
flytourisme.org
fodelsedagspresenter.nu
footballfarrago.com
forpackningsutveckling.se
fortunejack.com
forumprofi.de
fotoxxxru.com
fotzen-ficken.com
frcls.fr
free-video-tool.com
freesitetest.com
freeuploader.com
fres-news.com
friendflnder.com friendflnder.com
frustrated-favorable.gq frvo.alptandem.ru
fuckmill.com gambarkataku.co
gabeshop.ru gameplexcity.com
galaxys6manual.info gaytube.com
gay.adultgalls.com gazporno.com
germes-trans.com gemara.com
getaclueamerica.com gembird.com
gheus.altervista.org geoads.com
gigapeta.com gilbertbanda.net
gne8.com glavprofit.ru
go2jump.org glogow.pl
gorabagrata.ru golmau.host.sk
gotwebsite1.com goodwinmetals.co
googlefeud.com
gowreckdiving.com gowreckdiving.com
greatgrace.ru groupmoney.ru
gsmtlf.ru guildebzh.info
gta-top.ru
gunsvicceadadebt.tk
gwebtools.com gwebtools.com
gyffu.com gyffu.com
h2monline.com hamptonoaks.ca
hackers-crackers.tk hauleddes.com
handicapvantoday.com hd-filmy.net
hard-porn.mobi helicalpile.us
hasshe.com hetmanship.xyz
heatpower.ru hildinghr.se
hem.passagen.se hkladys.com
hermesreplica.win holidaypics.org
hidefiles.org homemature.net
hmmm.cz host-protection.com
homeinns.com hotdl.in
homemade.gq houdom.net
hoporno.com house.sieraddns.com
housekuba.org hoverboard360.se
hybrid.ru humbmosquina.tk
ictizanidinehcl4mg.blogspot.com id-forex.com
ilbe.club ilovevitaly.xyz
imagefinder.site
imagui.eu
img.wallpaperstock.net
imgarcade.com imgarcade.com
imperia31.ru import-sales.com
indianmedicaltourismshop.com inboxdollars.com
intimshop-fantasy.ru incanto.in.ua
ipchicken.com inet-traffic.com
irkutsk.zrus.org infobabki.ru
islamtoday.co.za infobanks.ru
istizanidineanarcoticdrug.blogspot.com informatiecentro.be
itsdp3.com inome.com.ua
iweblist.info instakink.com
jav-fetish.site integritylandscapeservices.com
jav-idol.com interior-stickers.ru
internetproviderstucson.com
invest-pamm.ru
investingclub.ru
iqoption.com
islandminingsupply.wordpress.com
istizanidineacontrolledsubstance.blogspot.com
itis4you.com
ivanovo.zrus.org
jav-fetish.com
javxxx18.com javxxx18.com
jaxcube.info jerseyschinabizwholesale.us
jerseysbizwholesalecheap.com jerseywholesalebizchina.com
jo24news.com jus0wil.pp.ua
jobmarket.com.ua kasino-money.pw
joessmogtestonly.com kazan.xrus.org
jolic2.com kchaxton.com
jyrxd.com kerei.ru
kaac.ru keywordbasket.com
kazinogames.lv keywords-monitoring-success.com
kenaba.su
kerwinandcariza.com
kfon.eu kfon.eu
kicknights.gq
kinocccp.net kinocccp.net
kinohit1.ru kinoduh.ru
kinostorm.net kletkimehan.ru
komputers-best.ru klosetkitten.com
kumuk.info konpax.com
kostenloser-sex.com
koversite.info
kovrenok.ru
kung-fu-ru.com kung-fu-ru.com
landreferat.ru kupiproday.com.ua
letto.by kursy-ege.ru
lider-zhaluzi.kiev.ua lampokrat.ws
likesuccess.com laxob.com
linkrr.com leboard.ru
lisque.batcave.net lenpipet.ru
lyrics.home-task.com lerporn.info
m292.info levaquin750mg.blogspot.com
machicon-akihabara.info lidoradio.com
macotool.com liquimondo.com
magnetic-bracelets.ru liran-locks.com
mainlinehobby.net littlesexdolls.com
maladot.com liupis.com
manuscript.su liver-chintai.org
map028.com longadventure.com
mapquestz.us lottospring.com
mararoom.ru m.b00kmarks.com
marcogrup.com mackeeper-center.club
masserect.com mackeeper-land-672695126.us-east-1.elb.amazonaws.com
master-muznachas.ru magiadinamibia.blogspot.com
max-p.men maglid.ru
mcnamaratech.com mansiondelrio.co
medmajor.ru marinetraffic.com
mensandals.xyz marketingtechniques.info
metafilter.com matematikus.info
microsearch.ru mathgym.com.au
mir-betting.ru maxxtor.eu
missis.top mcar.in.ua
medispainstitute.com.au
metaxalonevstizanidine.blogspot.com
mini-modus.ru
mini.7zap.com
mirzonru.net
mistr-x.org
mitrasound.ru mitrasound.ru
mobilemedia.md modnie-futbolki.net
mockupui.com mokrayakiska.com
moinozhki.com monclerjacketsoutlet.pw
monclercoats.xyz money-every-day.com
monetizer.com-01.site monthlywinners.com
monsterdivx.com mrvideospornogratis.xxx
morepoweronmac.trade mulberryoutletonlineeu.com
morocco-nomad-excursions.com mwtpludn.review
movpod.in my-floor.in.ua
mp3ritm.top myfreemp3.eu
mrbojikobi4.biz myghillie.info
mtmtv.info
musicvidz.ru
muz-tracker.net
mydeathspace.com
myfreecams.com
myhealthcare.com
mylesosibirsk.ru mylesosibirsk.ru
narkologiya-penza.ru mylovelibrabry.com
netcheckcdn.xyz myonigroup.com
newstraveller.ru mysex21.com
nextlnk12.com narco24.me
nfljerseyscheapchinabiz.com narkologiya-belgorod.ru
nfljerseysforsalewholesaler.com narutonaruto.ru
nicefloor.co.uk nastroyke.net
nudepatch.net nastydollars.com
nvformula.ru naughtyconnect.com
o-dachnik.ru news-readers.ru
oconto.ru nhl17coins.exblog.jp
offer.camp nl.netlog.com
olvanto.ru nootrino.com
one.net.in nyfinance.ml
onlinetvseries.me okeinfo.online
onlythegames.com onlinedomains.ru
optibuymac.com onlyporno.ru
osagonline.ru oralsexfilme.net
paceform.com ownshop.cf
papasdelivery.ru pagesense.com
partners-ship.pro paighambot.com
parajumpersjakkesalgnorge.info
paramountmarble.co.uk
pavlodar.xkaz.org
paydayloanslocal.com paydayloanslocal.com
pc-services.ru pc4download.co
picsearch.com pcads.ru
piluli.info pdns.download
pixell.club pepperstyle.ru
pixelrz.com pictures-and-images.com
pizdopletka.club pictures-and-images.net
play-mp3.com picurams.pw
polska-poezja.com pipki.r.acdnpro.com
poquoson.org pivka.xyz
porn555.com pixshark.com
porndairy.in plastgranar.nu
pornobrazzers.biz pokemongooo.ml
pornohub.me pons-presse.com
pornozhara.com popunder.ru
powenlite24.ru porndroids.com
preparevideosafesystem4unow.space pornoreino.com
proftests.net pornosemki.info
progress-upakovka.ru pornoxxx.com.mx
prostitutki-belgoroda.org posible.net
puzo2arbuza.ru positive2b.ru
puzzleweb.ru prchecker.info
pyramidlitho.webs.com presleycollectibles.com
pyrodesigns.com.au pretty-mart.com
q-moto.ru primedice.com
randki-sex.com privatamateure.com
ranksonic.info pro-poly.ru
rednise.com prostitutki-novgoroda.org
puserving.com
qwertty.net
rabotaetvse.ru
radiogambling.com
rarbg.to
realmonte.net
realtytimes.com
redirect.trafficreceiver.club
reeyanaturopathy.com reeyanaturopathy.com
remont-ustanovka-tehniki.ru registratciya-v-moskve.ru
rniaeba.ga remont-comp-pomosh.ru
rollercoin.com retailwith.com
roofers.org.uk retreatia.com
rozalli.com rfd-split.hr
roznica.com.ua rff-cfal.info
ruscopybook.com ringporno.com
risparmiocasa.bz.it
rrutw.com
ru-dety.ru
rus-pornuha.com
ruspdd.com
russintv.fr
rusvideos.su rusvideos.su
rutor.vip samara.rosfirm.ru
s8-nowy-wygraj.comli.com sarahmilne.top
saltspray.ru saratov.xrus.org
sanatorrii.ru
savingsslider-a.akamaihd.net
sbricur.com
sbwealthsolutions.ca
scanhub.ru scanhub.ru
scanner-jess.top scanner-barak.top
scanner-julianna.top scanspyware.net
scat.porn sdelatmebel.ru
schoolfiles.net seasonvar.ru
scoopquest.com secret.xn--oogle-wmc.com
screentoolkit.com segol.tv
se-welding.ru sel-hoz.com
searchimage.co
securityallianceservices.com
seo-traffic-ranking.info seo-traffic-ranking.info
seonetwizard.com seoanalyses.com
seorank.info seojokes.net
serdcenebolit.com service-core.ru
servicecenter.co.ua
seryeznie-znakomstva.ru seryeznie-znakomstva.ru
sethrollins.net sex-dating.co
sex-znakomstva.online sex-sex-sex5.com
sexiporno.net sexiporno.net
sexkontakteao.info sfj-ror.no
sexpornotales.net sharebutton.net
sexvporno.ru shariki-zuma-lines.ru
sharpchallenge.com sheerseo.com
shohanb.com shoesonlinebuy.xyz
sideeffectsoftizanidine.blogspot.com shopcheermakeup.info
similardeals.net simon3.ru
site-speed-checker.site simple-image.com.ua
siteimprove.com site-speed-check.site
siteonomy.com slimcdn.com
siteripz.net slowmac.tech
sitevalued.com smart-scripts.com
sixcooler.de smartadserver.com
sklad-24.ru soc-proof.su
skypasss.com social-buttons.xyz
slonechka.ru socialmediasuggest.com
sloopyjoes.com sogimlecal.tk
socas.pluto.ro soheavyblog.com
social-s-ggg.xyz solution4u.com
sockshare.net sortthemesitesby.com
space-worry.ml sportbetfair.com
special-porn.com spylog.com
speechfoodie.com spymac.net
spy-sts.com spywarenuker.com
stop-gepatit.te.ua stanthonyscatholicchurch.org
stpicks.com starpages.net
strag-invest.ru stockquotes.wooeb.com
strongholdsb.ru storehouse.ua
students-cheapskate.ml stroimajor.ru
success-seo.com stromerrealty.com
sudexpert66.ru subj.ukr-lit.com
sukirgenk.dvrlists.com svensk-poesi.com
takethatad.com swimpool.ca
tarad.com szucs.ru
tattomedia.com tabletkinaodchudzanie.com.pl
tattooha.com tackletarts.co
td-33.ru tagil.zrus.org
teastory.co takeflyte.com
teenfuck.tv taxi-v-eisk.ru
tehngr.ru telefonsexi.com
tetracsaudi.com thetattoohut.com
texbaza.by thewebsitetemplate.info
thexart.club thiegs.reco.ws
titelhelden.eu tizanidinehcl4mgtab.blogspot.com
tizanidineandcipro.blogspot.com tizanidinemusclerelaxant.blogspot.com
tizanidinesideeffects.blogspot.com tkanorganizma.ru
tjkckpytpnje.com tooplay.com
tmtrck.com top10-online-games.com
tn811.us topbestgames.com
tnctrx.com topmira.com
tonivedu.it torrent-newgames.com
topads.men totu.us
topanasex.com traffique.net
torrent-to-magnet.com tuckermktg.com
torrnada.ru u17795.netangels.ru
touchmods.fr uasb.ru
tradedeals.biz ucoz.ru
trafficgenius.xyz unrealcommander.biz
trahic.ru unrealcommander.org
ua.tc usiad.net
ugogo.info ustion.ru
ukrtextbook.com v24s.net
uptime-gamma.net v720hd.ru
url-img.link vbtracker.net
usswrite.com vduplo.ru
varbergsvind.se
vesnatehno.com vesnatehno.com
vesnatehno.ru
viagra-soft.ru viagra-soft.ru
videochaty.ru vilingstore.net
vids18.site vip2ch.com
vietimgy.pw visionwell.com.cn
vigrx-original.ru vita.com.hr
virus-schutzmasken.de vksex.ru
visitcambridge.org voloomoney.com
viveresaniesnelli.it vpnmouse.com
vladimir.zrus.org vtc.pw
voluumtracker1.com w3javascript.com
vsexkontakte.net wallpapersdesk.info
vucms.com
w-journal.ru
wanker.us
wareseeker.com wareseeker.com
watchmyfb.pl webkeyit.com
waysbetter.cn
web-analytics.date
webinstantservice.com
website-stealer.nufaq.com website-stealer.nufaq.com
webtherapy.ru westen-v.life
weightatraining.com westum.se
wellcome2slovenia.ru whereiskentoday.com
whatistizanidine2mg.blogspot.com whiteproduct.com
wma-x.com winner7777.net
wiosenny-bon-1500.pl
wleuaprpxuvr.ga
woman-h.ru
womensplay.net
word-vorlagen.net
wordkeyhelper.com wordkeyhelper.com
worldhistory.biz worldis.me
worldlovers.ru writingservices17.blogspot.ru
worldmusicfests.com
wrona.it
ws.ampower.me
wsgames.ru wsgames.ru
www.timer4web.com www.solartek.ru
www.wohnkabinen-shop.de www.wohnkabinen-shop.de
wygraj-skiny.win x-porno.video
x-musics.com
x5market.ru x5market.ru
xaijo.com xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai
xblog.in xn--80aaajbdbddwj2alwjieei2afr3v.xn--p1ai
xdoza.com xn--80adaggc5bdhlfamsfdij4p7b.xn--p1ai
xingzi-vision.com xn--80ajjbdhgmudixfjc8c5a9df8b.xn--p1ai
xitjw.info xn--80aodinpgi.xn--p1ai
xmladserver.com
xn--1-8sbcpb0bdm8k6a.xn--p1ai
xn--b1addnj3cah.xn--p1ai
xn--b1ag5cfn.xn--p1ai
xnxx-n.com xnxx-n.com
yogamatsexpert.com xxlargepop.com
youandcredit.ru you-shall-not-pass.is74.ru
youbrainboost.asia yourothersite.com
youradexchange.com yugk.net
youtubedownload.org zajm-pod-zalog-nedvizhimosti.ru
yugo-star.ru zapatosenventa.info
zeroredirect8.com zeikopay.com
zeroredirect9.com znakomstva-moskva77.ru
zigarettenonl.canalblog.com znaniyapolza.ru
znakom.sibtest.ru zooggames.com
zone-kev717.info zoolubimets.ru
zrelaya.pw zoompegs.com
zzbroya.com.ua zrizvtrnpale.tk
zvooq.eu
zytpirwai.net
zzlgxh.com

480
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
123locker.com 00go.com
1webmaster.ml 20pascals.nl
40cg.com 28n2gl3wfyb0.ru
4webmasters.org 2pxg8bcf.top
adssafeprotected.com a1security.com.ua
advertisingtag.net absolutelyanalog.com
advokat-grodno.by adamoads.com
agecheckadult.com ads.gold
albumsuper.info aero2.ru
alfa-medosmotr.ru akuhni.by
alice.it alert-hgd.xyz
alpharma.net all4invest.ru
amazon-adsystem.com allnews24.in
amt-k.ru alltheviews.com
anticrawler.org amospalla.es
apilinkswiftco-a.akamaihd.net anaseracresar.tk
architecturebest.com animal-drawings.com
arendakvartir.kz aosheng-tech.com
arvut.org apartamentwroclaw.eu
atlasvkusov.ru apiallgeniusinfo-a.akamaihd.net
autovideobroadcast.com apiitsthirteende-a.akamaihd.net
avtovolop.ru apiportalmorecom-a.akamaihd.net
bag77.ru apiwoodensealcom-a.akamaihd.net
bang-hotties.com autobrennero.it
bank.uz aviav.org
bankofthewext.com azarttoto.com
bedandbreakfast.com backuperwebcam.weebly.com
betterhdporn.com banan.tv
beztuberkuleza.ru bazaronline24.ru
bimmerpost.com best-seo-software.xyz
binaryoptionscops.info bharatdefencekavach.com
bonkers.name biteg.xyz
bookmaker-bet.com blue-square.biz
buypuppies.ca bmwhighperformers.com
bvlgaribracelet.xyz bpro1.top
browserprotecter.com
bum.com.ru
bumble.cheapwebsitehoster.com
burger-tycoon.com
buy-cheap-online.info
buytizanidineonline.blogspot.com
buzzsumo.com
c-english.ru
cacheimages.com
camdolls.com camdolls.com
candlewooddentalcentre.com.au cbox.ws
chatroulette.world cheatcode-lita12.rhcloud.com
checkm8.com check-this-out-now.online
chiblackhawks-jerseys.com chocolateslim-original.com
chocolateslim-u-srbiji.com cialis-samples.com
ciproandtizanidine.blogspot.com citetick.com
clash-clans.ru cl.s7.exct.net
clmforexeu.com compliance-checker-7.info
cntravelre.com compliance-don.top
coin-hive.com compliance-jessica.top
coindirect.io connectingsingles.com
com-secure.download coolgramgoods.com
compliance-jane.top countercrazy.com
compliance-nelson.top crynet.cc
connectionstrenth.com crystalslot.com
continent-e.tv data-ox.com
d0t.ru demenageur.com
datsun-do.com detective01.ru
dmmspy.com dogclothing.store
documentbase.net domain-submit.info
drunkenstepfather.com domik-derevne.ru
drunkmoms.net dwomlink.info
eas-seo.com e-biznes.info
elektrischezigarette2.onsugar.com emerson-rus.ru
elektrischezigaretten1.blogse.nl enginebay.ru
elektronischezi.livejournal.com ereko.ru
englishgamer.com eyessurgery.ru
epngo.bz feorina.ru
eshop.md financehint.eu
eyelike.com.ua findclan.org
ezb.elvenmachine.com fiuxy.com
f5mtrack.com fordsonmajbor.cf
fashion-stickers.ru forexgb.ru
filmetricsasia.com forms-mtm.ru
flowersbazar.com forsex.info
forum.poker4life.ru frbizlist.com
franecki.net freewareseek.com
free-fbook-traffic.com gameplexcity.com
free-social-buttons.xyz gay-file.com
freelinkbuilding.website.tk get-free-traffic-now.com
freshsuperbloop.com glavprofit.ru
froggytube.com
fungamelands.com
gamblingnerd.com
gamebackyard.com
gotcher.us
gotomontenegro.net gotomontenegro.net
grand-chlen.ru greatfind-a.akamaihd.net
greatdealshop.com hao123.com
gsmtlf.ru hausfrauensex18.com
hatedriveapart.com healgastro.com
hchha.com highstairs-a.akamaihd.net
hikesearch.net hitsbox.info
histats.com homedecoguide.info
hiwibyh.bugs3.com humanelydrew.com
homedo.fabpage.com imperiafilm.ru
homemade.gq impresagaia.it
hosting-tracker.com
icaseclub.ru
ideoworld.org
imagerydatabase.com
indianmedicaltourismshop.com
interfucks.net
interior-stickers.ru interior-stickers.ru
invitefashion.com investsuccess.org
istizanidineanopiate.blogspot.com irkutsk.online-podarki.com
iyasimasennka.com j-times.ru
jrcigars.com jabimgo.pw
jav-idol.com
johnnyhaley.top
jose.mulinohouse.co
juliadiets.com
jumptap.com
jyvopys.com jyvopys.com
kareliatobacco.ru karadene.com
kiinomaniak.pl karting196.ru
kino-rating.ru kongruan.com
kino2018.cc koversite.info
knowsitall.info kurwa.win
krasula.pp.ua landoftracking.com
lakomka.com.ua
lalalove.ru
lanasshop.ru
lapolis.it
larger.io larger.io
law-check-two.xyz law-check-two.xyz
laxdrills.com lawyers.cafe
lechenie-gemorroya.com lenpipet.ru
linkbux.ru
lion.playtap.us lion.playtap.us
livefixer.com liran-locks.com
lob.com.ru lkbennettstore.online
loftdigital.eu louboutinreplica.xyz
lomb.co low-format.ru
magicplayer-s.acestream.net marsgatan.com
markjaybeefractal.com message-warning.net
max-p.men midst.eu
maxthon.com minecraft-neo.ru
menetie.ru mobilierland.com
meteocast.net modabutik.ru
mirtorrent.net moneyzzz.ru
mirzonru.net msk-diplomat.com
misswell.net musezone.su
mnogolok.info musicpro.monster
mojpreskumanie.com musicspire.online
most.gov.iq myfreetutorials.com
my-floor.in.ua nastroyke.net
mykings.pw news-readers.ru
mypets.by newstraveller.ru
myseoconsultant.com nudo.ca
netpics.org nuup.info
new-apps.ru offf.info
ngps1.ru offtime.ru
okmusic.jp online-zaymy.ru
okroshki.ru onthemarch.co
online-podarki.com open-odyssey.org
oren-cats.ru opinionreelle.com
otbelivanie-zubov.com pc-virus-d0l92j2.pw
paidonlinesites.com pila.pl
pammik.ru pix24x7.com
partner-print.men pl-top.pl
pinapchik.com pliks.pl
pladform.ru pochtovyi-index.ru
play.leadzupc.com pokemongooo.ml
polimga.pw
polybuild.ru polybuild.ru
popugaychiki.com pooleroadmedicalcentre.co.uk
pornhub-forum.ga poptool.net
porno-video-chati.ru pornoforadult.com
princeadvantagesales.com pornohd1080.online
printingpeach.com pornoklad.ru
prosmibank.ru porodasobak.net
prostitutki-belgoroda.org potoideas.us
prostitutki-kiev.org psa48.ru
pyrodesigns.com.au pufip.com
quangcaons.com purplesphere.in
raisedseo.com radiodigital.co
rank-checker.online remote-dba.de
realnye-otzyvy.info rfid-locker.co
retailwith.com robot-forex.biz
rossmark.ru rostov.xrus.org
s1z.ru ruscopybook.com
satoristudio.net s-forum.biz
saugatuck.com sajatvelemeny.com
scanner-margo.top samo-soznanie.ru
searchinquire.com sanidumps.com
seasaltwithfood.com sarm.tk
seo-traffic-ranking.info sayyoethe.blogspot.co.za
seogadget.ru scanner-andrew.top
seotoolsagency.com schlampen-treffen.com
sexreliz.com screentoolkit.com
sexsearch.com seadragonherbery.com
shtaketniki.ru see-your-website-here.com
si-unique.com seemoreresultshu-a.akamaihd.net
sibtest.ru seksvideoonlain.com
skyway24.ru seocheckupx.com
softtor.com sexvporno.ru
sosdepotdebilan.com simpoed.ufop.br
spravka130.ru sindragosa.comxa.com
staticfs.host site5.com
stillmiracle.com skatestick.bid
studentguide.ru slimcdn.com
studiofaca.com small-games.biz
styro.ru social-s-iii.xyz
socialbutton.xyz
souvenirua.com
sovetogorod.ru
spammen.de
startufa.ru
stop-gepatit.te.ua
strongsignal-a.akamaihd.net
success-seo.com success-seo.com
superfish.com svbur.ru
swagbucks.com sygraem.com
tattooha.com tampabaywatch.org
taximytishi.ru teastory.co
teenbbw.yopoint.in tecspb.ru
telefonsexkostenlos.tk telefonsex-ohne0900.net
tiens2010.ru telsis.com
time-japan.ru thebitcoincode.com
tizanidine4mguses.blogspot.com theguardlan.com
tizanidineandhydrocodone.blogspot.com tizanidine6mg.blogspot.com
tizanidinesleepaid.blogspot.com tizanidineduringpregnancy.blogspot.com
torontoplumbinggroup.com tizanidinerecreationaluse.blogspot.com
toys.erolove.in tnaionline.org
tsan.net top10-online-games.com
tsyndicate.com topquality.cf
tula.mdverey.ru tourcroatia.co.uk
tvory.predmety.in.ua trkdf.com
tvteleport.ru trkur.com
udayavani.com trustedhealthtips.com
ultimateclassicrock.com twittrading.com
umg-stroy.ru uytmaster.ru
undergroundcityphoto.com vandrie-ict.nl
uptimebot.net vilingstore.net
uzporno.mobi
validdomain.xyz
vezuviy.su
viagraneggrx.com
viddyoze.com
voloomoney.com
vse-pesni.com vse-pesni.com
w-journal.ru vzglyadriv.kg
webcamtalk.net wallpaperaccess.com
weboptimizes.com wedding-salon.net
website-speed-up.site whereverdesperate.gq
website-stealer.nufaq.com whosonmyserver.com
wemarketing.se wttavern.com
westermarkanjou.se www.event-tracking.com
wildworld.site x-lime.net
win-spy.com xmladserver.com
wingsoffury2.com xn----7sbahjd3btneuw1joc.xn--p1ai
wleuaprpxuvr.ga xn----8sbhefaln6acifdaon5c6f4axh.xn--p1ai
woman-tampon.ru xn--80ajbshivpvn2i.xn--p1ai
wrona.it xn--q1a.xn--b1aube0e.xn--c1acygb.xn--p1ai
ws.ampower.me xtraffic.plus
xaylapdiendanang.com yaminecraft.ru
xclicks.net yes-com.com
xfire.com ynymnwbm.bloger.index.hr
xlovecam.com yottos.com
xn-----7kcabaipgeakzcss7bjdqdwpfnhv.xn--p1ai yougame.biz
youporn-ru.com youporn-forum.ga
yur-p.ru yourserverisdown.com
zazagames.org zaidia.xhost.ro
zdesoboi.com zeikopay.com
zigarettenonlinekaufen.tumblr.com zrelaya.pw
znaniyapolza.ru
zskdla.site

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.130 0; 10.1.1.78 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3452 ### Version: V4.2022.11.3453
### Updated: Sat Nov 5 10:03:41 UTC 2022 ### Updated: Sat Nov 5 22:01:13 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.11.3452 ### Version: V4.2022.11.3453
### Updated: Sat Nov 5 10:03:41 UTC 2022 ### Updated: Sat Nov 5 22:01:13 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##