vikarti.anatra/nginx-ultimate-bad-bot-blocker
1
0
Fork 0
mirror of https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git synced 2025-09-10 14:56:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

V4.2022.04.3076 [ci skip]

Browse source
This commit is contained in:
mitchellkrogza 2022-04-30 10:10:26 +00:00
parent d0d89335b6
commit b1ab6412db
47 changed files with 74904 additions and 74894 deletions
Download patch file Download diff file Expand all files Collapse all files

2
AUTO-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3075 #### Version: V4.2022.04.3076
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
MANUAL-CONFIGURATION.md
View file

@ -4,7 +4,7 @@
### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation: ### PLEASE READ CONFIGURATION INSTRUCTIONS BELOW THOROUGHLY :exclamation:
_______________ _______________
#### Version: V4.2022.04.3075 #### Version: V4.2022.04.3076
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

2
README.md
View file

@ -14,7 +14,7 @@
##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots) ##### The Ultimate Nginx Bad Bot, User-Agent, Spam Referrer Blocker, Adware, Malware and Ransomware Blocker, Clickjacking Blocker, Click Re-Directing Blocker, SEO Companies and Bad IP Blocker with Anti DDOS System, Nginx Rate Limiting and Wordpress Theme Detector Blocking. Stop and Block all kinds of bad internet traffic even Fake Googlebots from ever reaching your web sites. [PLEASE SEE: Definition of Bad Bots](#define-bad-bots)
_______________ _______________
#### Version: V4.2022.04.3075 #### Version: V4.2022.04.3076
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9224
_generator_lists/bad-ip-addresses.list
View file

File diff suppressed because it is too large Load diff

2
_google_analytics_ghost_spam/README.md
View file

@ -3,7 +3,7 @@
# EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM # EASY CONFIGURATION INSTRUCTIONS FOR STOPPING GOOGLE ANALYTICS "GHOST" SPAM
_______________ _______________
#### Version: V4.2022.04.3075 #### Version: V4.2022.04.3076
#### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list) #### Bad Referrers Blocked: [7094](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-referrers.list)
#### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list) #### Bad User-Agents (Bots) Blocked: [637](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/bad-user-agents.list)
#### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list) #### Fake Googlebots Blocked: [217](https://raw.githubusercontent.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker/master/_generator_lists/fake-googlebots.list)

9228
_sample_config_files/Engintron_for_cPanel_WHM_Configuration_Example/etc/nginx/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9228
conf.d/globalblacklist-testing-version.conf
View file

File diff suppressed because it is too large Load diff

9228
conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

9228
dev-tools/beta_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/beta_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/beta_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/beta_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/beta_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/beta_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/buildnumber
View file

@ -1 +1 @@
3075 3076

9228
dev-tools/globalblacklist-testing.template
View file

File diff suppressed because it is too large Load diff

9228
dev-tools/globalblacklist.template
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.112.180.103 0; 20.119.52.34 0;

9228
dev-tools/test1_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ip_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/test1_conf_files_ip_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_ratelimiting/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_ratelimiting/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/test1_conf_files_ratelimiting/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test1_conf_files_whitelist/bots.d/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

2
dev-tools/test1_conf_files_whitelist/bots.d/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

9228
dev-tools/test1_conf_files_whitelist/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test2_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.112.180.103 0; 20.119.52.34 0;

9228
dev-tools/test2_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test3_conf_files/bots.d/whitelist-ips.conf
View file

@ -45,4 +45,4 @@
# - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions. # - Whitelisting IP's and RANGES here ONLY affects the IP blocking functions.
# - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks. # - This file will NOT allow your own IP to bypass bad User-Agent or Referrer String checks.
# - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST # - To bypass everything for a certain IP see notes in blockbots.conf on SUPER WHITELIST
40.112.180.103 0; 20.119.52.34 0;

9228
dev-tools/test3_conf_files/conf.d/globalblacklist.conf
View file

File diff suppressed because it is too large Load diff

2
dev-tools/test_units/blacklist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 1; 10.1.0.140 1;
127.0.0.1 1; 127.0.0.1 1;

20
dev-tools/test_units/random-bots-for-test-quick.list
View file

@ -1,10 +1,10 @@
Anthill BBBike
Go!Zilla Evil
Id-search IndeedBot
InternetSeer Lipperhey
NextGenSearchBot Mediatoolkitbot
PyCurl OpenLinkProfiler
ScoutJet Pump
Sqlmap True_Robot
Stripper Web Collage
cognitiveseo WebsiteExtractor

322
dev-tools/test_units/random-bots-for-test.list
View file

@ -1,250 +1,250 @@
01h4x.com ADmantX
404enemy ALittle Client
80legs ASPSeek
AIBOT
Abonti Abonti
Aboundex AfD-Verbotsverfahren
Aboundexbot
AiHitBot AiHitBot
Anarchie Alexibot
Anarchy99 Alligator
AlphaBot
Ankit Ankit
Anthill Asterias
Apexoo Atomseobot
Aspiegel
AwarioSmartBot AwarioSmartBot
BackWeb BLEXBot
Backlink-Ceck BacklinkCrawler
Badass BatchFTP
Bandit
Barkrowler
Battleztar Bazinga Battleztar Bazinga
BetaBot
Bigfoot
Bitacle Bitacle
Black Hole Black Hole
BlackWidow
Blackboard
Blow Blow
BlowFish
Boardreader Boardreader
Brandwatch Bolt
Buck BotALot
BuiltBotTough BuiltBotTough
BuiltWith Bullseye
BunnySlippers BunnySlippers
BuzzSumo
CCBot CCBot
CheeseBot Calculon
CherryPicker CazoodleBot
Chlooe Cegbfeieh
CensysInspect
CheTeam
ChinaClaw
Citoid Citoid
Claritybot Collector
Cogentbot Copyscape
Cosmos Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler CrazyWebCrawler
Crescent Crescent
CrunchBot Curious
CyotekWebCopy Custo
Demon DBLBot
Deusu DSearch
DatabaseDriverMysqli
DigitalPebble DigitalPebble
Dirbuster Disco
Discobot Discoverybot
DittoSpyder DomainStatsBot
DnyzBot
DomCopBot
Domains Project Domains Project
Dotbot
Download Wonder
ECCP/1.0 ECCP/1.0
EMail Wolf
EroCrawler
Evil Evil
Express WebPictures ExtLinksBot
Extractor ExtractorPro
Extreme Picture Finder FDM
EyeNetIE
FHscan FHscan
FemtosearchBot Fyrebot
Fimap GalaxyBot
FlashGet Genieo
Flunky GermCrawler
G-i-g-a-b-o-t GetWeb
GT::WWW GoZilla
Gigabot GrabNet
Go!Zilla
Grafula
GrapeFX GrapeFX
HMView GridBot
HTMLparser HTTP::Lite
HTTrack HTTrack
Heritrix Haansoft
Hloader HybridBot
Humanlinks
IDBTE4M
IDBot
Iblog Iblog
Image Sucker Id-search
IndeedBot IlseBot
InfoNaviRobot
InfoTekies
Intelliseek Intelliseek
InterGET Iria
Internet Ninja Iskanie
InternetSeer
IstellaBot IstellaBot
JamesBOT JamesBOT
JennyBot Jbrofuzz
JetCar
Jetty Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider Kenjin Spider
Keyword Density Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin Larbin
Leap
LeechFTP
LeechGet LeechGet
LexiBot
Lftp
LibWeb
Libwhisker Libwhisker
LinkScan Lightspeedsystems
LinkWalker Linkbot
LinkpadBot LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot LinqiaScrapeBot
Lmspider MIDown tool
MIIxpc
MJ12bot MJ12bot
MQQBrowser MSIECrawler
MTRobot MTRobot
Mag-Net Mag-Net
Majestic12 Magnet
Masscan Mail.RU_Bot
MauiBot Majestic SEO
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser Mb2345Browser
MicroMessenger Mediatoolkitbot
Microsoft Data Access Microsoft Data Access
Minefield Mojeek
Msrabot
NICErsPRO NICErsPRO
NPbot Name Intelligence
Nameprotect
Needle Needle
Nessus Nessus
NetLyzer Nibbler
Nikto NimbleCrawler
Nimbostratus
Nmap Nmap
Not Nuclei
Offline Explorer Nutch
OpenLinkProfiler
Openfind
Openvas Openvas
OutclicksBot OrangeSpider
PageAnalyzer PageAnalyzer
PageGrabber PageGrabber
PageScorer Papa Foto
PageThing.com Pavuk
Pandalytics Picscout
Panscient Pimonster
Petalbot Pockey
ProPowerBot
Probethenet Probethenet
Pump Pump
PyCurl PyCurl
RankFlex QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot RankingBot
RankingBot2
ReGet ReGet
Reaper
Recorder Recorder
RedesScrapy Rogerbot
RocketCrawler SISTRIX
SEOkicks
SEOlyticsCrawler
SMTBot SMTBot
ScanAlert
ScoutJet
Screaming Screaming
ScreenerBot ScreenerBot
ScrepyBot
Searchestate Searchestate
SearchmetricsBot SearchmetricsBot
SemanticJuice SeoSiteCheckup
SemrushBot Seomoz
SentiBot Siphon
SeobilityBot Sitebeam
SiteExplorer Siteimprove
Snoopy Sitevigil
SocialRankIOBot SmartDownload
Sociscraper Snapbot
Sogou web spider Sottopop
Sosospider SpaceBison
Spammen
Spanner Spanner
Spbot Spbot
SputnikBot Sqlworm
Surfbot Sucuri
Szukacz Suzuran
Swiftbot
TeleportPro TeleportPro
Telesoft TightTwatBot
TheNomad Toata
Tracemyfile Toweyabot
Trendiction Turingos
Trendictionbot
TwengaBot
Twice Twice
Typhoeus URLy Warning
VB Project UnisterBot
Vagabondo V-BOT
Vacuum
VelenPublicWebCrawler VelenPublicWebCrawler
VidibleScraper VoidEYE
Virusdie WISENutbot
Voil WWWOFFLE
WEBDAV Wallpapers/3.0
WPScan WallpapersHD
WWW-Collector-E
WWW-Mechanize
WeSEE WeSEE
Web Auto
Web Collage Web Collage
Web Enhancer Web Enhancer
Web Fetch Web Fetch
Web Pix Web Sucker
Web Sauger
WebAuto WebAuto
WebCollage
WebCopier
WebEnhancer WebEnhancer
WebFetch WebFetch
WebImageCollector
WebReaper
WebSucker
WebWhacker WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
WebsiteQuester WebsiteQuester
WebsiteExtractor
Webster Webster
Who.is Bot WiseGuys Robot
Wonderbot Wonderbot
Woobot Wotbox
Xaldon WebSpider
Xaldon_WebSpider Xaldon_WebSpider
Xenu Zauba
Zeus Zeus
Zitebot
ZoomBot ZoomBot
ZoominfoBot ZumBot
ZyBorg archive.org_bot
arquivo.pt arquivo.pt
autoemailspider
backlink-check backlink-check
cah.io.community cah.io.community
coccocbot cognitiveseo
demandbase-bot crawl.sogou.com
eCatch crawler.feedback
gopher dataforseo.com
heritrix facebookscraper
instabid instabid
linkdexbot internetVista monitor
magpie-crawler lwp-request
lwp-trivial
meanpathbot meanpathbot
mediawords muhstik-scan
netEstate NE Crawler netEstate NE Crawler
ripz oBot
page scorer
plumanalytics
probe-image-size
s1z.ru s1z.ru
scalaj-http
seocompany.store seocompany.store
seoscanners seoscanners
seostar seostar
sexsearcher sexsearcher
sitechecker.pro siteripz
sogouspider
sp_auditbot
tAkeOut tAkeOut
ubermetrics-technologies.com trendiction.de
voyagerx.com webpros.com
x09Mozilla
x22Mozilla
zauba.io zauba.io

316
dev-tools/test_units/random-bots-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
404enemy 360Spider
ADmantX
ALittle Client
Abonti Abonti
Acunetix Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Alligator Alligator
Anarchie Anarchie
Anarchy
Ankit Ankit
Attach Asterias
BBBike
BDCbot
BLEXBot BLEXBot
BackStreet BackDoorBot
BackWeb Badass
BacklinkCrawler
Bandit
Barkrowler Barkrowler
BetaBot BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow BlackWidow
Bolt
BotALot BotALot
Brandprotect Brandprotect
Buck
BuiltBotTough BuiltBotTough
CCBot BuiltWith
Bullseye
BunnySlippers
CODE87 CODE87
CSHttp
Cegbfeieh
CensysInspect
CherryPicker CherryPicker
ChinaClaw
Citoid
Cocolyzebot Cocolyzebot
Cogentbot Collector
CopyRightCheck
Copyscape
Cosmos Cosmos
Craftbot
Crawling at Home Project
Crescent
Curious Curious
CyotekWebCopy
DBLBot DBLBot
DSearch DIIbot
DTS Agent
DataCha0s DataCha0s
Demon Demon
Devil
Digincore Digincore
Dispatch Dirbuster
Disco
DnBCrawler-Analytics DnBCrawler-Analytics
DnyzBot DomCopBot
DomainAppender DomainAppender
DomainCrawler DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot Dotbot
EMail Siphon
EasyDL EasyDL
ExtLinksBot Ecxi
Ezooms EroCrawler
FHscan Evil
Firefox/7.0 FDM
FemtosearchBot
Fimap
FlashGet FlashGet
Flunky Foobot
Fuzz Freeuploader
Fyrebot G-i-g-a-b-o-t
Getintent GalaxyBot
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX GrapeFX
GridBot HMView
HTMLparser HTMLparser
Haansoft HaosouSpider
Harvest Havij
Hloader Heritrix
HybridBot Humanlinks
IDBTE4M IDBTE4M
IndeedBot IRLbot
InterGET Iblog
Internet Ninja Image Fetch
Iria Indy Library
Iskanie InfoTekies
IstellaBot Intelliseek
JennyBot InternetSeer
Jetty JOC Web Spider
JikeSpider JamesBOT
JustView Joomla
Keybot Translation-Search-Machine Jorgee
Keyword Density Kenjin Spider
Kozmosbot
LNSpiderguy LNSpiderguy
LWP::Simple
Larbin Larbin
LeechFTP
LexiBot LexiBot
Libwhisker Lftp
Lightspeedsystems LinkWalker
LinkScan
Linkbot Linkbot
LinkextractorPro LinkextractorPro
LinkpadBot
LinksManager LinksManager
LinqiaMetadataDownloaderBot LinqiaScrapeBot
MIIxpc Lipperhey
MSIECrawler Lipperhey Spider
MJ12bot
MSFrontPage
Mag-Net Mag-Net
Majestic SEO Mail.RU_Bot
Majestic-SEO Majestic-SEO
Majestic12 MarkMonitor
Mass Downloader MarkWatch
Masscan
Mata Hari Mata Hari
MauiBot
Mb2345Browser Mb2345Browser
Meanpathbot Microsoft Data Access
Mediatoolkitbot Mister PiX
MegaIndex.ru MolokaiBot
Mozlila Morfeus Fucking Scanner
Msrabot Msrabot
Musobot Navroad
Nameprotect Needle
NearSite Net Vampire
Nessus
NetAnts NetAnts
NetLyzer
NetMechanic NetMechanic
NetSpider NetSpider
NetZIP Netvibes
NextGenSearchBot
Nibbler Nibbler
Niki-bot Niki-bot
Nikto Nimbostratus
NimbleCrawler Ninja
Not Not
Nutch Nutch
Octopus Octopus
Offline Navigator
OnCrawl OnCrawl
Openfind OpenLinkProfiler
Openvas Openvas
OrangeBot PHPCrawl
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer PageAnalyzer
PageGrabber Pavuk
PageScorer Pi-Monster
Pandalytics ProWebWalker
Panscient
Papa Foto
Petalbot
Picsearch
Pimonster
Probethenet Probethenet
Pu_iN Psbot
RankFlex PxBroker
PyCurl
Quick-Crawler
RankActive
RankingBot RankingBot
RankingBot2 RankingBot2
RankurBot
Re-re
RealDownload
Reaper Reaper
RedesScrapy RepoMonkey
Ripper SEOprofiler
RocketCrawler
SEOlyticsCrawler
SISTRIX
SMTBot SMTBot
SalesIntelligent ScreenerBot
Scanbot
Scrapy
ScrepyBot ScrepyBot
SearchmetricsBot SemanticJuice
Semrush
SemrushBot
SentiBot SentiBot
Shodan SeoSiteCheckup
Siphon Siphon
Site Sucker SiteExplorer
SiteLockSpider
SiteSnagger
SlySearch SlySearch
SmartDownload
Snapbot
Snoopy Snoopy
Sociscraper
Sogou web spider
SpaceBison SpaceBison
SpankBot Spanner
SputnikBot Spbot
Surfbot Sqlmap
Sqworm
Steeler
Sucuri
SuperHTTP
Suzuran Suzuran
T8Abot Swiftbot
TeleportPro
Telesphorep
The Intraformant
Thumbor
Titan
Toata Toata
Toweyabot Toweyabot
Turingos Turingos
TurnitinBot TurnitinBot
TwengaBot Typhoeus
URLy Warning VCI
UnisterBot
Vacuum
Vagabondo Vagabondo
Virusdie WEBDAV
Voltron WISENutbot
WASALive-Bot Wallpapers
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Auto Web Auto
Web Enhancer Web Collage
Web Sauger Web Fuck
WebBandit WebCopier
WebGo IS WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix WebPix
WebReaper WebReaper
WebSauger
WebStripper
WebSucker WebSucker
WebWhacker
WebZIP WebZIP
Webalta
WebmasterWorldForumBot WebmasterWorldForumBot
Website Quester Website Quester
Webster WebsiteQuester
Whatweb
Who.is Bot Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon WebSpider Xaldon WebSpider
Xenu Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
Zeus Zeus
Zitebot
ZmEu
ZoominfoBot ZoominfoBot
ZumBot ZumBot
adscanner
archive.org_bot archive.org_bot
cah.io.community arquivo-web-crawler
check1.exe arquivo.pt
backlink-check
coccocbot coccocbot
crawl.sogou.com crawler.feedback
crawler4j crawler4j
demandbase-bot
domainsproject.org
eCatch eCatch
evc-batch heritrix
facebookscraper internetVista monitor
lwp-request isitwp.com
linkdexbot
magpie-crawler magpie-crawler
netEstate NE Crawler
polaris version polaris version
probe-image-size probe-image-size
ripz s1z.ru
seobility seoscanners
seocompany.store
seostar seostar
serpstatbot sexsearcher
sogouspider sitechecker.pro
sysscan tAkeOut
trendiction.com
trendiction.de trendiction.de
ubermetrics-technologies.com
voyagerx.com voyagerx.com
webgains-bot
webpros.com webpros.com
x22Mozilla webprosbot
x09Mozilla
xpymep1.exe xpymep1.exe
zauba.io

20
dev-tools/test_units/random-referrers-for-test-quick.list
View file

@ -1,10 +1,10 @@
256bit.by 40cg.com
8si.ru alert-fdm.xyz
arendakvartir.kz compliance-andrew.top
dptaughtme.com construmac.com.mx
enhand.se frankofficial.ru
freza-sverlo.ru hostingclub.lk
kaac.ru jofucipiku.tk
kino-fun.ru signx.info
pornosexrolik.com tooplay.com
tizanidinedrugtest.blogspot.com wholesalejerseychinaoutlet.com

928
dev-tools/test_units/random-referrers-for-test.list
View file

@ -1,500 +1,500 @@
00go.com 123kuma.com
0n-line.tv 12u.info
1000n1.ru 1j7740kd.website
101lesbian.xyz 2000k.ru
18ps.ru 2pxg8bcf.top
1kdailyprofit.me 3weekdiet.com
21h2o.com aa08daf7e13b6345e09e92f771507fa5f4.com
24x7-server-support.site abbanreddy.com
4rent.ru adamoads.com
6hopping.com addtoadd.men
70casino.online adultactioncam.com
8gold.com agysya.ru
991mostfm.co.id aktobe.xkaz.org
999webdesign.com
aa81bf391151884adfa3dd677e41f94be1.com
aad1f4acb0a373420d9b0c4202d38d94fa.com
abcdeg.xyz
abusora.com
activepr.ru
adidas.frwebs.fr
adinterax.com
adloads.com
admitad.com
adprotect.net
adverster.com
agecheckadult.com
alarmobninsk.ru alarmobninsk.ru
albuteroli.com algerianembassy.co.in
alert-fdm.xyz alice.it
algarveglobal.com all-streaming-media.com
all-number.com alldubai.biz
all4invest.info allfinweb.com
all4wap.ru alt-servis.ru
am-se.com alyeskaresort.com
amazingpic.net amyfoxfitness.com
amoi.tn animali.deagostinipassion.it
anaseracresar.tk apibetweenlinesn-a.akamaihd.net
anatomiy.com apibrowsesmartne-a.akamaihd.net
android4fun.org apple.com-cleaner.systems
angel1777.kz approved.su
apartmentratings.com apptester.tk
apimossnetinfo-a.akamaihd.net arcteryxsale.online
appfixing.space arenanews.com.ua
apps-analytics.net arendatora.ru
arabgirls.adultgalls.com arkartex.ru
arcadepages.com
arcadeplayhouse.com
arquapetrarca.info
asdfg.pro asdfg.pro
ausergrubhof.info asscenihotosidea.blogspot.co.za
autoloans.com atdedinotuho.tk
autolombard-krasnodar.ru audiobangout.com
autoseo-traffic.com autonew.biz
aviapanda.ru autowebmarket.com.ua
avitocars.ru aviav.eu
avramstroy.ru avirasecureserver.com
ayanaspa.com avto-oligarh.ru
azartmix.com bad-stars.net
b00kmarks.com bag77.ru
babyguns.ru berlininsl.com
baksman.com bestempresas.es
bankiem.pl besthomemadepornsites.com
barnfurnituremart.com bestofferswalkmydogouteveryday.gq
beauty-things.com bestsexyblog.com
bedandbreakfast.com betonka.pro
belsetirehafi.tk
bestimagecoollibrary.com
bestofpicture.com
bestwrinklecreamnow.com
betune.onlinewebshop.net betune.onlinewebshop.net
big-boards.info bezsporno.ru
big-cash.net bgviagrachrx.com
bingo8888.com bibys.com
bitcoin-ua.top bildsuche.ru
bjgugu.net.ua binomo.com
bio.trade-jp.net
bkgr.se bkgr.se
blagovest-med.ru blog.f00kclan.de
blog.koreadaily.com blog.koreadaily.com
bloggers.nl
blogporn.in blogporn.in
bonanza-fortune.men bosman.pluto.ro
bonky.biz breget74.ru
bonux.nextview.ru brk-rti.ru
boo-arts.com btvn.ru
bookmark4you.com bum.com.ru
boole.onlinewebshop.net bumascloset.com
bosefux.esy.es burger-tycoon.com
brendbutik.ru
brewdom.ru
buchananshardware.com
bugshoot.cn
buscarfoto.com buscarfoto.com
businesn.men buypuppies.ca
buy-forum.ru bzero1jewelry.net
buyscabiescream.com cacheimages.com
buytizanidineonlinenoprescription.blogspot.com cardsharp1.ru
bwlx.prepedu.cn carrauterie.be
cand.jp cartierbracelet.xyz
candycrushshop.com cartierbraceletsreplica.pw
cardul.ru cartiertrinity.xyz
cartechnic.ru cartierwatch.xyz
cartierlovebraceletreplica.xyz cartujano-pre.de
cartierring.xyz cascadelink.org
caveavins.fr castingbank.ru
cfsrating.sonicwall.com cbox.ws
chocoslim.pro cdncash.org
choosecuisine.com chatroulette.life
cialischsrx.com chelnytruck.ru
chinaelitecheapjerseys.com
citetick.com citetick.com
claytransformations.info cjs.com.ru
clickbanksites.info classiquebijoux.ru
clickcash.com
clips.ua.ac.be clips.ua.ac.be
coin-hive.com comissionka.net
com-cleaner.systems compliance-checker.info
compliance-alex.xyz compliance-elena.top
compliance-andrew.xyz compliance-fred.xyz
compliance-fred.top compliance-jane.top
compliance-irvin.xyz conboy.us
connectingsingles.com copypaste.traderzplanet.in
converse.ddsoldes.fr counter.bloke.com
coolyarddecorations.com countercrazy.com
dafatiri.com country-chic.ru
darkbooks.org courtshipgift.com
data-ox.com crackguru.tk
ddpills.com cscwtalkto.site
demenageur.com cyclobenzaprinevstizanidine.blogspot.com
design-ideas.info darkages.info
detalizaciya-tut.biz ddlmega.net
dickssportinggoods.com decoratinghomes.ga
digilander.libero.it decorationspcs.com
digital-video-processing.com depositfiles-porn.ga
digitalassetmanagement.site deshevo-nedorogo.ru
dlya-android.org dev-seo.blog
dogsrun.net digital-sale.su
domaincrawler.com dimkino.ru
domination.ml directivepub.com
dosug-lux.ru divisioncore.com
dptaughtme.com diy-handmade-ideas.com
duplicashapp.com djekxa.ru
edge.sharethis.com dkvorota.ru
education-cz.ru doublepimp.com
ege-essay.ru download-wallpaper.net
ege-russian.ru druzhbany.ru
el-nation.com dtm-spain.com
e-collantes.com
ed-shop01.ru
electrik-avenue.com
elektronischezigarettekaufen1.myblog.de elektronischezigarettekaufen1.myblog.de
elektrozigarette2.webs.com elitepcgames.com
elmifarhangi.com empirepoker.com
emergencyneeds.org engines-usa.com
empathica.com englishdictionaryfree.com
energydiet-info.ru enskedesquashclub.se
energydiet24.ru erotik-kostenlos.net
enhand.se event-tracking.com
epngo.bz expdom.com
erotiktreff24.info ezigarettekaufen.myblog.de
essaypro.com f07.de
essayservicewriting.org f1nder.org
euromasterclass.ru familyphysician.ru
europages.com.ru favorcosmetics.com
evehemming.blogspot.com.au favornews.com
evrotekhservis.ru ferieboligkbh.dk
ewebarticle.info financetip.eu
excaliburfilms.com find1friend.com
expresstoplivo.ru firstdrugmall.ru
falcon-images.blogspot.com firstsiteguide.com
felizporno.com forex-procto.ru
fetlifeblog.com forum20.smailik.org
fickenbumsen.net
fidelityfunding.com
filkhbr.com
fishingwholesale.us
forex.osobye.ru
forminecrafters.ru
forumprofi.de forumprofi.de
free-traffic.xyz freshsuperbloop.com
freenode.info frvo.alptandem.ru
fuck-paid-share-buttons.xyz funnypica.com
fun-mobi.pl fxgallery.com
gambarxkata.co gallictures.com
genetworx.com gamewrath.com
getmyads24.com gazoblok.net.ua
gonextmedia.com gemara.com
goodhumor24.com getlaid-xxxhookupdirect.com
gopro-online.info getlamborghini.ga
gosmeb.ru ghernnqr.skyrock.com
gotomontenegro.net gigapeta.com
gotorussia.com girlgamerdaily.com
gratuitxblcodes.com gloverid.site
greatidea.marketing googlepositions.com
gsasearchengineranker.pw gosreg.amchs.ru
gsasearchengineranker.top grtyi.com
guod.me gsasearchenginerankerdiscount.com
hackers-crackers.tk gta-club.ru
hamacapty.com gtopstats.com
hamptonoaks.ca guardlink.org
hd720kino.ru gwagka.com
healbio.ru hannasolution.ru
healgastro.com hdfreeporno.net
hebr.myddns-flir.com hdxnxxtube.mobi
helvetia.com.ua hermesreplica.win
hkdiiohi.skyrock.com high-speed1.net
holidaypics.org himazin.info
hoterika.com hiwibyh.bugs3.com
hotshoppymac.com hobild.net
howtoclean.club hostsshop.ru
hulfingtonpost.com hotdl.in
ideawheel.com hoverboard360.nl
iflycapetown.co.za ico.re
ilmen.net id-forex.com
ilovevitaly.ru ie.57883.net
immigrational.info igadgetsworld.com
inclk.com iinstalll-fii1leis.jus0wil.pp.ua
instakink.com ikritikimou.gr
interior-stickers.ru ilmexico.com
internet-apteka.ru imagecoolpub.com
inzn.ru images-graphics-pics.com
ip-guide.com imagez.co
iqoption.pro inome.com.ua
irunfar.com ipchicken.com
istizanidineanarcoticdrug.blogspot.com istizanidinelikexanax.blogspot.com
izismile.com it-max.com.ua
jerseychinabizwholesale.us janavibekken.no
jerseyschinabizwholesale.us janerikholst.se
jikoman.info jav-idol.com
jurajskie.info javstock.com
kamalsinha.com jeremyeaton.co
keywesthideaways.co jerseywholesalebizchina.com
kidskunst.info jillepille.com
kinofak.net joessmogtestonly.com
journalhome.com
joy-penguin.com
kaac.ru
kamorel.com
kareliatobacco.ru
katushka.net
kchaxton.com
keenoutlet.online
kinocccp.net
kinoflux.net kinoflux.net
kinoplen.ru kongoultry.net
kiwe-analytics.com konkursov.net
klejonka.info konturkrasoty.ru
konica.kz koronirealestate.gr
konoplisemena.com
konteiner24.com
kopihijau.info
koral.se
kosmetyki.tm.pl
kosynka-games.ru
kountrylife.com kountrylife.com
krasnodar.zrus.org krasivye-devushki.net
kustanay.kz ks1234.com
kvartira-sutochno.com kurwa.win
lacasamorett.com kw21.org
lampokrat.ws laexotic.com
lanadelreyfans.us
lancheck.net
laparfumotec.com
lapolis.it
leadwayau.com leadwayau.com
lechtaczka.net lenvred.org
letmacworkfaster.site levaquin750mg.blogspot.com
lider-zhaluzi.kiev.ua lionking-1994.blogspot.com
life-instyle.com littleberry.ru
lineavabit.it lkbennettoutlet.online
lion.bolegapakistan.com lombia.co
littlesunraiser.com lombia.com
liverpool.gsofootball.com louboutinreplica.pw
locustdesign.co lsex.xyz
love-baby.cz mackeeper-center.club
lyrster.com macrotek.ru
mackeeper-land-672695126.us-east-1.elb.amazonaws.com mafa-free.com
managerpak204.weebly.com mansiondelrio.co
masserect.com marwer.info
mathgym.com.au master-muznachas.ru
matsdale.com masturbate.co.uk
matb3aa.com
max-eclat.men
max-p.men max-p.men
medanestesia.ru medicinacom.ru
meddesk.ru medosmotr-ufa.ru
meetingrainstorm.bid mensandals.xyz
mejoresfotos.eu meteocast.net
members.ghanaweb.com middlerush-a.akamaihd.net
militarysale.pro militarysale.pro
mixed-wrestling.ru miniature.io
mixtapetorrent.com minyetki.ru
mobplayer.net misswell.net
mojpregled.com mister-shop.com
mompussy.net mmofreegames.online
moscow-region.ru mnimmigrantrights.net
mosdverka.ru mnogabukaff.net
mototsikl.org modabutik.ru
mowser.com monarchfind-a.akamaihd.net
moyaterapiya.ru monsterdivx.com
monthlywinners.com
morlat.altervista.org
moskva.nodup.ru
mountainstream.ms
movpod.in
mrwhite.biz mrwhite.biz
my-aladin.com multgo.ru
my-big-family.com mundoaberrante.com
musicdaddy.net
muztops.ru
my-bc.ru
my-cash-bot.co my-cash-bot.co
mydoctorok.ru mydirtystuff.com
myindospace.com
mykings.pw
mysex21.com
myshopmatemac.com myshopmatemac.com
narkologiya-belgorod.ru nacap.ru
narutonaruto.ru naturtreenspicerx.pw
nastydollars.com
naval.jislaaik.com
neks.info neks.info
newfilmsonline.ru net-profits.xyz
newstudio.tv netvouz.com
nextconseil.com newstaffadsshop.club
nextlnk12.com newtechspb.ru
nfljerseyscheapbiz.us nikitsyringedrivelg.pen.io
novgorod.xrus.org novodigs.com
nw-servis.ru nudejapan.net
oakridgemo.com nuker.com
ofanda.com o-o-11-o-o.com
offf.info o00.in
online-sbank.ru o333o.com
osoznanie-narkotikam.net obesidadealgarve.com
ossmalta.com obiavo.su
ourville.info offside2.5v.pl
page2rss.com oil-td.ru
paighambot.com oklogistic.ru
parajumpersstore.online okonich.com.ua
partner-print.men onlinadverts.com
partnerads.men online-hit.info
pdns.download onlinemegax.com
perl.dp.ua onload.pw
pewit.pw optom-deshevo.ru
phobia.us paleohub.info
photochki.com pandroid.co
php-market.ru parvezmia.xyz
picturesify.com perso.wanadoo.es
pk-pomosch.ru phormchina.com
pl.aasoldes.fr phrcialiled.com
platezhka.net physfunc.ru
playboyfiles.xblog.in piccdata.com
polytopesexempt.com pills24h.com
pomoc-drogowa.cba.pl pisanieprac.info
popup-hgd.xyz pistonclasico.com
poquoson.org pix-hd.com
pornogig.com pizda.lol
pk-services.ru
pkr1hand.com
plastweb.ru
playmsn.com
podshipniki-nsk.ru
podshipniki-ntn.ru
poisk-zakona.ru
pornmania.pl
porno-transsexuals.ru
pornosemki.info
pornoslive.net
pornotubexxx.name pornotubexxx.name
portal-eu.ru poshiv-chehol.ru
porto.abuilder.net postclass.com
pregnant.guru pourvous.info
pretty-mart.com preg.marketingvici.com
pricheskaonline.ru printdirectforless.com
pricheski-video.com privat-girl.net
privatamateure.com
privatefx.all4invest.info privatefx.all4invest.info
privatov-zapisi.ru prizeestates.cricket
prodess.ru prlog.ru
professionaldieselcare.com
profitsport.club profitsport.club
prointer.net.ua promoheads.com
promalp-universal.ru prostitutki-tyumeni.org
prostitutki-kiev.org pts163.ru
prpops.com qpypcx.com
push-ad.com quickcashlimited.com
pushdata.sendpulse.com quickchange.cc
qitt.ru quizzitch.net
quality-traffic.com
queerspace.com
qwesa.ru qwesa.ru
ranksays.com ranksignals.com
razorweb-a.akamaihd.net razleton.com
registry-clean-up.net realizmobi.com
remont-ustanovka-tehniki.ru refudiatethissarah.info
responsive-test.net registrysweeper.com
rimedia.org relax.ru
risparmiocasa.bz.it restaurantlescampi.com
ros-ctm.ru rezeptiblud.ru
ruscopybook.com rfd-split.hr
rusvideos.su rialp.getenjoyment.net
sa-live.com ringporno.com
safe-app.net rome2rio.com
saletool.ru russia-tao.ru
salut-camp.ru russia-today-video.ru
sampleletters.net rybalka-opt.ru
sanjosestartups.com samo-soznanie.ru
saratov.xrus.org sarafangel.ru
sbf441.com scalerite.co.za
sbornik-zakonov.ru scanhub.ru
scanner-jack.top scanner-jess.top
schoolfiles.net scopich.com
score-ads.men scrapinghub.com
search.alot.com screpy.com
searchaddis.com searchtooknow-a.akamaihd.net
searchimpression.com seoanalyses.com
searchinquire.com seogadget.ru
seinterface.com seoholding.com
selectads.men
senger.atspace.co.uk
seojokes.net
seomarketings.online seomarketings.online
serviporno.com seoprofiler.com
sexxdate.net sethrollins.net
shinikiev.com.ua sex-dating.co
sexreliz.com
sextracker.be
sextracker.de
sexvporno.ru
sexyali.com
sexyebonyteen.com
sherlock.se
shtaketniki.kz shtaketniki.kz
simul.co sibecoprom.ru
sluganarodu.ru sientalyric.co
smadihome.com simon3.ru
sodexo.com site3.free-share-buttons.com
soft-program.com siteexpress.co.il
softomix.com siteripz.net
softomix.net skypasss.com
softtor.com sladkoevideo.com
sonata-arctica.wz.cz slimcdn.com
songplanet.ru slutloadlive.com
soundfrost.org smailik.org
spacash.com socas.pluto.ro
spasswelt.xyz social-buttons.com
soda.media
soft-terminal.ru
soietvousmaime.fr
souvenirua.com
speechfoodie.com
spin2016.cf
spywarebegone.com spywarebegone.com
spywareit.com statistici.ro
sstroy44.ru stmassage.ru
stathat.com stpicks.com
statoutlook.info
stats-public.grammarly.io
steamoff.net
steelmaster.lv
stpolice.com stpolice.com
studentguide.ru strana-solnca.ru
superfish.com success-seo.com
svolze.com suchenindeutschland.com
taqywu51.soup.io sukirgenk.dvrlists.com
tattoo33.ru svarbit.com
td-33.ru swiped.su
symphonyintegratedhealthcare.com
tds-advert002.info tds-advert002.info
techart24.com
tecspb.ru tecspb.ru
templates.franklinfire.co teenfuck.tv
thedownloadfromwarez.blogspot.com teesdaleflyballclub.co.uk
ticketsys.inetwd.com telefonsexi.com
tivolibasket.it telefonsexkostenlos.tk
tizanidinenarcotic.blogspot.com telemetryverification.net
topsy.com telsis.com
torrent-to-magnet.com tgtclick.com
torrentred.games the-trader.net
torrents.life thecoral.com.br
traderzplanet.in thecounter.com
trafficnetzwerk.de thfox.com
traffictrade.life thin.me.pn
trubywriting.com thruport.com
trustedhealthtips.com titan-cloud.life
tuckermktg.com tonerbox.kz
tula.howotorg.ru toondinsey.com
tvteleport.ru torrentdownloadhub.com
twitlinks.com torrnada.ru
u17795.netangels.ru touchmods.fr
uac.net.au tradgardspartner.se
uprour.com trafficshaper.com
usiad.net trainoffend.ml
uzungil.com traxdom.ru
vacances-voyages.info trudogolik.net
vadimkravtcov.ru tryrating.com
vapomnoncri.tk unimodemhalfduplefw.pen.io
vertaform.com unitygame3d.com
via-energy-order.com universals.com.ua
viagroid.ru unrealcommander.com
video-hollywood.ru ustion.ru
uvozdeckych.info
vacuumcleanerguru.com
velen.io
viagra.pp.ua
viberdownload10.com
video-camer.com
video-woman.com video-woman.com
videochat.bz
videochat.tv.br videochat.tv.br
videositename.com videosbox.ru
vinsit.ru voltrknc1.com
vipromoffers.com
vipsexfinders.com
vizag.kharkov.ua
vksaver-all.ru
vksex.ru
voronezh.xrus.org
vote-up.ru
vzlomfb.com vzlomfb.com
walkme.com w3javascript.com
wanker.us webenlace.com.ar
wapsite.me weddingdresses.xyz
watracker.net westen-v.life
weekes.biz.tc westvilletowingservices.co.za
wellcome2slovenia.ru whatsappbot.flyland.ru
wemarketing.se whengirlsgowild.com
wholesalejerseychinaoutlet.com wieseversa.no
winterclassichockeyjerseys.com winterclassichockeyjerseys.com
witclub.info womensterritory.ru
word-vorlagen.net worldmusicfests.com
word-vorlagen.xyz wufak.com
wordkeyhelper.com www.ehscloud.cn
works.if.ua www.event-tracking.com
wowas31.ucoz.ru
ww2awards.info
www.labves.ru www.labves.ru
x-true.info www.solartek.ru
xblognetwork.com wygraj-teraz.com
xmlinde.com xcombear.ru
xn--80aaaks3bbhabgbigamdr2h.xn--p1ai xn-----8kcatubaocd1bneepefojs1h2e.xn--p1ai
xn--80ahvj9e.xn--p1ai xn--80ahdheogk5l.xn--p1ai
xtraffic.plus xportvusbdriver8i.snack.ws
xxx-treker.ru xrus.org
yellowstonevisitortours.com xtrafficplus.com
youandcredit.ru xxxnatelefon.ru
yourtemplatefinder.com xxxsiterips.xyz
yellowproxy.net
ynymnwbm.bloger.index.hr
yogamatsexpert.com
youporn-forum.ga
youporn-ru.com
your-bearings.com
youradexchange.com
yourporngay.com
youtoner.it youtoner.it
yur-p.ru yugk.net
zahvat.ru yun56.co
zakazfutbolki.com zdesformula.ru
zambini.ru zerocash.msk.ru
zarabiaj-dzis.pl zigarettenonlinekaufen2.drupalgardens.com
zetmaster.ru znakomstvaonlain.ru
zigarettenonlinekaufen2.bloog.pl zojirushi-products.ru
zmoda.hostreo.com zone-kev717.info
zolotoy-lis.ru zoolubimets.ru
zscaler.net
zvezdagedon.ru

482
dev-tools/test_units/random-referrers-for-whitelist-test.list
View file

@ -1,250 +1,250 @@
1008.su 256bit.by
1webmaster.ml 4k-player.pl
2728fb936f0.com
51.la
72-news.com
7minuteworkout.com 7minuteworkout.com
DomainStatsBot aarbur.com
aa8b68101d388c446389283820863176e7.com actionnooz.com
aasoldes.fr addtoadd.men
adelly.bg afmuseum.com
adktrailmap.com alevinefesleri.com
alienwheel.es alldownload.pw
alkoravto.ru alldubai.biz
allornamenti.com alt-servis.ru
alveris.ru
ameblo.top ameblo.top
anonymizeme.pro apple.com-webbrowsing-security.review
anti-virus-removal.info apple.com-webbrowsing-security.science
apartmentratings.com articlesdirectoryme.info
appsecurityr.com asiavirtualsolutions.com
asdfg.pro asmxsatadriverin.aircus.com
asia-forum.ru asscenihotosidea.blogspot.co.za
autochoixspinelli.com audiobangout.com
autotop.com.ua autogrep.ru
balla-boo.se bestcalovebracelet.cn
bannerconnect.net bidbuy.co.kr
basedecor.ru big-boards.info
besthoro.ru bimatoprost-careprost.com.ua
bestwebsitesawards.com binomo.com
bio-japan.net binomo.kz
bitporno.sx bitnote.co
blogrankers.com bjanshee.ru
blogsfunky672.weebly.com blogsfunky672.weebly.com
builtwith.com bonvillan.com
buynorxx.com brains2.biz
cakemediahq.com.au bryansk.zrus.org
camel-beach.com btc4u.ru
candelluxsklep.pl buntube.net
carina-sy.de buscarfoto.com
carsplate.com business-made-fun.com
buy-loft.ru
cakesplus.com.au
casinos4dummies.co.uk casinos4dummies.co.uk
cdnnetwok.xyz cdncash.org
ceotrk.com cfsrating.sonicwall.com
cheapjerseysbizwholesale.us cheapmoncler.pw
cheapjerseysfootballshop.com chinajerseyswholesalecoupons.com
christianlouboutinreplica.win cindymatches.com
chuckguilford.com cityadspix.com
cjs.com.ru clayvasedesigns.tk
clean-virus-mac.com cobaltpro.ru
clips.ua.ac.be codysbbq.com
coin-hive.com colehaanoutlet.store
comeondog.info compliance-barak.top
compliance-julianna.top compliance-irvin.xyz
construmac.com.mx creditmoney.com.ua
coop-gamers.ru cwetochki.ru
countbertwistdisp26.soup.io daneshetabiat.com
cpajunkies.com daptravel.com
dcj-nn.ru datadepths.com
descargar-musica-gratis.net den-noch24.ru
deutschehobbyhuren.net depositfiles-porn.ga
dogoimage.com detalizaciya-tut.biz
domain.webkeyit.com dimaka.info
downloads-whatsapp.com diusyawiga.tk
drpornogratisx.xxx drunkenstepfather.com
druzhbany.ru e-biznes.info
dscaas.website earn-from-articles.com
dwomlink.info edge.sharethis.com
dynainbox.com editors.choice6912650.hulfingtonpost.com
e90post.com elidelcream.weebly.com
elitepcgames.com encodable.com
energydiet-info.ru estibot.com
esfchat.tk evening-dating-club.info
exci.ru ezigarettekaufen2.mpbloggar.se
expolicenciaslatam.co f07.de
extstat.com fashionindeed.ml
eywords-monitoring-your-success.com fetroshok.ru
faptitans.com fickenprivat.info
fastcrawl.com financetip.eu
ferieboligkbh.dk firstsiteguide.com
fidelityfunding.com fishingwholesale.us
fifa-coins.online foto-telok.net
film-one.ru foxtechfpv.com
fireads.men frighteningremain.cf
frameimage.org frustrated-favorable.gq
fungamelands.com gambarxkata.co
funnymama.com gateway.zscalertwo.net
game300.ru gsasearchengineranker.space
gavuer.ru
gayxperience.com
gearsadspromo.club
getprismatic.com
getyourimage.club
global-ics.co.za
goforexvps.com
gombita.info
goodwriterssales.com
gsou.cf gsou.cf
hdseriale.pl hamilton.ca
headpharmacy.com happy.new.yeartwit.com
hetmanship.xyz heygidday.biz
hidemyass.com houseofrose.com
highspeed5.net hptwaakw.blog.fc2.com
historichometeam.com igtools.club
hobbyhuren-datenbank.com imgarit.pw
hoste.octopis.com
hotcore.info
humbmosquina.tk
iccornacircri.cf
ifmo.ru
impisr.ru impisr.ru
int.search.mywebsearch.com inet-traffic.com
internetproviderstucson.com investsuccess.org
iplusbit.blogspot.co.za io9.com
iptool.xyz
iqs.biz.ua iqs.biz.ua
islandminingsupply.wordpress.com jackpotchances.com
jacago.com johannesburgsingles.co.za
kandidos.com journalhome.com
kiinomaniak.pl jwss.cc
kinomaniatv.pl kakadu-interior.com.ua
konoplisemena.com kerch.site
koopilka.com kinobaks.com
koversite.info kinohit1.ru
kustanay.kz kinopolet.net
lasvegaslockandsafe.com kirov.zrus.org
legionalpha.com klitimg.pw
lflash.ru kollekcioner.ru
limads.men kollesa.ru
lincolntheatre.com kolotiloff.ru
liupis.com konturkrasoty.ru
livefixer.com ladov.ru
m4ever.net lafriore.ru
masthopehomes.com lonfon.xyz
members.ghanaweb.com lyrster.com
michaelkorsoutlet.store maglid.ru
milblueprint.com manuscript.su
mobsfun.net martlinker.com
modnie-futbolki.net medicine-4u.org
moivestiy.biz meget.co.za
montredemarque.nl mere.host.sk
mountainstream.ms mesto-x.com
mrmoneymustache.com micasainvest.com
myanyone.net mjchamonix.org
nastroyke.net mojpreskumanie.com
monarhs.info
monclercheap.xyz
moncleronline.xyz
mowser.com
moyaterapiya.ru
mrbitsandbytes.com
multgo.ru
music7s.me
my-bc.ru
mycaf.it
myfreetutorials.com
nac-bearings.ru
nardulan.com
networkcheck.xyz
nextbackgroundcheck.gq
nfljerseyscheapchinabiz.com nfljerseyscheapchinabiz.com
nicefloor.co.uk noclegonline.info
novgorod.xrus.org norththeface.store
obiavo.com ntic.fr
obiavo.su nw-servis.ru
onthemarch.co obnal.org
ooo-olni.ru offer.camp
ownshop.cf office-windows.ru
pastaleads.com omsk.xrus.org
pdn-4.com oralsexfilme.net
perosan.com orhonit.com
phormchina.com paccohichetoti.ml
phuketscreen.com panchro.xyz
piccdata.com pelfind.me
picsearch.com picmoonco.pw
pod-muzyku.club plastweb.ru
pony-business.com poems.com.ua
poshiv-chehol.ru pomoc-drogowa.cba.pl
preg.marketingvici.com porn-w.org
preparevideosafesystem4unow.site pornhub-forum.ga
presleycollectibles.com progonrumarket.ru
privatamateure.com prointer.net.ua
privatov-zapisi.ru prostitutki-belgoroda.org
privhosting.com prostitutki-kharkova.org
psvita.ru prostitutki-kiev.org
puteshestvennik.com qexyfu.bugs3.com
q-moto.ru quick-seeker.com
quelle.ru rangjued.com
rankings-analytics.com rangoman.date
redirect.trafficreceiver.club razyboard.com
registratciya-v-moskve.ru reklamuss.ru
remontvsamare.su rep-am.com
roleforum.ru respublica-otel.ru
roofers.org.uk rniaeba.ga
rusexy.xyz rock-cafe.info
russkie-gorki.ru royalads.net
sarf3omlat.com ru-dety.ru
satellite.maps.ilovevitaly.com rubbed.us
saveriopiazza.it ruspdd.com
seadragonherbery.com sabaapress.com
search-goo.com sale-japan.com
secret.xn--oogle-wmc.com saveindex.xyz
segol.tv seinterface.com
selectads.men sex-pr.net
sell-fb-group-here.com sexblog.pw
seomarketings.online sexs-foto.top
seorankinglinks.com sharebutton.org
seorussian.ru shemale-sex.net
sexreliz.com sherlock.se
shillyourcoins.com site-speed-check.site
sisiynas.ru site5.com
site3.free-share-buttons.com skylta.com
slutloadlive.com solnplast.ru
social-button.xyz sovetogorod.ru
social-search.me sovinsteel.ru
socialbuttons.xyz spravka130.ru
softlinesolutions.me sprttrack.com
solicita.info start.myplaycity.com
spinazdrav.ru store-rx.com
sportbetfair.com strongholdsb.ru
sps-shop.com sukirgenk.dvrlists.com
spymac.net superoboi.com.ua
sterva.cc svetodiodoff.ru
stroiminsk.com symbaloo.com
svarkagid.com taihouse.ru
tam-gde-more.ru tech4master.com
telefonsex-ohne0900.net teletype.in
thegalerie.eu templates.radiodigital.co
tizanidine4mgstreetvalue.blogspot.com thaisamkok.com
torrent-newgames.com theporndude.com
torrentdownloadhub.com thesmartsearch.net
torture.ml tizanidinefibromyalgia.blogspot.com
toy-shop.top tksn.ru
trafficmania.com todohr.com
turbodsp.com totu.us
turist-strani.ru trailer.cinemaflix.website
turizmus.us truck-land.life
twodollarshows.com trustedmaccleaner.com
umityangin.net umekana.ru
uprour.com unrealcommander.org
upupa.net uptimechecker.com
url-img.link urll.eu
validccseller.com usdx.us
vapeface.club veerotech.com
vegan-foods.us videos-for-your-business.com
via-energy-acquistare.com vip-file.com
videochat.world vitoriacabos.com
vladimir.xrus.org vkontarkte.com
vut.com.ru waycash.net
wallpaperaccess.com
wdfdocando.com wdfdocando.com
webalan.ru wildcattube.com
websites-reviews.com wildworld.site
wjgony.com winwotgold.pl
wma-x.com wleuaprpxuvr.ga
wordpress-crew.net xbaboon.com
www.get-free-traffic-now.com xingzi-vision.com
x-lime.com xmronta.com
x-rates.ru xuki.us
xlolitka.com xvideospornoru.com
xn--80ajbshivpvn2i.xn--p1ai xxxnatelefon.ru
xn--d1aifoe0a9a.top yebocasino.co.za
xxxhdvideo.site yougame.biz
yellowads.men youghbould.wordpress.com
yogamatsexpert.com zeg-distribution.com
zagadki.in.ua zone-kev717.info
zazagames.org zoosexart.com
zreloeporno.tv

10
dev-tools/test_units/ratelimittest-master.txt
View file

@ -581,4 +581,14 @@
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1> <h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p> <p>This is merely used for testing !!!</p>
</body> </body>
</html><!DOCTYPE html>
<html>
<head>
<title>Welcome to NginX</title>
</head>
<body>
<div align=center>
<h1>Welcome to the NginX Ultimate Bad Bot Blocker</h1>
<p>This is merely used for testing !!!</p>
</body>
</html> </html>

2
dev-tools/test_units/whitelist-ips.conf
View file

@ -1,2 +1,2 @@
10.1.0.122 0; 10.1.0.140 0;
127.0.0.1 0; 127.0.0.1 0;

4
dev-tools/tmp/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3075 ### Version: V4.2022.04.3076
### Updated: Fri Apr 29 22:01:30 UTC 2022 ### Updated: Sat Apr 30 10:04:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##

4
robots.txt/robots.txt
View file

@ -6,8 +6,8 @@
### Version Information # ### Version Information #
################################################### ###################################################
### Version: V4.2022.04.3075 ### Version: V4.2022.04.3076
### Updated: Fri Apr 29 22:01:30 UTC 2022 ### Updated: Sat Apr 30 10:04:44 UTC 2022
### Bad Bot Count: 637 ### Bad Bot Count: 637
################################################### ###################################################
### Version Information ## ### Version Information ##