V4.2023.12.4184 [ci skip]

dev-tools/test_units/random-bots-for-whitelist-test.list

@@ -1,100 +1,100 @@
-01h4x.com
-Anthill
-Asterias
-AwarioRssBot
-BackWeb
-Backlink-Ceck
-Bitacle
-Blackboard
-Blow
+80legs
+Abonti
+Aipbot
+Alligator
+Ankit
+Apexoo
+Atomseobot
+Badass
+BotALot
+Buddy
+BuiltWith
 BunnySlippers
+CODE87
 CSHttp
-Cegbfeieh
-Chlooe
-Cliqzbot
+CensysInspect
+Claritybot
+Cloud mapping
 Copyscape
 Crawling at Home Project
-Curious
-Demon
-Discobot
-DnBCrawler-Analytics
-DomainSigmaCrawler
-DomainStatsBot
-Domains Project
-Download Wonder
-Drip
-Ebingbong
+Crescent
+Deusu
+DigitalPebble
+EMail Wolf
+Ecxi
 EirGrabber
-Evil
-ExtLinksBot
-Extractor
-EyeNetIE
-Foobot
-GalaxyBot
-Getintent
-GoZilla
+Extreme Picture Finder
+FyberSpider
+Fyrebot
+G-i-g-a-b-o-t
+Gigabot
 GrabNet
-Harvest
-Humanlinks
-Intelliseek
-InternetSeer
+GridBot
+HMView
+HTTP::Lite
+Haansoft
+Indy Library
+JamesBOT
 JennyBot
-LeechFTP
-LeechGet
+Joomla
+LexiBot
 Lightspeedsystems
-LinksManager
-MeanPath Bot
-Metauri
-Microsoft Data Access
-Mojeek
-Morfeus Fucking Scanner
+Lipperhey
+Mass Downloader
+Mb2345Browser
+Mister PiX
+Mr.4x3
+Msrabot
+NPbot
 Nameprotect
-Navroad
-NearSite
-NetLyzer
-NetSpider
-Niki-bot
-Nuclei
-OpenVAS
-Page Analyzer
-PageGrabber
-Pavuk
-Petalbot
-ProWebWalker
+Nessus
+NetMechanic
+Nettrack
+Offline Explorer
+Papa Foto
+PleaseCrawl
+ProPowerBot
 Pu_iN
-RocketCrawler
-Scanbot
-SenutoBot
-SeoSiteCheckup
-Snoopy
+RankingBot
+RankingBot2
+Rogerbot
+ScanAlert
+SeekportBot
+SeobilityBot
+Shodan
+Siteimprove
+Sitevigil
+SocialRankIOBot
+SpankBot
 Spbot
-Sqworm
-Suzuran
-Telesoft
-Telesphoreo
-Turnitin
-TurnitinBot
-Virusdie
-Voil
-WBSearchBot
-WWWOFFLE
-Wallpapers
-WebLeacher
-Webshag
-Whack
-Who.is Bot
-Wonderbot
-Woobot
-Xenu
-Zitebot
-archive.org_bot
+Toata
+TwengaBot
+VB Project
+Vacuum
+Vagabondo
+VoidEYE
+Web Collage
+Web Enhancer
+Web Sucker
+WebmasterWorldForumBot
+ZmEu
+ZumBot
+adscanner
 autoemailspider
-domainsproject.org
-evc-batch
-linkdexbot
+cah.io.community
+coccocbot
+com.plumanalytics
+crawl.sogou.com
+crawler4j
+dataforseo.com
+dataforseobot
+facebookscraper
+iubenda-radar
 lwp-trivial
-ripz
-s1z.ru
-serpstatbot
-trendiction.de
-x22Mozilla
+meanpathbot
+muhstik-scan
+netEstate NE Crawler
+scalaj-http
+seocompany.store
+seoscanners
+sitechecker.pro