V4.2022.03.2988 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
 01h4x.com
+360Spider
+404checker
 404enemy
 ADmantX
-ASPSeek
-Abonti
-Acunetix
-AfD-Verbotsverfahren
+Aboundex
+Aboundexbot
+AiHitBot
 AllSubmitter
+AlphaBot
 Anarchie
 Anarchy
-Attach
-BDCbot
-BLEXBot
-BackStreet
+Apexoo
+Aspiegel
+AwarioSmartBot
+BDFetch
+Backlink-Ceck
 BacklinkCrawler
 Badass
 Barkrowler
-Bitacle
-BlackWidow
-Blackboard
+Black Hole
 BlowFish
-Bolt
-Buddy
-BuiltBotTough
-Bullseye
-CODE87
-Cegbfeieh
+Boardreader
+Buck
+BunnySlippers
+BuzzSumo
+CCBot
+CSHttp
+Calculon
 CensysInspect
-CheTeam
-CheeseBot
+CherryPicker
 ChinaClaw
-Chlooe
+Citoid
 Claritybot
-Cliqzbot
+Cocolyzebot
 Collector
-Copier
 CopyRightCheck
-Craftbot
+Copyscape
+CrazyWebCrawler
+CrunchBot
 Custo
-CyotekWebCopy
-DSearch
-DatabaseDriverMysqli
+DIIbot
 Demon
 Deusu
+Devil
 Digincore
-DigitalPebble
-Disco
-Discoverybot
-DnBCrawler-Analytics
+Discobot
+DomainCrawler
 DomainStatsBot
-Domains Project
 Dragonfly
-Drip
 EMail Wolf
-Ebingbong
+EasyDL
 Ecxi
-EirGrabber
 Evil
-Exabot
-Extreme Picture Finder
-Ezooms
+Extractor
 FemtosearchBot
-Fimap
+Firefox/7.0
+FlashGet
+Flunky
 Foobot
-FyberSpider
-Fyrebot
+FrontPage
+Fuzz
 G-i-g-a-b-o-t
 GT::WWW
-Genieo
 GermCrawler
-Gigabot
-Gotit
+Go!Zilla
+Go-Ahead-Got-It
 Grafula
 GrapeshotCrawler
 GridBot
+HTMLparser
 HTTP::Lite
 HTTrack
-Heritrix
-HonoluluBot
-HybridBot
-IRLbot
-Image Fetch
-IndeedBot
-InterGET
-Iria
+Hloader
+Iblog
+Indy Library
+InfoNaviRobot
+Intelliseek
+Internet Ninja
 Iskanie
-IstellaBot
-JamesBOT
 JetCar
-Jyxobot
-Kenjin Spider
-Kinza
-Lanshanbot
-Larbin
-LexiBot
-Libwhisker
+Joomla
+Jorgee
+LNSpiderguy
+LeechGet
 Likse
-LinkScan
-Linkbot
-Linkdexbot
-LinkextractorPro
 LinqiaRSSBot
-Lipperhey Spider
+LinqiaScrapeBot
+Lipperhey
 Litemage_walker
+Lmspider
 Ltx71
-MFC_Tear_Sample
 MIDown tool
-MSIECrawler
+MJ12bot
+MQQBrowser
+MSFrontPage
 Mag-Net
-Magnet
-Mail.RU_Bot
 Majestic SEO
 Majestic-SEO
+MarkMonitor
 Mass Downloader
+MauiBot
 MeanPath Bot
-Meanpathbot
-Mediatoolkitbot
-Metauri
-Microsoft URL Control
-Minefield
-Mister PiX
+MegaIndex.ru
+Microsoft Data Access
 Mojeek
-MolokaiBot
-Mr.4x3
+Mozlila
+Msrabot
+Name Intelligence
 Nameprotect
-NearSite
-Nessus
-NetSpider
-Netcraft
+Navroad
+Net Vampire
+NetLyzer
+NetMechanic
 Nettrack
-Nikto
+Netvibes
+Nibbler
+NimbleCrawler
+Nimbostratus
+Ninja
 Nmap
 Not
+Nutch
 Offline Navigator
 OpenVAS
 Openfind
-Openvas
-OutclicksBot
-OutfoxBot
-PHPCrawl
-Page Analyzer
-PageGrabber
-PageThing.com
+OrangeSpider
+PECL::HTTP
+POE-Component-Client-HTTP
+PageAnalyzer
 Panscient
-PeoplePal
-Petalbot
-Pi-Monster
+Picscout
+PictureFinder
 Pimonster
-Pu_iN
-Pump
-PyCurl
+ProPowerBot
+ProWebWalker
+PxBroker
 QueryN Metasearch
-Quick-Crawler
 RSSingBot
 RankActive
-RankingBot
-Rankivabot
-Re-re
-Reaper
+RankFlex
+RankingBot2
+RankurBot
+RealDownload
 Recorder
 RedesScrapy
-SBIder
+RepoMonkey
+Ripper
 SEOkicks
-SISTRIX
-SalesIntelligent
-ScanAlert
-Scrapy
-Seekport
+Scanbot
+ScoutJet
+Screaming
+ScreenerBot
+SemanticJuice
+Semrush
+SemrushBot
 SentiBot
 SeoSiteCheckup
-Seomoz
-Shodan
+SiteCheckerBotCrawler
+SiteExplorer
+SiteSucker
 Sitebeam
+Siteimprove
 Sitevigil
 SlySearch
-SmartDownload
 Snapbot
-Snoopy
-Sociscraper
-Sosospider
+SpaceBison
+SpankBot
 Spbot
 SputnikBot
-Swiftbot
+Sqlmap
+SurveyBot
+Szukacz
+T0PHackTeam
 T8Abot
-TeleportPro
-Telesoft
-Telesphoreo
 Telesphorep
 The Intraformant
-TightTwatBot
-Titan
 Toweyabot
+Tracemyfile
 Trendiction
-True_Robot
-Turingos
+Turnitin
 Twice
-URLy Warning
+URLy.Warning
+UnisterBot
 VB Project
 Vagabondo
 VelenPublicWebCrawler
-VidibleScraper
-Voil
+WASALive-Bot
 WBSearchBot
 WEBDAV
 WISENutbot
-WPScan
-WWW-Collector-E
-WWW::Mechanize
-WWWOFFLE
+WWW-Mechanize
 Wallpapers/3.0
+WallpapersHD
 Web Fuck
-WebAuto
-WebBandit
+Web Pix
+WebCollage
 WebEnhancer
 WebFetch
+WebGo IS
 WebImageCollector
 WebLeacher
-WebPix
 WebSucker
-Webshag
+WebWhacker
+WebZIP
+WebmasterWorldForumBot
+Webster
+Whack
 Whacker
-WinHTTrack
+Whatweb
 Wonderbot
 Woobot
+Wotbox
 Wprecon
-Xaldon WebSpider
-Xenu
+Xaldon_WebSpider
 YoudaoBot
-Zauba
-Zitebot
+Zade
 ZmEu
-archive.org_bot
-crawler4j
-domainsproject.org
-heritrix
+ZoomBot
+ZumBot
+ZyBorg
+arquivo.pt
+cah.io.community
+clark-crawler
+coccocbot
+cognitiveseo
+com.plumanalytics
+demandbase-bot
+eCatch
 instabid
-lwp-request
+internetVista monitor
+iubenda-radar
+magpie-crawler
 meanpathbot
-mediawords
-plumanalytics
-polaris version
-satoristudio.net
+page scorer
+pcBrowser
+ripz
+s1z.ru
 scalaj-http
 scan.lol
+seocompany.store
 sitechecker.pro
+siteripz
 sp_auditbot
-sysscan
-tAkeOut
-trendiction.com
+webgains-bot
+webmeup-crawler
+x09Mozilla
+x22Mozilla
 zauba.io
+zgrab