V4.2021.10.2660 [ci skip]

dev-tools/test_units/random-bots-for-test.list

@@ -1,250 +1,250 @@
-ASPSeek
-Aboundexbot
+360Spider
+404checker
+404enemy
+AIBOT
+AfD-Verbotsverfahren
 AhrefsBot
+AiHitBot
 Aipbot
 AllSubmitter
-AlphaBot
-Anarchie
+Alligator
 Anarchy
 Ankit
-Asterias
-Attach
+Apexoo
 AwarioRssBot
-BDCbot
-BackStreet
-Backlink-Ceck
-Badass
-Bigfoot
-Bitacle
-Black Hole
-BlackWidow
-Boardreader
-BotALot
+AwarioSmartBot
+BDFetch
+BLEXBot
+Barkrowler
+BatchFTP
+Bolt
 Brandprotect
 Brandwatch
 Buddy
-BuiltWith
-Bullseye
-BuzzSumo
-CATExplorador
-CCBot
-CSHttp
+BuiltBotTough
+BunnySlippers
 CazoodleBot
-CheTeam
+Cegbfeieh
+CheeseBot
 CherryPicker
-ChinaClaw
 Claritybot
 Cliqzbot
-Cloud mapping
-Cogentbot
 Collector
+CopyRightCheck
 Copyscape
+Cosmos
 Craftbot
-Crawling at Home Project
 CrazyWebCrawler
+CrunchBot
 Custo
-CyotekWebCopy
-DIIbot
 DTS Agent
 DataCha0s
-DatabaseDriverMysqli
-Deusu
-Digincore
-Dirbuster
-Discoverybot
+Devil
+DigitalPebble
 Dispatch
 DnyzBot
-DomainAppender
 DomainCrawler
-DomainStatsBot
-Domains Project
-Download Wonder
-EasyDL
+ECCP/1.0
+EMail Siphon
 Ebingbong
+EirGrabber
+EroCrawler
 Evil
+Exabot
 ExtLinksBot
-FDM
-FlashGet
+ExtractorPro
+Extreme Picture Finder
+EyeNetIE
+FHscan
+Fimap
+Flunky
+Foobot
 Freeuploader
+FrontPage
 Fuzz
-FyberSpider
 Fyrebot
 GT::WWW
 GermCrawler
-GetRight
-Getintent
 Gigabot
 Go!Zilla
-GrabNet
-GrapeshotCrawler
-GridBot
-HEADMasterSEO
-HTTP::Lite
-HTTrack
+Gotit
 Haansoft
-HaosouSpider
-Heritrix
-Hloader
-Humanlinks
-HybridBot
+Harvest
+Id-search
+Image Sucker
 IndeedBot
+Indy Library
+InfoNaviRobot
+InfoTekies
 Internet Ninja
-Iskanie
-JamesBOT
-Joomla
-Kenjin Spider
+InternetSeer
+IstellaBot
+JOC Web Spider
+Jbrofuzz
+Jorgee
+JustView
 Keyword Density
 Kozmosbot
 Leap
-LeechFTP
+LexiBot
 LibWeb
-LieBaoFast
-Linkbot
+Likse
+LinksManager
 LinqiaRSSBot
+LinqiaScrapeBot
 Lipperhey
-Ltx71
-MIDown tool
-MIIxpc
 MQQBrowser
 MSIECrawler
+MTRobot
 Mag-Net
-Mail.RU_Bot
-Majestic SEO
+Magnet
+Masscan
 MauiBot
-Mb2345Browser
-Metauri
-MicroMessenger
-Mister PiX
-Moblie Safari
+Mediatoolkitbot
+Microsoft URL Control
+Mojeek
 Mojolicious
 Mr.4x3
+Msrabot
 Musobot
+NICErsPRO
 Name Intelligence
-Navroad
 NearSite
-Net Vampire
-NetLyzer
+Needle
+Nessus
+NetAnts
+NetMechanic
+NetSpider
+Nettrack
 Netvibes
-Ninja
+Nibbler
+Niki-bot
+Nimbostratus
+Nmap
 Nuclei
-Offline Explorer
-OrangeSpider
-OutfoxBot
+Nutch
+Offline Navigator
+OpenLinkProfiler
+OutclicksBot
 PHPCrawl
-POE-Component-Client-HTTP
-PageAnalyzer
-PageGrabber
-Panscient
 Papa Foto
-Pavuk
-Pi-Monster
+Petalbot
 Picscout
-Pixray
-ProWebWalker
+Pimonster
+ProPowerBot
 Probethenet
 Pump
-PxBroker
-QueryN Metasearch
-RankActiveLinkBot
-RankFlex
-Rankivabot
+PyCurl
+Quick-Crawler
+RankingBot
 Re-re
-ReGet
-RepoMonkey
-RocketCrawler
-Rogerbot
-SEOkicks
+RealDownload
+Reaper
+RedesScrapy
 SEOlyticsCrawler
-SalesIntelligent
+SEOprofiler
+SISTRIX
+ScanAlert
+Scanbot
 Scrapy
 ScreenerBot
 Searchestate
-SearchmetricsBot
 SemrushBot
-SiteCheckerBotCrawler
-SiteSucker
-Sitebeam
-Snake
-Snapbot
-SpaceBison
-Spammen
+SeoSiteCheckup
+SeobilityBot
+Siphon
+Site Sucker
+SiteLockSpider
+Snoopy
+Sociscraper
+Sottopop
+SpankBot
+Spanner
 SputnikBot
-Sqlworm
+Sqlmap
+Sqworm
 Stripper
 Sucuri
-SurveyBot
-Swiftbot
+SuperBot
+SuperHTTP
+Szukacz
+T0PHackTeam
 T8Abot
-Teleport
 TeleportPro
+The Intraformant
+Thumbor
 TightTwatBot
-True_Robot
+Tracemyfile
+Trendiction
+Trendictionbot
 Turingos
-VB Project
-VelenPublicWebCrawler
+Turnitin
+TurnitinBot
+Typhoeus
+UnisterBot
+V-BOT
+VCI
 VidibleScraper
 VoidEYE
-WASALive-Bot
-WBSearchBot
-WWW-Collector-E
+WISENutbot
+WPScan
 WWW-Mechanize
-WWWOFFLE
 Wallpapers
 Web Auto
+Web Collage
 Web Enhancer
-Web Sauger
+Web Fetch
+Web Fuck
+Web Pix
 WebAuto
-WebCollage
-WebFetch
-WebFuck
-WebGo IS
-WebReaper
-WebSauger
-WebStripper
-WebZIP
+WebBandit
+WebCopier
+WebEnhancer
+WebLeacher
+WebPix
+WebWhacker
 Webalta
-Whack
-Whacker
-Whatweb
+WebmasterWorldForumBot
+Website Quester
+Who.is Bot
+Widow
+WinHTTrack
+Wonderbot
 Woobot
 Wprecon
-Xaldon WebSpider
-Xenu
-Zauba
-Zermelo
+Xaldon_WebSpider
+Zade
 Zeus
+Zitebot
+ZmEu
 ZoomBot
 ZoominfoBot
-ZyBorg
 archive.org_bot
-arquivo.pt
-backlink-check
+arquivo-web-crawler
+autoemailspider
 cah.io.community
-check1.exe
-clark-crawler
-com.plumanalytics
-crawl.sogou.com
-demandbase-bot
+coccocbot-web
+cognitiveseo
+crawler.feedback
+dataforseo.com
 domainsproject.org
-eCatch
+evc-batch
+gopher
+instabid
 internetVista monitor
-ips-agent
-isitwp.com
-lwp-request
-netEstate NE Crawler
-oBot
-page scorer
-pcBrowser
-probe-image-size
+magpie-crawler
+mediawords
+polaris version
+ripz
 satoristudio.net
-scan.lol
-seostar
-serpstatbot
+seobility
+seoscanners
 sitechecker.pro
 siteripz
 sogouspider
-spyfu
+sp_auditbot
 sysscan
-webpros.com
-xpymep1.exe
-zgrab
+tAkeOut
+trendiction.com
+webmeup-crawler
+x09Mozilla