nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-28 10:07:41 +00:00

100 lines
1.1 KiB
Text

Aspiegel
AwarioRssBot
BDFetch
BackWeb
Badass
BotALot
BuiltBotTough
CSHttp
CazoodleBot
Cegbfeieh
Chlooe
Crawling at Home Project
DIIbot
DTS Agent
DatabaseDriverMysqli
DomainCrawler
EirGrabber
Exabot
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Flunky
FyberSpider
Genieo
Go-Ahead-Got-It
Gotit
GrapeshotCrawler
Hloader
IDBTE4M
Information Security Team InfraSec Scanner
InfraSec Scanner
InterGET
Lanshanbot
Likse
LinqiaMetadataDownloaderBot
Lmspider
Ltx71
MarkWatch
Mata Hari
Mediatoolkitbot
Musobot
Name Intelligence
NextGenSearchBot
Nutch
Offline Navigator
PageScorer
Papa Foto
RankFlex
ReGet
Rogerbot
ScanAlert
Scanbot
Scrapy
Screaming
SeoSiteCheckup
SeobilityBot
Seomoz
SiteCheckerBotCrawler
SiteSnagger
SlySearch
Snoopy
Sogou web spider
SpankBot
SputnikBot
Sqworm
Suzuran
TightTwatBot
Tracemyfile
True_Robot
Turingos
TwengaBot
Twice
Vacuum
VeriCiteCrawler
VidibleScraper
WBSearchBot
WPScan
WebFetch
WebLeacher
WebsiteQuester
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
arquivo-web-crawler
awario.com
check1.exe
meanpathbot
oBot
polaris version
probe-image-size
ripz
s1z.ru
serpstatbot
sogouspider
webgains-bot
webpros.com
x09Mozilla