Big data storage

Splunk

High-performance, low-cost, scalable storage for SmartStore single-site and multi-site deployments

Splunk and Scality have partnered to deliver a scalable unified platform for operational intelligence. Index larger data sets and retain them longer at a fraction of the cost, while reducing complexity and increasing flexibility.

How Splunk + Scality lowers cost while increasing operational functionality and agility

With Splunk SmartStore, storage is decoupled from compute, allowing resources to be scaled independently and, therefore, more efficiently. The resulting TCO reduction is further compounded by higher utilization. SmartStore also reduces storage costs by offloading older, less frequently used data (warm buckets) to Scality RING, without impacting search performance.

Scality RING holds the master copy of warm buckets while indexers’ local storage is used for hot and cache copies of warm buckets. With most data residing on Scality RING, the indexer maintains a local cache that contains a minimal amount of data: hot buckets, and copies of warm buckets participating in active or recent searches, and bucket metadata. This renders indexers stateless for warm and cold data, boosting operational flexibility and agility.

Scality RING is Splunk SmartStore ready for simplified single and multi-site deployments

Software-defined Scality RING has supported the Amazon S3 API since 2010 and is an ideal storage tier for Splunk SmartStore. Scality offers Splunk customers petabyte-scale storage and multiple data protection schemes for greater choice and flexibility in their SmartStore deployments.

No other vendor can accommodate all three SmartStore deployment models

Uniquely validated as a SmartStore ready storage solution for Splunk deployments in all three architectures, Scality RING provides efficient and scalable business continuance and high availability solutions for Splunk big data analytic applications.

Single-site architecture with erasure coding protects against the loss of disks and even entire servers.

Multi-site active-active architecture with erasure coding as well as asynchronous replication between two sites protects against the loss of disks, servers, and even an entire site. Active-active is best suited for multi-site Splunk deployments where inter-site latency goes up to 100ms

Multi-site stretched architecture with erasure coding as well as synchronous replication across three sites protects against the loss of disks, servers, and even an entire site. With a stretched architecture, Splunk customers’ experience is akin to what they would have on AWS within an Availability Zone. A stretched architecture is best suited for multi-site deployments where returning consistent and complete results is mandatory, even during a data center failure event.

Read more here about Scality RING for Splunk SmartStore single and multi-site deployments, plus how Scality partnered with HPE to test and validate the two Splunk multi-site architectures.

Benefits

CLOUDSERVER

In 2013, our interest and research in object storage resulted in the CloudServer project.———— 2013年には、オブジェクトストレージへの関心と研究から、CloudServerプロジェクトが生まれました。CloudServerは、オンプレミスでのS3ベースのアプリケーション開発やデプロイメントの選択を可能にする、オープンソースのオブジェクトストレージプロジェクトです。当時のCloudServerは、Docker上に展開された最初のAmazon-S3互換のオブジェクトストレージAPIサーバーの1つでした。オープンソースコミュニティからはポジティブな反応を得ており、Scalityは今でもそれらのコードの一部を製品に利用しています。 CloudServer is an open source object storage project to enable on-premises S3-based application development and data deployment choice. CloudServer was one of the first Amazon S3-compatible object storage API servers deployed on Docker. The open source community welcomed the project, and we still utilize some of their early contributions. Used by the community both alone and as a component in Scality products, CloudServer is one of our most successful open source projects. Learn more about CloudServer on GitHub.

ZENKO

With Zenko (now also a modular configuration to complement RING), we took our commitment to open source to the next level. In 2017, our dedicated engineers built and released an open software code-base for managing data across all three public cloud providers (AWS, GoogleCloud, and Azure). Zenko is cloud-agnostic, providing a unified namespace, access API and search capabilities for data stored locally or in public cloud storage services. Zenko open source software offers control over data — liberating users from cloud vendor lock-in. Learn more about Zenko on GitHub or on Zenko.io

METALK8S

Zenko was originally designed to be deployed on any Kubernetes cluster. To bring Zenko on-premises, we started the MetalK8s project. For production deployments, we needed things like monitoring capabilities, log management, user authentication and other security concerns, load balancing and many other key services that are not part of Kubernetes’ core.
We, therefore, decided to create MetalK8s as an open-source project, an opinionated Kubernetes distribution with a focus on long-term on-prem deployments. Our latest release with MetalK8s was built to deploy Zenko on bare metal (on any server or available VM). Although it’s fine-tuned for Zenko deployments, MetalK8s can be used for any application built to run on Kubernetes. Learn more about MetalK8s on GitHub.

BERT-E

To improve our own product releases with quality, speed and innovative features, we created a release process model coined: GitWaterFlow. It proved so useful that, in 2016, we created our own “release automation software” called Bert-e and opened the code base for everyone to enjoy. Learn more about GitWaterFlow and Bert-e on GitHub.

QUADIRON

Our team was doing research in the field of data governance and security. The outcome of this research is QuadIron — an open source C++11 fast erasure coding library for large numbers of data and parities. It was presented at the Storage Developer Conference in 2018 (watch the recording here). Get the QuadIron white paper, or learn more about QuadIron on Github.

evaluator group report

The solution

Learn how Scality RING + Splunk helps you index larger data sets and retain them longer — at a fraction of the cost — while reducing complexity and increasing flexibility.

WHITE PAPER

Splunk White Paper

SOLUTION SHEET

Splunk Solution Paper

WHITE PAPER

Enterprise storage with Splunk

WHITE PAPER

Scality RING for Splunk with HPE Primera

SOLUTION SHEET

HPE storage solutions for Splunk

WHITE PAPER

Kubernetes PAAS for Splunk

evaluator group report
EVALUATOR GROUP TECHNICAL INSIGHT

Optimize for big data analytics

This latest technical report by Evaluator Group demonstrates why Scality RING and Splunk SmartStore are the perfect fit to optimize your big data deployment. Take data back from the cloud and gain advantages.

Privacy Policy Cookie Policy