Red Hat SummitChapter 2. Object storage
The Ceph Object Gateway client is a leading storage backend for cloud platforms that provides a RESTful S3-compliant and Swift-compliant object storage for objects like audio, bitmap, video, and other data. Ceph Object Gateway, also known as RADOS Gateway (RGW), is an object storage interface built on top of the librados library to provide applications with a RESTful gateway to Ceph storage clusters.
Common use cases
The following are some of the most common uses cases for CephFS.
- Storage as a Service (SaaS)
- Provides scalability and performance for both small and large object stores.
- AI, Analytics and Big Data including Data Lake and Data Lake House
- Cloud native data lake, with massive scalability and high availability to support demanding workloads.
- Backup and archive or large amounts of unstructured data
- A unique new way to architect the dataflow in applications which is through event driven architectures.
- Data intensive workloads like Cloud Native (S3) object data
- Back up and recover into and from an object storage helps improve recovery time objectives (RTO) and recovery point objectives (RPO).
- Internet of Things (IoT)
- Object gateways serve as intermediatries in IoT systems, aggregating data from various devices, translating communication protocols, and enabling edge processing. They enhance security, facilitate device management, and ensure interoperability, streaming the overall IoT ecosystem.
2.1. Object storage common workloads
Understand the most common workloads for object storage.
- Data efficiency
- Use for erasure coding, thin provisioning, lifecycle management, and compression.
- Data security
- Use for object lock, key management, at rest and inflight encryption, and WORM.
- Data resilience
- Use for backup, snapshots, cloning, and business continuity.
2.2. Object storage interfaces
Learn about the three object storage interfaces.
- Administrative API
- Provides an administrative interface for managing the Ceph Object Gateways. For more information, see Ceph Object Gateway administrative API
- S3
- Provides object storage functionality with an interface that is compatible with a large subset of the Amazon S3 RESTful API. For more information, see Ceph Object Gateway and the S3 API.
- Swift
- Provides object storage functionality with an interface that is compatible with a large subset of the OpenStack Swift API. The Ceph Object Gateway is a service interacting with a Ceph storage cluster. For more information, see Ceph Object Gateway and the Swift API.
2.3. Getting started with object storage
This section lists the relevant tasks required for working with object storage.
Before you begin
See Compatibility Matrix for Red Hat Ceph Storage 7.0 for a list of backup vendors that are certified with Red Hat Ceph Storage as an S3 target.
Prerequisites
There are specific network and hardware requirements to work with Ceph object storage. For more information, see Red Hat Ceph Storage considerations and recommendations.
Setting up S3 server-side security
For detailed information, see Server-Side Encryption (SSE).
Creating S3 users and testing S3 access
For detailed information on creating S3 users, see Create an S3 user. For detailed information on testing S3 access, see Test S3 access.
Managing Object Gateway through the dashboard
For detailed information, see Management of Ceph Object Gateway using the dashboard.
Multi-site replication to enable Disaster Recovery of backup
For detailed information, see Failover and disaster recovery.
Deploying Ceph Object Gateway with Ceph Orchestrator
Ceph Object Gateway is deployed by either using the Ceph Orchestrator with the command line interface or by using the service specification. You can also configure multi-site Ceph Object Gateways, and remove the Ceph Object Gateway using the Ceph Orchestrator. The cephadm command deploys the Ceph Object Gateway as a collection of daemons that manages a single-cluster deployment or a particular realm and zone in a multi-site deployment.
For full Ceph Object Gateway deployment information and instructions, see Deployment.
Alternatively, you can deploy Ceph Object Gateway using the command-line interface. For more information, see Deploying the Ceph Object Gateway using the command line interface.
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}