7.3. Ceph 性能基准

流程

1. 创建新存储池：

   [root@osd~ ]# ceph osd pool create testbench 100 100

   Copy to Clipboard Toggle word wrap

2. 对新创建的存储池执行 10 秒的写入测试：

   [root@osd~ ]# rados bench -p testbench 10 write --no-cleanup

   Copy to Clipboard Toggle word wrap

   输出示例

   Maintaining 16 concurrent writes of 4194304 bytes for up to 10 seconds or 0 objects
    Object prefix: benchmark_data_cephn1.home.network_10510
      sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
        0       0         0         0         0         0         -         0
        1      16        16         0         0         0         -         0
        2      16        16         0         0         0         -         0
        3      16        16         0         0         0         -         0
        4      16        17         1  0.998879         1   3.19824   3.19824
        5      16        18         2   1.59849         4   4.56163   3.87993
        6      16        18         2   1.33222         0         -   3.87993
        7      16        19         3   1.71239         2   6.90712     4.889
        8      16        25         9   4.49551        24   7.75362   6.71216
        9      16        25         9   3.99636         0         -   6.71216
       10      16        27        11   4.39632         4   9.65085   7.18999
       11      16        27        11   3.99685         0         -   7.18999
       12      16        27        11   3.66397         0         -   7.18999
       13      16        28        12   3.68975   1.33333   12.8124   7.65853
       14      16        28        12   3.42617         0         -   7.65853
       15      16        28        12   3.19785         0         -   7.65853
       16      11        28        17   4.24726   6.66667   12.5302   9.27548
       17      11        28        17   3.99751         0         -   9.27548
       18      11        28        17   3.77546         0         -   9.27548
       19      11        28        17   3.57683         0         -   9.27548
    Total time run:         19.505620
   Total writes made:      28
   Write size:             4194304
   Bandwidth (MB/sec):     5.742
   
   Stddev Bandwidth:       5.4617
   Max bandwidth (MB/sec): 24
   Min bandwidth (MB/sec): 0
   Average Latency:        10.4064
   Stddev Latency:         3.80038
   Max latency:            19.503
   Min latency:            3.19824

   Copy to Clipboard Toggle word wrap

3. 为存储池执行一次10 秒的连续读测试 ：

   [root@osd~ ]## rados bench -p testbench 10 seq

   Copy to Clipboard Toggle word wrap

   输出示例

   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
     0       0         0         0         0         0         -         0
   Total time run:        0.804869
   Total reads made:      28
   Read size:             4194304
   Bandwidth (MB/sec):    139.153
   
   Average Latency:       0.420841
   Max latency:           0.706133
   Min latency:           0.0816332

   Copy to Clipboard Toggle word wrap

4. 为存储池执行一次 10 秒的随机读取测试 ：

   [root@osd ~]# rados bench -p testbench 10 rand

   Copy to Clipboard Toggle word wrap

   输出示例

   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
     0       0         0         0         0         0         -         0
     1      16        46        30   119.801       120  0.440184  0.388125
     2      16        81        65   129.408       140  0.577359  0.417461
     3      16       120       104   138.175       156  0.597435  0.409318
     4      15       157       142   141.485       152  0.683111  0.419964
     5      16       206       190   151.553       192  0.310578  0.408343
     6      16       253       237   157.608       188 0.0745175  0.387207
     7      16       287       271   154.412       136  0.792774   0.39043
     8      16       325       309   154.044       152  0.314254   0.39876
     9      16       362       346   153.245       148  0.355576  0.406032
    10      16       405       389   155.092       172   0.64734  0.398372
   Total time run:        10.302229
   Total reads made:      405
   Read size:             4194304
   Bandwidth (MB/sec):    157.248
   
   Average Latency:       0.405976
   Max latency:           1.00869
   Min latency:           0.0378431

   Copy to Clipboard Toggle word wrap

5. 要增加并发读取和写入的数量，请使用 -t 选项，默认为 16 个线程。另外，-b 参数可以调整所写入对象的大小。默认对象大小为 4 MB。安全最大对象大小为 16 MB。红帽建议将这些基准测试中的多个副本运行到不同的池。这样做显示与多个客户端的性能更改。

   添加 --run-name <label > 选项来控制在基准测试测试期间写入的对象名称。通过更改每个运行命令实例的 --run-name 标签，可以同时运行多个 rados bench 命令。这可防止当多个客户端试图访问同一对象时可能会出现潜在的 I/O 错误，并允许不同的客户端访问不同的对象。在尝试模拟真实工作负载时，--run-name 选项也很有用。例如：

   [root@osd ~]# rados bench -p testbench 10 write -t 4 --run-name client1

   Copy to Clipboard Toggle word wrap

   输出示例

   Maintaining 4 concurrent writes of 4194304 bytes for up to 10 seconds or 0 objects
    Object prefix: benchmark_data_node1_12631
      sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
        0       0         0         0         0         0         -         0
        1       4         4         0         0         0         -         0
        2       4         6         2   3.99099         4   1.94755   1.93361
        3       4         8         4   5.32498         8     2.978   2.44034
        4       4         8         4   3.99504         0         -   2.44034
        5       4        10         6   4.79504         4   2.92419    2.4629
        6       3        10         7   4.64471         4   3.02498    2.5432
        7       4        12         8   4.55287         4   3.12204   2.61555
        8       4        14        10    4.9821         8   2.55901   2.68396
        9       4        16        12   5.31621         8   2.68769   2.68081
       10       4        17        13   5.18488         4   2.11937   2.63763
       11       4        17        13   4.71431         0         -   2.63763
       12       4        18        14   4.65486         2    2.4836   2.62662
       13       4        18        14   4.29757         0         -   2.62662
   Total time run:         13.123548
   Total writes made:      18
   Write size:             4194304
   Bandwidth (MB/sec):     5.486
   
   Stddev Bandwidth:       3.0991
   Max bandwidth (MB/sec): 8
   Min bandwidth (MB/sec): 0
   Average Latency:        2.91578
   Stddev Latency:         0.956993
   Max latency:            5.72685
   Min latency:            1.91967

   Copy to Clipboard Toggle word wrap

6. 删除 rados bench 命令创建的数据：

   [root@osd ~]# rados -p testbench cleanup

   Copy to Clipboard Toggle word wrap