The Yahoo! Cloud Serving Benchmark (YCSB) is an open-source specification and program suite for evaluating retrieval and maintenance capabilities of computer programs. It is often used to compare the relative performance of NoSQL database management systems.

The original benchmark was developed by workers in the research division of Yahoo! who released it in 2010 with the stated goal of "facilitating performance comparisons of the new generation of cloud data serving systems", particularly for transaction-processing workloads which differed from ones measured by benchmarks designed for more traditional database management systems. [1]

YCSB was contrasted with the TPC-H benchmark from the Transaction Processing Performance Council, with YCSB being called a big data benchmark while TPC-H is a decision support system benchmark.[2]

YCSB was used by DBMS vendors for "benchmark marketing".[3] It has been used in scholarly or tutorial discussions, particularly for Apache HBase.[4][5] It has been used for multiple-product comparisons by industry observers such as Network World (comparing Cassandra, MongoDB, and Riak),[6] Thumbtack Technologies (comparing Aerospike, Cassandra, Couchbase, and MongoDB),[7] and the Polytechnic Institute and University of Coimbra (comparing Cassandra, HBase, Elasticsearch, MongoDB, Oracle NoSQL, OrientDB, Redis, Scalaris, Tarantool, and Voldemort).[8] SanDisk Corporation published results measured on the Oracle NoSQL Database.[9]

Implementations

edit

References

edit
  1. ^ Cooper, Brian F; et al. "Benchmarking cloud serving systems with YCSB" (PDF). Yahoo Research.
  2. ^ Barata, Melyssa; Bernardino, Jorge; Furtado, Pedro; et al. (June 27, 2014). "YCSB and TPC-H: Big Data and Decision Support Benchmarks". 2014 IEEE International Congress on Big Data. IEEE. pp. 800–801. doi:10.1109/BigData.Congress.2014.128. ISBN 978-1-4799-5057-7. S2CID 10756715.
  3. ^ Monash, Curt. "YCSB benchmark notes". Monash Research.
  4. ^ Dey, Akon; Nambiar, Raghunath; Fekete, Alan; Röhm, Uwe. "YCSB+T: Benchmarking web-scale transactional databases" (PDF). IEEE.
  5. ^ Jiang, Lifeng (2012). HBase Administration Cookbook. Packt Publishing.
  6. ^ Bushik, Sergey (2012-10-22). "A vendor-independent comparison of NoSQL databases". Network World.
  7. ^ Abel, Avram. "NoSQL Benchmark Compares Aerospike, Cassandra, Couchbase and MongoDB". InfoQ.
  8. ^ Abramova, Veronika; Bernardino, Jorge; Furtado, Pedro. "Experimental Evaluation of NoSQL Databases" (PDF). International Journal of Database Management Systems.
  9. ^ "Oracle NoSQL Database Cluster YCSB Testing with Fusion ioMemory Storage" (PDF). June 15, 2016. Retrieved September 20, 2016.

📚 Artikel Terkait di Wikipedia

ScyllaDB

on a cluster of 24-core machines by a margin of 10–37x depending on the YCSB workload. ScyllaDB is available on-premises, on major public cloud providers

NoSQL

Performance and scalability comparisons are most commonly done using the YCSB benchmark. Since most NoSQL databases lack ability for joins in queries,

Oracle NoSQL Database

including Intel and Cisco, performing Yahoo! Cloud Serving Benchmarks (YCSB) on various hardware configurations, and published its results. For example

List of NoSQL software and tools

NoSQL backends HammerDB — supports benchmarking of some NoSQL databases YCSB — Yahoo! Cloud Serving Benchmark for NoSQL databases SymmetricDS — supports

Apache Accumulo

(including Cassandra and Voldemort that order by hash of the user key). 2011 YCSB++: Benchmarking and Performance Debugging Advanced Features in Scalable Table

PerfKitBenchmarker

Simulation Web benchmarks Workloads Aerospike YCSB Cassandra YCSB Hadoop Terasort HBase YCSB MongoDB YCSB Redis YCSB HPCC Scimark2 OLDIsim etcd EPFL CS Web Search