Fast in-memory transaction processing using RDMA and HTM

Published: 14 December 2015
on channel: Association for Computing Machinery (ACM)
1,701
14

Authors: Xingda Wei, Jiaxin Shi, Yanzhe Chen, Rong Chen, Haibo Chen

Abstract:

We present DrTM, a fast in-memory transaction processing system that exploits advanced hardware features (i.e., RDMA and HTM) to improve latency and throughput by over one order of magnitude compared to state-of-the-art distributed transaction systems. The high performance of DrTM are enabled by mostly offloading concurrency control within a local machine into HTM and leveraging the strong consistency between RDMA and HTM to ensure serializability among concurrent transactions across machines. We further build an efficient hash table for DrTM by leveraging HTM and RDMA to simplify the design and notably improve the performance. We describe how DrTM supports common database features like read-only transactions and logging for durability. Evaluation using typical OLTP workloads including TPC-C and SmallBank show that DrTM scales well on a 6-node cluster and achieves over 5.52 and 138 million transactions per second for TPC-C and SmallBank Respectively. This number outperforms a state-of-the-art distributed transaction system (namely Calvin) by at least 17.9X for TPC-C.

ACM DL: http://dl.acm.org/citation.cfm?id=281...
DOI: http://dx.doi.org/10.1145/2815400.281...


Watch video Fast in-memory transaction processing using RDMA and HTM online, duration hours minute second in high quality that is uploaded to the channel Association for Computing Machinery (ACM) 14 December 2015. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 1,701 times and liked it 14 visitors.