文献类型：期刊文献

中文题名：Using Confidence Interval to Summarize the EvaluatingResults of DSM Systems

英文题名：Using confidence interval to summarize the evaluating results of DSM systems

作者：Shi, Weisong[1]; Tang, Zhimin[1]; Shi, Jinsong[2]

机构：[1]Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China;[2]E China Univ Sci & Technol, Dept Appl Math, Shanghai 200237, Peoples R China

年份：2000

卷号：15

期号：1

起止页码：73

中文期刊名：Journal of Computer Science & Technology

外文期刊名：JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY

收录：CSTPCD;;EI(收录号：2000265171014);Scopus;WOS:【SCI-EXPANDED(收录号:WOS:000089936500008)】；CSCD:【CSCD2011_2012】；PubMed;

语种：英文

中文关键词：data-summarizing technique;performance evaluation;DSM system;confidence interval;benchmarking

外文关键词：data-summarizing technique; performance evaluation; DSM system; confidence interval; benchmarking

摘要：Distributed Shared Memory (DSM) systems have gained popularacceptance by combining the scalability and low cost of distributed system with theease of use of single address space. Many new hardware DSM and software DSMsystems have been proposed in recent years. In general, benchmarking is widely usedto demonstrate the performance advantages of new systems. However, the commonmethod used to summarize the measured results is the arithmetic mean of ratios,which is incorrect in some cases. Furthermore, many published papers list a lot ofdata only, and do not summarize them effectively, which confuse users greatly. Infact, many users want to get a single number as conclusion, which is not providedin old summarizing techniques. Therefore, a new data-summarizing technique basedon confidence interval is proposed in this paper. The new technique includes twodata-summarizing methods: (1) paired confidence interval method; (2) unpairedconfidence interval method. With this new technique, it is concluded that at someconfidence one system is better than others. Four examples are shown to demonstratethe advantages of this new technique. Furthermore, with the help of confidence level,it is proposed to standardize the benchmarks used for evaluating DSM systems sothat a convincing result can be got. In addition, the new summarizing technique fitsnot only for evaluating DSM systems, but also for evaluating other systems, such asmemory system and communication systems.
Distributed Shared Memory (DSM) systems have gained popular acceptance by combining the scalability and low cost of distributed system with the ease of use of single address space. Many new hardware DSM and software DSM systems have been proposed in recent years. In general, benchmarking is widely used to demonstrate the performance advantages of new systems. However, the common method used to summarize the measured results is the arithmetic mean of ratios, which is incorrect in some cases. Furthermore, many published papers list a lot of data only, and do not summarize them effectively, which confuse users greatly. In fact, many users want to get a single number as conclusion, which is not provided in old summarizing techniques. Therefore, a new data-summarizing technique based on confidence interval is proposed in this paper. The new technique includes two data-summarizing methods: (1) paired confidence interval method; (2) unpaired confidence interval method. With this new technique, it is concluded that at some confidence one system is better than others. Four examples are shown to demonstrate the advantages of this new technique. Furthermore, with the help of confidence level, it is proposed to standardize the benchmarks used for evaluating DSM systems so that a convincing result can be got. In addition, the new summarizing technique fits not only for evaluating DSM systems, but also for evaluating other systems, such as memory system and communication systems.