2022 BenchCouncil International Symposium on benchmarking, measuring and optimizing (Bench 2022) call for papers
July 2022
Sponsored and organized by the International Open Benchmark Council (BenchCouncil), the Bench conference encompasses a wide range of topics in benchmarking, measurement, evaluation methods, and tools....
Share article
SAIBench: Benchmarking AI for Science
April 2022
Scientific research communities are embracing AI-based solutions to target tractable scientific tasks and improve research work flows. However, the development and evaluation of such solutions are scattered...
Share article
An efficient encrypted deduplication scheme with security-enhanced proof of ownership in edge computing
April 2022
With the rapid expansion of Internet of Things (IoT), relevant files are stored and transmitted at the network edge by employing data deduplication to eliminate redundant data for the best accessibility....
Share article
Asynchronous memory access unit for general purpose processors
April 2022
In future data centers, applications will make heavy use of far memory (including disaggregated memory pools and NVM). The access latency of far memory is more widely distributed than that of local...
Share article
A BenchCouncil view on benchmarking emerging and future computing
April 2022
The measurable properties of the artifacts or objects in the computer, management, or finance disciplines are extrinsic, not inherent — dependent on their problem definitions and solution instantiations....
Share article
Performance and energy consumption tradeoff in server consolidation
April 2022
Server consolidation is one of the techniques used to increase energy efficiency in datacentres. Nevertheless, the server consolidation has an inherent trade-off between performance degradation and...
Share article
Are current benchmarks adequate to evaluate distributed transactional databases?
March 2022
With the rapid development of distributed transactional databases in recent years, there is an urgent need for fair performance evaluation and comparison. Though there are various open-source benchmarks...
Share article
Three laws of technology rise or fall
March 2022
Newton’s laws of motion perfectly explain or approximate physical phenomena in our everyday life. Are there any laws that explain or approximate technology’s rise or fall? After reviewing thirteen information...
Share article
Combating disinformation on social media: A computational perspective
March 2022
The use of social media has accelerated information sharing and instantaneous communications. The low barrier to enter social media enables more users to participate and makes them stay engaged longer,...
Share article
Challenges and recent advances in the design of real-time wireless Cyber-Physical Systems
March 2022
Cyber-Physical Systems (CPS) refer to systems where some intelligence is embedded into devices that interact with their environment. Using wireless technology in such systems is desirable for better...
Share article
Training, testing and benchmarking medical AI models using Clinical AIBench
March 2022
AI technology has been used in many clinical research fields, but most AI technologies are difficult to land in real-world clinical settings. In most current clinical AI research settings, the diagnosis...
Share article
Open-source computer systems initiative: The motivation, essence, challenges, and methodology
March 2022
The global community faces many pressing and uncertain challenges like pandemics and global climate change. Information technology (IT) infrastructure has become the enabler to addressing those challenges....
Share article
Latency-aware automatic CNN channel pruning with GPU runtime analysis
October 2021
The huge storage and computation cost of convolutional neural networks (CNN) make them challenging to meet the real-time inference requirement in many applications. Existing channel pruning methods...
Share article
Fallout: Distributed systems testing as a service
October 2021
All modern distributed systems list performance and scalability as their core strengths. Given that optimal performance requires carefully selecting configuration options, and typical cluster sizes...
Share article
Revisiting the effects of the Spectre and Meltdown patches using the top-down microarchitectural method and purchasing power parity theory
October 2021
Software patches are made available to fix security vulnerabilities, enhance performance, and usability. Previous works focused on measuring the performance effect of patches on benchmark runtimes....
Share article
MLHarness: A scalable benchmarking system for MLCommons
October 2021
With the society’s growing adoption of machine learning (ML) and deep learning (DL) for various intelligent solutions, it becomes increasingly imperative to standardize a common set of measures for...
Share article
A parallel sparse approximate inverse preconditioning algorithm based on MPI and CUDA
October 2021
In this study, we present an efficient parallel sparse approximate inverse (SPAI) preconditioning algorithm based on MPI and CUDA, called HybridSPAI. For HybridSPAI, it optimizes a latest static SPAI...
Share article
Performance optimization opportunities in the Android software stack
October 2021
The smartphone hardware and software ecosystems have evolved very rapidly. Multiple innovations in the system software, including OS, languages, and runtimes have been made in the last decade. Although,...
Share article
Benchmarking feature selection methods with different prediction models on large-scale healthcare event data
October 2021
With the development of the Electronic Health Record (EHR) technique, vast volumes of digital clinical data are generated. Based on the data, many methods are developed to improve the performance of...
Share article
Comparative evaluation of deep learning workloads for leadership-class systems
October 2021
Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications...
Share article
MVDI25K: A large-scale dataset of microscopic vaginal discharge images
October 2021
With the widespread application of artificial intelligence technology in the field of biomedical images, the deep learning-based detection of vaginal discharge, an important but challenging topic in...
Share article
Benchmarking for Observability: The Case of Diagnosing Storage Failures
October 2021
Diagnosing storage system failures is challenging even for professionals. One recent example is the “When Solid State Drives Are Not That Solid” incident occurred at Algolia data center, where Samsung...
Share article
Call for establishing benchmark science and engineering
October 2021
Currently, there is no consistent benchmarking across multi-disciplines. Even no previous work tries to relate different categories of benchmarks in multi-disciplines. This article investigates the...
Share article
Workflow Critical Path: A data-oriented critical path metric for Holistic HPC Workflows
October 2021
Current trends in HPC, such as the push to exascale, convergence with Big Data, and growing complexity of HPC applications, have created gaps that traditional performance tools do not cover. One example...
Share article
Stars shine: The report of 2021 BenchCouncil awards
October 2021
This report introduces the awards presented by the International Open Benchmark Council (BenchCouncil) in 2021 and highlights the award selection rules, committee, awardees, and their contributions...
Share article