Recent Articles

Open access

ISSN: 2772-4859

2022 BenchCouncil International Symposium on benchmarking, measuring and optimizing (Bench 2022) call for papers

Sponsored and organized by the International Open Benchmark Council (BenchCouncil), the Bench conference encompasses a wide range of topics in benchmarking, measurement, evaluation methods, and tools....

Share article

SAIBench: Benchmarking AI for Science

Scientific research communities are embracing AI-based solutions to target tractable scientific tasks and improve research work flows. However, the development and evaluation of such solutions are scattered...

Share article

An efficient encrypted deduplication scheme with security-enhanced proof of ownership in edge computing

With the rapid expansion of Internet of Things (IoT), relevant files are stored and transmitted at the network edge by employing data deduplication to eliminate redundant data for the best accessibility....

Share article

Asynchronous memory access unit for general purpose processors

In future data centers, applications will make heavy use of far memory (including disaggregated memory pools and NVM). The access latency of far memory is more widely distributed than that of local...

Share article

A BenchCouncil view on benchmarking emerging and future computing

The measurable properties of the artifacts or objects in the computer, management, or finance disciplines are extrinsic, not inherent — dependent on their problem definitions and solution instantiations....

Share article

Performance and energy consumption tradeoff in server consolidation

Server consolidation is one of the techniques used to increase energy efficiency in datacentres. Nevertheless, the server consolidation has an inherent trade-off between performance degradation and...

Share article

Are current benchmarks adequate to evaluate distributed transactional databases?

With the rapid development of distributed transactional databases in recent years, there is an urgent need for fair performance evaluation and comparison. Though there are various open-source benchmarks...

Share article

Three laws of technology rise or fall

Newton’s laws of motion perfectly explain or approximate physical phenomena in our everyday life. Are there any laws that explain or approximate technology’s rise or fall? After reviewing thirteen information...

Share article

Combating disinformation on social media: A computational perspective

The use of social media has accelerated information sharing and instantaneous communications. The low barrier to enter social media enables more users to participate and makes them stay engaged longer,...

Share article

Challenges and recent advances in the design of real-time wireless Cyber-Physical Systems

Cyber-Physical Systems (CPS) refer to systems where some intelligence is embedded into devices that interact with their environment. Using wireless technology in such systems is desirable for better...

Share article

Training, testing and benchmarking medical AI models using Clinical AIBench

AI technology has been used in many clinical research fields, but most AI technologies are difficult to land in real-world clinical settings. In most current clinical AI research settings, the diagnosis...

Share article

Open-source computer systems initiative: The motivation, essence, challenges, and methodology

The global community faces many pressing and uncertain challenges like pandemics and global climate change. Information technology (IT) infrastructure has become the enabler to addressing those challenges....

Share article

Latency-aware automatic CNN channel pruning with GPU runtime analysis

The huge storage and computation cost of convolutional neural networks (CNN) make them challenging to meet the real-time inference requirement in many applications. Existing channel pruning methods...

Share article

Fallout: Distributed systems testing as a service

All modern distributed systems list performance and scalability as their core strengths. Given that optimal performance requires carefully selecting configuration options, and typical cluster sizes...

Share article

Revisiting the effects of the Spectre and Meltdown patches using the top-down microarchitectural method and purchasing power parity theory

Software patches are made available to fix security vulnerabilities, enhance performance, and usability. Previous works focused on measuring the performance effect of patches on benchmark runtimes....

Share article

MLHarness: A scalable benchmarking system for MLCommons

With the society’s growing adoption of machine learning (ML) and deep learning (DL) for various intelligent solutions, it becomes increasingly imperative to standardize a common set of measures for...

Share article

A parallel sparse approximate inverse preconditioning algorithm based on MPI and CUDA

In this study, we present an efficient parallel sparse approximate inverse (SPAI) preconditioning algorithm based on MPI and CUDA, called HybridSPAI. For HybridSPAI, it optimizes a latest static SPAI...

Share article

Performance optimization opportunities in the Android software stack

The smartphone hardware and software ecosystems have evolved very rapidly. Multiple innovations in the system software, including OS, languages, and runtimes have been made in the last decade. Although,...

Share article

Benchmarking feature selection methods with different prediction models on large-scale healthcare event data

With the development of the Electronic Health Record (EHR) technique, vast volumes of digital clinical data are generated. Based on the data, many methods are developed to improve the performance of...

Share article

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications...

Share article

MVDI25K: A large-scale dataset of microscopic vaginal discharge images

With the widespread application of artificial intelligence technology in the field of biomedical images, the deep learning-based detection of vaginal discharge, an important but challenging topic in...

Share article

Benchmarking for Observability: The Case of Diagnosing Storage Failures

Diagnosing storage system failures is challenging even for professionals. One recent example is the “When Solid State Drives Are Not That Solid” incident occurred at Algolia data center, where Samsung...

Share article

Call for establishing benchmark science and engineering

Currently, there is no consistent benchmarking across multi-disciplines. Even no previous work tries to relate different categories of benchmarks in multi-disciplines. This article investigates the...

Share article

Workflow Critical Path: A data-oriented critical path metric for Holistic HPC Workflows

Current trends in HPC, such as the push to exascale, convergence with Big Data, and growing complexity of HPC applications, have created gaps that traditional performance tools do not cover. One example...

Share article

Stars shine: The report of 2021 BenchCouncil awards

This report introduces the awards presented by the International Open Benchmark Council (BenchCouncil) in 2021 and highlights the award selection rules, committee, awardees, and their contributions...

Share article

Stay Informed

Register your interest and receive email alerts tailored to your needs. Sign up below.