Recent Articles

Open access

ISSN: 2772-4859

BinCodex: A comprehensive and multi-level dataset for evaluating binary code similarity detection techniques

The binary code similarity detection (BCSD) technique can quantitatively measure the differences between two given binaries and give matching results at predefined granularity (e.g., function), and...

Share article

Evaluatology: The science and engineering of evaluation

Evaluation is a crucial aspect of human existence and plays a vital role in each field. However, it is often approached in an empirical and ad-hoc manner, lacking consensus on universal concepts, terminologies,...

Share article

An approach to workload generation for modern data centers: A view from Alibaba trace

Modern data centers provide the foundational infrastructure of cloud computing. Workload generation, which involves simulating or constructing tasks and transactions to replicate the actual resource...

Share article

TensorTable: Extending PyTorch for mixed relational and linear algebra pipelines

The mixed relational algebra (RA) and linear algebra (LA) pipelines have become increasingly common in recent years. However, contemporary widely used frameworks struggle to support both RA and LA operators...

Share article

AIGCBench: Comprehensive evaluation of image-to-video content generated by AI

The burgeoning field of Artificial Intelligence Generated Content (AIGC) is witnessing rapid advancements, particularly in video generation. This paper introduces AIGCBench, a pioneering comprehensive...

Share article

CloudAISim: A toolkit for modelling and simulation of modern applications in AI-driven cloud computing environments

There is a very significant knowledge gap between Artificial Intelligence (AI) and a multitude of industries that exist in today’s modern world. This is primarily attributable to the limited availability...

Share article

Characterizing and understanding deep neural network batching systems on GPUs

As neural network inference demands are ever-increasing in intelligent applications, the performance optimization of model serving becomes a challenging problem. Dynamic batching is an important feature...

Share article

Benchmarking ChatGPT for prototyping theories: Experimental studies using the technology acceptance model

•We explore the paradigm of leveraging ChatGPT as a bench tool for theory prototyping in business research.•We conducted two experimental studies using the classical technology acceptance model (TAM)...

Share article

A pluggable single-image super-resolution algorithm based on second-order gradient loss

Convolutional neural networks for single-image super-resolution have been widely used with great success. However, most of these methods use L1 loss to guide network optimization, resulting in blurry...

Share article

MetaverseBench: Instantiating and benchmarking metaverse challenges

The rapid evolution of the metaverse has led to the emergence of numerous metaverse technologies and productions. From a computer systems perspective, the metaverse system is a complex, large-scale...

Share article

Benchmarking, ethical alignment, and evaluation framework for conversational AI: Advancing responsible development of ChatGPT

Conversational AI systems like ChatGPT have seen remarkable advancements in recent years, revolutionizing human–computer interactions. However, evaluating the performance and ethical implications of...

Share article

Algorithmic fairness in social context

Algorithmic fairness research is currently receiving significant attention, aiming to ensure that algorithms do not discriminate between different groups or individuals with similar characteristics....

Share article

Analyzing the potential benefits and use cases of ChatGPT as a tool for improving the efficiency and effectiveness of business operations

•The potential benefits for companies of adopting ChatGPT, a popular chatbot built on a large-scale transformer.•To carefully analyze its use cases and restrictions, as well as its strengths and disadvantages.•ChatGPT...

Share article

Mind meets machine: Unravelling GPT-4’s cognitive psychology

Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large Language Models (LLMs) are emerging as potent tools increasingly...

Share article

CoviDetector: A transfer learning-based semi supervised approach to detect Covid-19 using CXR images

COVID-19 was one of the deadliest and most infectious illnesses of this century. Research has been done to decrease pandemic deaths and slow down its spread. COVID-19 detection investigations have utilised...

Share article

Benchmarking HTAP databases for performance isolation and real-time analytics

Hybrid Transactional/Analytical Processing (HTAP) databases are designed to execute real-time analytics and provide performance isolation for online transactions and analytical queries. Real-time analytics...

Share article

TBench (BenchCouncil Transactions on Benchmarks, Standards and Evaluations) Calls for Papers

BenchCouncil Transactions on Benchmarks, Standards and Evaluations (TBench) is an open-access journal dedicated to advancing the field of benchmarks, data sets, standards, evaluations and optimizations....

Share article

The Third BenchCouncil International Symposium on Intelligent Computers, Algorithms, and Applications (IC 2023) Call for Papers

Sponsored and organized by the International Open Benchmark Council (BenchCouncil), the IC conference is to provide a pioneering technology map through searching and advancing state-of-the-art and state-of-the-practice...

Share article

Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system

Artificial Intelligence (AI)-based ChatGPT developed by OpenAI is now widely accepted in several fields, including education. Students can learn about ideas and theories by using this technology while...

Share article

2023 BenchCouncil Distinguished Doctoral Dissertation Award Call for Nomination

BenchCouncil Distinguished Doctoral Dissertation Award is to recognize and encourage superior research and writing by doctoral candidates in the broad field of benchmarking community. This year, the...

Share article

DPUBench: An application-driven scalable benchmark suite for comprehensive DPU evaluation

With the development of data centers, network bandwidth has rapidly increased, reaching hundreds of Gbps. However, the network I/O processing performance of CPU improvement has not kept pace with this...

Share article

StreamAD: A cloud platform metrics-oriented benchmark for unsupervised online anomaly detection

Cloud platforms, serving as fundamental infrastructure, play a significant role in developing modern applications. In recent years, there has been growing interest among researchers in utilizing machine...

Share article

Enabling hyperscale web services

Modern web services such as social media, online messaging, and web search support billions of users, requiring data centers that scale to hundreds of thousands of servers, i.e., hyperscale. The key...

Share article

ERMDS: A obfuscation dataset for evaluating robustness of learning-based malware detection system

Learning-based malware detection systems (LB-MDS) play a crucial role in defending computer systems from malicious attacks. Nevertheless, these systems can be vulnerable to various attacks, which can...

Share article

e₹—The digital currency in India: Challenges and prospects

The Reserve Bank of India (RBI) has recently launched the country’s first pilot project for the digital currency known as the digital rupee or e-Rupee (e₹). The launch of the digital rupee represents...

Share article

Stay Informed

Register your interest and receive email alerts tailored to your needs. Sign up below.