Benchmarking, ethical alignment, and evaluation framework for conversational AI: Advancing responsible development of ChatGPT
September 2023
Conversational AI systems like ChatGPT have seen remarkable advancements in recent years, revolutionizing human–computer interactions. However, evaluating the performance and ethical implications of...
Share article
Algorithmic fairness in social context
September 2023
Algorithmic fairness research is currently receiving significant attention, aiming to ensure that algorithms do not discriminate between different groups or individuals with similar characteristics....
Share article
Analyzing the potential benefits and use cases of ChatGPT as a tool for improving the efficiency and effectiveness of business operations
September 2023
•The potential benefits for companies of adopting ChatGPT, a popular chatbot built on a large-scale transformer.•To carefully analyze its use cases and restrictions, as well as its strengths and disadvantages.•ChatGPT...
Share article
Mind meets machine: Unravelling GPT-4’s cognitive psychology
September 2023
Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large Language Models (LLMs) are emerging as potent tools increasingly...
Share article
MetaverseBench: Instantiating and benchmarking metaverse challenges
September 2023
The rapid evolution of the metaverse has led to the emergence of numerous metaverse technologies and productions. From a computer systems perspective, the metaverse system is a complex, large-scale...
Share article
Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system
June 2023
Artificial Intelligence (AI)-based ChatGPT developed by OpenAI is now widely accepted in several fields, including education. Students can learn about ideas and theories by using this technology while...
Share article
CoviDetector: A transfer learning-based semi supervised approach to detect Covid-19 using CXR images
June 2023
COVID-19 was one of the deadliest and most infectious illnesses of this century. Research has been done to decrease pandemic deaths and slow down its spread. COVID-19 detection investigations have utilised...
Share article
StreamAD: A cloud platform metrics-oriented benchmark for unsupervised online anomaly detection
June 2023
Cloud platforms, serving as fundamental infrastructure, play a significant role in developing modern applications. In recent years, there has been growing interest among researchers in utilizing machine...
Share article
DPUBench: An application-driven scalable benchmark suite for comprehensive DPU evaluation
June 2023
With the development of data centers, network bandwidth has rapidly increased, reaching hundreds of Gbps. However, the network I/O processing performance of CPU improvement has not kept pace with this...
Share article
Benchmarking HTAP databases for performance isolation and real-time analytics
June 2023
Hybrid Transactional/Analytical Processing (HTAP) databases are designed to execute real-time analytics and provide performance isolation for online transactions and analytical queries. Real-time analytics...
Share article
TBench (BenchCouncil Transactions on Benchmarks, Standards and Evaluations) Calls for Papers
June 2023
BenchCouncil Transactions on Benchmarks, Standards and Evaluations (TBench) is an open-access journal dedicated to advancing the field of benchmarks, data sets, standards, evaluations and optimizations....
Share article
The Third BenchCouncil International Symposium on Intelligent Computers, Algorithms, and Applications (IC 2023) Call for Papers
June 2023
Sponsored and organized by the International Open Benchmark Council (BenchCouncil), the IC conference is to provide a pioneering technology map through searching and advancing state-of-the-art and state-of-the-practice...
Share article
2023 BenchCouncil Distinguished Doctoral Dissertation Award Call for Nomination
June 2023
BenchCouncil Distinguished Doctoral Dissertation Award is to recognize and encourage superior research and writing by doctoral candidates in the broad field of benchmarking community. This year, the...
Share article
Enabling hyperscale web services
February 2023
Modern web services such as social media, online messaging, and web search support billions of users, requiring data centers that scale to hundreds of thousands of servers, i.e., hyperscale. The key...
Share article
ChatGPT for healthcare services: An emerging stage for an innovative perspective
February 2023
Generative Pretrained Transformer, often known as GPT, is an innovative kind of Artificial Intelligence (AI) which can produce writing that seems to have been written by a person. OpenAI created this...
Share article
e₹—The digital currency in India: Challenges and prospects
February 2023
The Reserve Bank of India (RBI) has recently launched the country’s first pilot project for the digital currency known as the digital rupee or e-Rupee (e₹). The launch of the digital rupee represents...
Share article
ERMDS: A obfuscation dataset for evaluating robustness of learning-based malware detection system
February 2023
Learning-based malware detection systems (LB-MDS) play a crucial role in defending computer systems from malicious attacks. Nevertheless, these systems can be vulnerable to various attacks, which can...
Share article
SNNBench: End-to-end AI-oriented spiking neural network benchmarking
February 2023
Spiking Neural Networks (SNNs) show great potential for solving Artificial Intelligence (AI) applications. At the preliminary stage of SNNs, benchmarks are essential for evaluating and optimizing SNN...
Share article
Bench 2023 Calls For Papers
February 2023
Share article
Enabling Reduced Simpoint Size Through LiveCache and Detail Warmup
October 2022
Simpoint technology (Sherwood et al., 2002) has been widely used by modern micro-architecture research community to significantly speedup the simulation time. However, the typical Simpoint size remains...
Share article
HPC AI500 V3.0: A scalable HPC AI benchmarking framework
October 2022
In recent years, the convergence of High Performance Computing (HPC) and artificial intelligence (AI) makes the community desperately need a benchmark to guide the design of next-generation scalable...
Share article
CpsMark+: A scenario-oriented benchmark system for office desktop performance evaluation in centralized procurement via simulating user experience
October 2022
Rapid business expansion of various companies has placed growing demand on office desktops recent decades. However, improper evaluation of system performance and inexplicit awareness of practical use...
Share article
An extensive study on Internet of Behavior (IoB) enabled Healthcare-Systems: Features, facilitators, and challenges
October 2022
The Internet of Behaviour (IoB) is an effort to dissect behavioural patterns as explained by data collection. IoB is an extension of the Internet of Things (IoT). Therefore, both are anticipated to...
Share article
Edge AIBench 2.0: A scalable autonomous vehicle benchmark for IoT–Edge–Cloud systems
October 2022
Many emerging IoT–Edge–Cloud computing systems are not yet implemented or are too confidential to share the code or even tricky to replicate its execution environment, and hence their benchmarking is...
Share article
Optimizing the sparse approximate inverse preconditioning algorithm on GPU
October 2022
In this study, we present an optimization sparse approximate inverse (SPAI) preconditioning algorithm on GPU, called GSPAI-Opt. In GSPAI-Opt, it fuses the advantages of two popular SPAI preconditioning...
Share article