Unveiling Real-Time Economic Insights with Search Big Data

Published 19 October, 2023

Economic indicators released by the government are pivotal in shaping decisions across both the public and private sectors. However, a significant limitation of these indicators lies in their timeliness, as they rely on macroeconomic factors like inventory turnover and iron production. For instance, in the case of Japan Cabinet Office's Indexes of Business Conditions, the indices are typically released with a two-month delay.

To overcome the drawbacks of conventional macro-variable-driven techniques, a team of Japanese researchers developed a big data-driven method capable of providing accurate nowcasts for macroeconomic indicators. Importantly, this approach eliminates the need for aggregating semi-macroeconomic data and relies solely non-prescribed search engine query data (Search Big Data) obtained from a prominent search engine used by more than 60% of the nation’s internet users.

“Our new model demonstrated the ability to forecast key Japanese economic indicators in real time (= nowcast), even amid the challenges posed by pandemic-related disruptions,” shared co-corresponding author of the study, Kazuto Ataka. “By leveraging search big data, the model identifies highly correlated queries and performs multiple regression analysis to provide timely and accurate economic insights.”

Remarkably, the model showed adaptability and resilience even in the face of rapid economic shifts and unpredictable scenarios. Furthermore, in-depth analysis has revealed that economic activities are influenced not only by economic factors but also by fundamental human desires, including libido and desire for laughter. This underscores the complex interplay between human interests and economic developments.

“Our findings offer a nuanced perspective for understanding real-time economic trends. The model's outstanding performance in nowcasting during the pandemic represents a significant advancement over current methodologies, emphasizing the potential of incorporating various real-time data sources to enhance the precision of economic nowcasting,” added Ataka.

The study, published in The Journal of Finance and Data Science, stands as a significant advancement in the field of economic nowcasting, opening avenues for more informed and timely decision-making in both the public and private sectors.

Fig. 1. Actual and nowcasted values of the CCI from April 2019 to March 2021. CREDIT: The authors
Fig. 2. Proportions of query genres used for CI and CCI nowcasting during Before COVID-19 and Under COVID-19 periods. CREDIT: The authors

Contact author name, affiliation, email address: Kazuto Ataka, Faculty of Environment and Information Studies, Keio University, Kanagawa, Japan. ataka@sfc.keio.ac.jp

Social media handles:

Goshi Aoki: https://twitter.com/goshi_aoki

Kazuto Ataka: https://twitter.com/kaz_ataka

Takero Doi: https://twitter.com/takero_doi

Funder: This research was conducted using the resources of Yahoo Japan Corporation.

Conflict of interest: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

See the article: Goshi Aoki, Kazuto Ataka, Takero Doi, Kota Tsubouchi, Data-Driven Estimation of Economic Indicators with Search Big Data in Discontinuous Situation, The Journal of Finance and Data Science, 2023, https://doi.org/10.1016/j.jfds.2023.100106.

Back to JFDS News

Stay Informed

Register your interest and receive email alerts tailored to your needs. Sign up below.