Subscribe to the gold package and get unlimited access to Shamra Academy
Register a new userMeasuring Human Adaptation to AI in Decision Making: Application to Evaluate Changes after AlphaGo
192
0
0.0
(
0
)
Ask ChatGPT about the research
No Arabic abstract
Across a growing number of domains, human experts are expected to learn from and adapt to AI with superior decision making abilities. But how can we quantify such human adaptation to AI? We develop a simple measure of human adaptation to AI and test its usefulness in two case studies. In Study 1, we analyze 1.3 million move decisions made by professional Go players and find that a positive form of adaptation to AI (learning) occurred after the players could observe the reasoning processes of AI, rather than mere actions of AI. These findings based on our measure highlight the importance of explainability for human learning from AI. In Study 2, we test whether our measure is sufficiently sensitive to capture a negative form of adaptation to AI (cheating aided by AI), which occurred in a match between professional Go players. We discuss our measures applications in domains other than Go, especially in domains in which AIs decision making ability will likely surpass that of human experts.
rate research
Read More
People supported by AI-powered decision support tools frequently overrely on the AI: they accept an AIs suggestion even when that suggestion is wrong. Adding explanations to the AI decisions does not appear to reduce the overreliance and some studies suggest that it might even increase it. Informed by the dual-process theory of cognition, we posit that people rarely engage analytically with each individual AI recommendation and explanation, and instead develop general heuristics about whether and when to follow the AI suggestions. Building on prior research on medical decision-making, we designed three cognitive forcing interventions to compel people to engage more thoughtfully with the AI-generated explanations. We conducted an experiment (N=199), in which we compared our three cognitive forcing designs to two simple explainable AI approaches and to a no-AI baseline. The results demonstrate that cognitive forcing significantly reduced overreliance compared to the simple explainable AI approaches. However, there was a trade-off: people assigned the least favorable subjective ratings to the designs that reduced the overreliance the most. To audit our work for intervention-generated inequalities, we investigated whether our interventions benefited equally people with different levels of Need for Cognition (i.e., motivation to engage in effortful mental activities). Our results show that, on average, cognitive forcing interventions benefited participants higher in Need for Cognition more. Our research suggests that human cognitive motivation moderates the effectiveness of explainable AI solutions.
Clinical decision support tools (DST) promise improved healthcare outcomes by offering data-driven insights. While effective in lab settings, almost all DSTs have failed in practice. Empirical research diagnosed poor contextual fit as the cause. This paper describes the design and field evaluation of a radically new form of DST. It automatically generates slides for clinicians decision meetings with subtly embedded machine prognostics. This design took inspiration from the notion of Unremarkable Computing, that by augmenting the users routines technology/AI can have significant importance for the users yet remain unobtrusive. Our field evaluation suggests clinicians are more likely to encounter and embrace such a DST. Drawing on their responses, we discuss the importance and intricacies of finding the right level of unremarkableness in DST design, and share lessons learned in prototyping critical AI systems as a situated experience.
Many still rightly wonder whether accounting numbers affect business value. Basic questions are why? and how? I aim at promoting an objective choice on how optimizing the most suitable valuation methods under a value-based management framework through some performance measurement systems. First, I present a comprehensive review of valuation methods. Three valuations methods, (i) Free Cash Flow Valuation Model (FCFVM), (ii) Residual Earning Valuation Model (REVM) and (iii) Abnormal Earning Growth Model (AEGM), are presented. I point out to advantages and limitations. As applications, the proofs of the findings are illustrated on three study cases: Marks & Spencers business pattern (size and growth prospect), which had a recently advertised valuation problem, and two comparable companies, Tesco and Sainsburys, all three chosen for multiple-based valuation. For the purpose, two value drivers are chosen, EnV/EBIT (entity value/earnings before interests and taxes) and the corresponding EnV/Sales. Thus, the question whether accounting numbers through models based on mathematical economics truly affect business value has an answer: Maybe, yes.
After the 2007/2008 financial crisis, the UK government decided that a change in regulation was required to amend the poor control of financial markets. The Financial Services Act 2012 was developed as a result in order to give more control and authority to the regulators of financial markets. Thus, the Financial Conduct Authority (FCA) succeeded the Financial Services Authority (FSA). An area requiring an improvement in regulation was insider trading. Our study examines the effectiveness of the FCA in its duty of regulating insider trading through utilising the event study methodology to assess abnormal returns in the run-up to the first announcement of mergers. Samples of abnormal returns are examined on periods, under regulation either by the FSA or by the FCA. Practically, stock price data on the London Stock Exchange from 2008-2012 and 2015-2019 is investigated. The results from this study determine that abnormal returns are reduced after the implementation of the Financial Services Act 2012; prices are also found to be noisier in the period before the 2012 Act. Insignificant abnormal returns are found in the run-up to the first announcement of mergers in the 2015-2019 period. This concludes that the FCA is efficient in regulating insider trading.
This work focuses on the development of a new family of decision-making algorithms for adaptation and learning, which are specifically tailored to decision problems and are constructed by building up on first principles from decision theory. A key observation is that estimation and decision problems are structurally different and, therefore, algorithms that have proven successful for the former need not perform well when adjusted for decision problems. We propose a new scheme, referred to as BLLR (barrier log-likelihood ratio algorithm) and demonstrate its applicability to real-data from the COVID-19 pandemic in Italy. The results illustrate the ability of the design tool to track the different phases of the outbreak.
Log in to be able to interact and post comments
comments
Fetching comments
Sign in to be able to follow your search criteria
