Suppr超能文献

提高专家技术预测的策略。

A strategy to improve expert technology forecasts.

机构信息

Department of Engineering and Public Policy, Carnegie Mellon University, Pittsburgh, PA 15213.

Department of Engineering and Public Policy, Carnegie Mellon University, Pittsburgh, PA 15213

出版信息

Proc Natl Acad Sci U S A. 2021 May 25;118(21). doi: 10.1073/pnas.2021558118.

Abstract

Forecasts of the future cost and performance of technologies are often used to support decision-making. However, retrospective reviews find that many forecasts made by experts are not very accurate and are often seriously overconfident, with realized values too frequently falling outside of forecasted ranges. Here, we outline a hybrid approach to expert elicitation that we believe might improve forecasts of future technologies. The proposed approach iteratively combines the judgments of technical domain experts with those of experts who are knowledgeable about broader issues of technology adoption and public policy. We motivate the approach with results from a pilot study designed to help forecasters think systematically about factors beyond the technology itself that may shape its future, such as policy, economic, and social factors. Forecasters who received briefings on these topics provided wider forecast intervals than those receiving no assistance.

摘要

对未来技术的成本和性能的预测通常被用来支持决策。然而,回顾性研究发现,许多专家做出的预测并不十分准确,而且往往过于自信,实际价值经常超出预测范围。在这里,我们概述了一种混合的专家征询方法,我们相信这可能会提高对未来技术的预测。所提出的方法迭代地结合了技术领域专家的判断和那些对技术采用和公共政策等更广泛问题有知识的专家的判断。我们用一项旨在帮助预测者系统地思考可能影响技术未来的技术本身以外的因素(如政策、经济和社会因素)的试点研究的结果来说明该方法。接受了这些主题介绍的预测者提供的预测区间比没有接受帮助的预测者提供的预测区间要宽。

相似文献

1
A strategy to improve expert technology forecasts.
Proc Natl Acad Sci U S A. 2021 May 25;118(21). doi: 10.1073/pnas.2021558118.
2
Comparing expert elicitation and model-based probabilistic technology cost forecasts for the energy transition.
Proc Natl Acad Sci U S A. 2021 Jul 6;118(27). doi: 10.1073/pnas.1917165118.
3
Use (and abuse) of expert elicitation in support of decision making for public policy.
Proc Natl Acad Sci U S A. 2014 May 20;111(20):7176-84. doi: 10.1073/pnas.1319946111. Epub 2014 May 12.
4
Quantifying machine influence over human forecasters.
Sci Rep. 2020 Sep 29;10(1):15940. doi: 10.1038/s41598-020-72690-4.
5
Development of a Group Judgment Process for Forecasts of Health Care Innovations.
JAMA Netw Open. 2018 Nov 2;1(7):e185108. doi: 10.1001/jamanetworkopen.2018.5108.
6
Marine Forecasting and Fishing Safety: Improving the Fit between Forecasts and Harvester Needs.
J Agromedicine. 2019 Oct;24(4):324-332. doi: 10.1080/1059924X.2019.1639576. Epub 2019 Jul 11.
8
Case studies on forecasting for innovative technologies: frequent revisions improve accuracy.
Health Aff (Millwood). 2015 Feb;34(2):311-8. doi: 10.1377/hlthaff.2014.1066.
9
A simple method for joint evaluation of skill in directional forecasts of multiple variables.
Heliyon. 2023 Sep 1;9(9):e19729. doi: 10.1016/j.heliyon.2023.e19729. eCollection 2023 Sep.
10
Compromising improves forecasting.
R Soc Open Sci. 2023 May 17;10(5):221216. doi: 10.1098/rsos.221216. eCollection 2023 May.

引用本文的文献

1
Autologous blood in the management of ocular surface disorders.
World J Exp Med. 2024 Dec 20;14(4):96412. doi: 10.5493/wjem.v14.i4.96412.
2
Implications of uncertainty in technology cost projections for least-cost decarbonized electricity systems.
iScience. 2023 Dec 7;27(1):108685. doi: 10.1016/j.isci.2023.108685. eCollection 2024 Jan 19.
3
Probabilistic projections of granular energy technology diffusion at subnational level.
PNAS Nexus. 2023 Sep 29;2(10):pgad321. doi: 10.1093/pnasnexus/pgad321. eCollection 2023 Oct.
4
Testing and improving technology forecasts for better climate policy.
Proc Natl Acad Sci U S A. 2021 Aug 31;118(35). doi: 10.1073/pnas.2109417118.

本文引用的文献

1
Empirical prediction intervals improve energy forecasting.
Proc Natl Acad Sci U S A. 2017 Aug 15;114(33):8752-8757. doi: 10.1073/pnas.1619938114. Epub 2017 Jul 31.
2
How Can Decision Making Be Improved?
Perspect Psychol Sci. 2009 Jul;4(4):379-83. doi: 10.1111/j.1745-6924.2009.01142.x.
3
Use (and abuse) of expert elicitation in support of decision making for public policy.
Proc Natl Acad Sci U S A. 2014 May 20;111(20):7176-84. doi: 10.1073/pnas.1319946111. Epub 2014 May 12.
4
Psychological strategies for winning a geopolitical forecasting tournament.
Psychol Sci. 2014 May 1;25(5):1106-15. doi: 10.1177/0956797614524255. Epub 2014 Mar 21.
5
Think twice and then: combining or choosing in dialectical bootstrapping?
J Exp Psychol Learn Mem Cogn. 2014 Jan;40(1):218-32. doi: 10.1037/a0034054. Epub 2013 Sep 9.
6
Expert assessments of the cost of light water small modular reactors.
Proc Natl Acad Sci U S A. 2013 Jun 11;110(24):9686-91. doi: 10.1073/pnas.1300195110. Epub 2013 May 28.
7
Expert assessments of future photovoltaic technologies.
Environ Sci Technol. 2008 Dec 15;42(24):9031-8. doi: 10.1021/es8014088.
8
Overconfidence in interval estimates.
J Exp Psychol Learn Mem Cogn. 2004 Mar;30(2):299-314. doi: 10.1037/0278-7393.30.2.299.
9
Realism of confidence judgments.
Psychol Rev. 1961 Jan;68:33-45. doi: 10.1037/h0040274.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验