ML p(r)ior | What We Don't Know About Spreadsheet Errors Today: The Facts, Why We Don't Believe Them, and What We Need to Do

What We Don't Know About Spreadsheet Errors Today: The Facts, Why We Don't Believe Them, and What We Need to Do

2016-02-02
1602.02601 | cs.SE
Research on spreadsheet errors is substantial, compelling, and unanimous. It has three simple conclusions. The first is that spreadsheet errors are rare on a per-cell basis, but in large programs, at least one incorrect bottom-line value is very likely to be present. The second is that errors are extremely difficult to detect and correct. The third is that spreadsheet developers and corporations are highly overconfident in the accuracy of their spreadsheets. The disconnect between the first two conclusions and the third appears to be due to the way human cognition works. Most importantly, we are aware of very few of the errors we make. In addition, while we are proudly aware of errors that we fix, we have no idea of how many remain, but like Little Jack Horner we are impressed with our ability to ferret out errors. This paper reviews human cognition processes and shows first that humans cannot be error free no matter how hard they try, and second that our intuition about errors and how we can reduce them is based on appallingly bad knowledge. This paper argues that we should reject any prescription for reducing errors that has not been rigorously proven safe and effective. This paper also argues that our biggest need, based on empirical data, is to do massively more testing than we do now. It suggests that the code inspection methodology developed in software development is likely to apply very well to spreadsheet inspection.
PDF

Highlights - Most important sentences from the article

Login to like/save this paper, take notes and configure your recommendations

Related Articles

2019-05-20
1905.08297 | cs.SE

Software analytics can be improved by surveying; i.e. rechecking and (possibly) revising the labels … show more
PDF

Highlights - Most important sentences from the article

2018-03-17

Society needs more secure software. But the subject matter experts in software security are in short… show more
PDF

Highlights - Most important sentences from the article

2018-08-30
1808.10231 | cs.SE

Spreadsheets (sometimes also called Excel programs) are powerful tools which play a business-critica… show more
PDF

Highlights - Most important sentences from the article

2015-09-24
1509.07238 | cs.SE

Which programming error messages are the most common? We investigate this question, motivated by wri… show more
PDF

Highlights - Most important sentences from the article

2015-05-27

Affects---emotions and moods---have an impact on cognitive activities and the working performance of… show more
PDF

Highlights - Most important sentences from the article

2016-11-30

Spreadsheets are powerful tools which play a business-critical role in many organizations. However, … show more
PDF

Highlights - Most important sentences from the article

2017-03-31
1703.10863 | cs.PL

Computer programs do not always work as expected. In fact, ominous warnings about the desperate stat… show more
PDF

Highlights - Most important sentences from the article

2012-10-01

Scientists spend an increasing amount of time building and using software. However, most scientists … show more
PDF

Highlights - Most important sentences from the article

2017-07-17

Shortage of available training data is holding back progress in the area of automated error detectio… show more
PDF

Highlights - Most important sentences from the article

2015-03-12

In this paper, we present our vision of the integration of human factors engineering into the softwa… show more
PDF

Highlights - Most important sentences from the article

2019-06-27
1906.11456 | cs.SE

Background: Compilers tend to produce cryptic and uninformative error messages, leaving programmers … show more
PDF

Highlights - Most important sentences from the article

2019-06-27

While functional programming is an efficient way to express complex software, functional programming… show more
PDF

Highlights - Most important sentences from the article

2019-07-17

One problem when studying how to find and fix syntax errors is how to get natural and representative… show more
PDF

Highlights - Most important sentences from the article

2018-02-01
1802.00496 | cs.CY

Based on the Spreadsheet Competency Framework for finance professionals, in the present paper we int… show more
PDF

Highlights - Most important sentences from the article

2018-01-30

The humble spreadsheet is the most widely used data storage, manipulation and modelling tool. Its ub… show more
PDF

Highlights - Most important sentences from the article

2018-01-23
1801.07782 | cs.CY

This paper presents and discusses the results of a small scoping survey of Clinical Decision Support… show more
PDF

Highlights - Most important sentences from the article