ITECH1400 Foundations of Programming Assignment 2
{`
Federation University
School of Science Engineering and Information Technology
ITECH1400 Foundations of Programming
`}
Logarithms, Benford’s Law and Fraudulent Data
Overview
In this assignment you will write an application in Python that will apply Benford’s Law to a given set of your own data. This is an individual assignment.
Timelines and Expectations
Percentage Value of Task: 20%
Due: Friday 5 June 2020 @17:00 (week 11)
Minimum time expectation: 20 hours
Learning Outcomes Assessed
The following course learning outcomes are assessed by completing this assessment:
K1. Identify and use the correct syntax of a common programming language.
K2. Recall and use typical programming constructs to design and implement simple software solutions.
K3. Reproduce and adapt commonly used basic algorithms.
K4. Explain the importance of programming style concepts (documentation, mnemonic names, indentation)
S2. Write and implement a solution algorithm using basic programming constructs. S3. Demonstrate debugging and testing skills whilst writing code.
A1. Develop self-reliance and judgement in adapting algorithms to diverse contexts.
A2. Design and write program solutions to identified problems using accepted design constructs.
Assessment Details
Background
- https://www.wikiwand.com/en/Common_logarithm
- Newcomb, S. (1881). Note on the Frequency of Use of the Different Digits in Natural Numbers. American Journal of Mathematics, 4(1), 39-40.
sports statistics, molecular weights and so on – and it is base and scale invariant – the length of rivers could be in miles, kilometres, metres or even cubits.
Theory
Although you do not need to know the derivation[1] or proof of Benford’s law, all you need to know is how to apply it to a set of data.
Benford’s law states[2]:
Pr(D1 = d1) = log10(1+1/d1) d1 =1, 2,..., 9(Equation 1)
So that, for the first digit in a number, the probability that this digit is a ‘1’ is:
Pr(D1 = 1) = log10(1+1/1)
log10(2)
=0.3010
or about 30.1%.
Similarly for the remaining digits 2-9.
If we do this for all the digits and plot them as a bar graph, we get:
Your Task
Develop a Python program which will load up a set of data, determine the frequencies of the leading digits and compare them with the predicted distribution of Benford’s law. Display this in a bar chart and a table of values. For example:
Digit 1: Observed = 0.321 Expected = 0.301
Digit 2: Observed = 0.153 Expected = 0.176 and so on up till digit 9.
We shall look at three cases.
An Excel spreadsheet has been taken from Office-Watch: Benford’s Law and Excel[3] to let you quickly visualize the Python application that we need make.
Case 1 - Fibonacci series[4]
This series begins with two numbers 1,1 – these two numbers are added to continue the series giving rise to the following (only the first 8 terms of the series are shown here):
1,1,2,3,5,8,13,21,. . .
There are many examples of this pattern in Nature and the series is closely related to the Golden [5] ratio.
Using the Excel spreadsheet generate a Fibonacci series up to the 24th term and see if the first digits obey Benford’s Law. Does it get better if you add more terms?
The Chi-test[6] measures how close an actual value is to the expected value – the closer it is to 100% the closer the actual value is to the expected value. In our case, we are testing how close the frequency of each digit in our dataset is to Benford’s prediction for that digit.
What is the value of the ChiTest comparison for this Fibonacci series? Does it get better if we add more terms to the series?
Case 2 – Fibonacci numbers & Benford’s law using Python
In this case you are to repeat the analysis in Case 1 but using you Python code.
Case 3 – Length of Rivers[7] in the World
In this case, use your Python code to see whether the lengths of rivers in the world follow Benford’s law.
Fraud detection using Benford’s Law
One use of Benford’s Law is to detect cases of Fraud. Consider the 1993 case of State of Arizona v Nelson. The accused diverted nearly $2M to fake vendors in an attempt to defraud the State. The frequency of first digits in the written cheques clearly violates Benford’s Law leading to a conviction.
Another case is that of Enron in its posting of revenue for the year 2000. Comparison of the frequency of first digits versus the expected frequency shows large discrepancies. The company went bankrupt the following year – one of the greatest financial failures in history.
Submission
A report is to be submitted in this assignment. There is a discussion section in the report in which you can apply step 6 in the six-step problem solving process and ask the four questions often used in evaluating a solution.
More details on academic reports are available - please refer to this link:
There are three important parts at the link above:
1. General Guide to Writing and Study Skills
This section describes the content of a report – refer to page 34 – Abstract, Table of Contents, Introduction and Conclusion and so on.
- General Guide to Referencing
APA referencing style is described in this section – EndNote is also available to students
3. Assignment Layout and Appearance Guidelines
This section describes how the report should appear: margin sizes, fonts, how diagrams and tables are presented and so on.
You must supply your program source code files and your documentation, together with any files required to run your application, as a single zip file named as follows:
<YOUR-NAME>_<YOUR-STUDENT-ID>.zip
e.g. Ada_LOVELACE_30331815.zip
You may supply your word processed documentation in either Microsoft Word or LibreOffice/OpenOffice formats only – no proprietary Mac specific formats, please.
Assignments will be marked on the basis of fulfilment of the requirements and the quality of the work.
In addition to the marking criteria, marks may be deducted for failure to comply with the assignment requirements, including (but not limited to):
- Incomplete implementation(s), and
- Incomplete submissions (e.g. missing files), and
- Poor spelling and grammar.
You might be asked to demonstrate and explain your work.
Marking Criteria/Rubric
|
Task |
Mark | |
|
1 |
Pseudo-code for all Python scripts |
10 |
|
2 |
Final Python code (Exceptions 2 marks), annotated with author details and with comments throughout the code (2 marks), consistent with pseudo-code |
10 |
|
3 |
Tests to check that Python code is working correctly |
10 |
|
4 |
Case 1 - Fibonacci numbers using example Excel sheet |
5 |
|
5 |
Case 2 - Fibonacci numbers using your Python script – bar chart (10) & table (5) |
15 |
|
6 |
Case 3 - Lengths of Rivers using your Python script – bar chart (10) & table (5) |
15 |
|
7 |
Discussion (including 4 Questions in Step 6) |
15 |
|
8 |
Report: Abstract, Title Page, Table of Contents (including Figures & Tables), Introduction, Method, Results, Discussion (including the 4 Questions in Step 6 of problem solving), Acknowledgements & Statement of Authorship, References |
20 |
|
TOTAL |
100 | |
|
Final Grade |
20 |
[1]See, for example, Miller, S. J. (2015). A Quick Introduction to Benford’s Law. In S. J. Miller (Ed.), Benford's Law (pp. 3-22): Princeton University Press.
[2]Nigrini, M. J., & ProQuest (Firm). (2012). Benford's law applications for forensic accounting, auditing, and fraud detection, Wiley corporate F & A, p.5
[3]https://office-watch.com/2012/benfords-law-and-excel/
[4]https://en.wikipedia.org/wiki/Fibonacci_number
[5]https://en.wikipedia.org/wiki/Golden_ratio
[6]Also written as 2-test
