Professional Documents
Culture Documents
=
cells all e
e o
f
f f
c r
2
2
) (
) 1 )( 1 (
)
1 1
)( 1 (
) ( ) (
2 1
2 1 2 1
n n
p p
p p p p
Z
+
=
v v
2 1
2 1
n n
X X
p
+
+
=
Pacic Accounting Review Vol. 17, No. 1, June 2005 15
Table 2a
Extent of Agreement between the Temporal Model, Altmans Model and Auditors
Opinion in the Last Reporting Period Prior to Bankruptcy/Liquidation (Service
Industry)
Code 1 denotes either a bankrupt prediction or an audit not unqualied (see codes
below)
Firm
Number
Temporal Altman Auditor Firm
Number
Temporal Altman Auditor
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
1 0 28 1 1 0
2 1 1 1 29 1 0
3 1 0 0 30 1 1 0
4 1 0 1 31 1 1
5 0 1 32 1 1 1
6 1 1 1 31 1 0 0
7 1 0 0 34 0 0 0
8 1 1 1 35 0 0 0
9 1 1 1 36 1 1 0
10 0 0 0 37 1 0 0
11 1 0 38 1 1 0
12 1 1 0 39 1 0 1
13 1 0 40 1 1
14 0 1 1 41 0 0 0
15 1 1 42 1 0
16 1 1 43 0 1 1
17 1 1 1 44 1 1 0
18 0 1 1 45 1 0
19 1 1 1 46 1 0
20 1 1 1 47 1 1
21 1 1 1 48 0 1 1
22 1 1 1 49 0 1 0
23 1 1 0 50 0 1 1
24 1 0 0 51 0 0 0
25 1 1 0 52 0 1 1
26 1 0 0 53 1 1
27 0 1 54 0 0 0
Number of Bankrupt Predictions/Opinions 38 28 24
Total Number of Predictions/Opinions Reported 53 43 50
*Auditors Opinion Code (AUOP Compustat code)
0=unadited => blank 3=no opinion => code 1
1=unqualied => code 0 4=unqualied with additional explanatory
language added => code 1
2=qualied => code 1 5=adverse opinion = code 1
Altmans Multiple Discrimination Analysis
Model (1968) Zscore:
Cybinskis Temporal Model (1998) Risk of
Bankruptcy:
A Zscore (>1.8) is classied as not bankrupt
=> code 0
Probability less than 0.5 => code 0
A Zscore (<1.8) is classied as bankrupt =>
code 1
Probability greater than 0.5 => code 1
16 Pacic Accounting Review
Table 2b
Extent of Agreement between the Temporal Model, Altmans Model and Auditors
Opinion in the Last Reporting Period Prior to Bankruptcy/Liquidation (Trade
Industry)
Code 1 denotes either a bankrupt prediction or an audit not unqualied (see codes
below)
Firm
Number
Temporal Altman Auditor Firm
Number
Temporal Altman Auditor
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
1 1 29 0 1 0
2 1 30 1
3 1 31 0 1 0
4 0 32 1 1
5 1 33 1 1
6 0 0 34 0 0
7 1 35 0 0
8 1 36 1 0 0
9 1 37 1 0
10 1 38 1 0 0
11 1 39 1 1 0
12 1 0 0 40 0 0
13 1 0 0 41 0
14 0 0 42 0 0
15 0 0 43 1 0
16 1 1 44 1 1
17 0 0 45 1 1 1
18 0 0 0 46 0
19 0 0 47 0 0
20 1 48 1 0
21 0 49 1 1 1
22 1 50 1 1
23 0 51 0 1 0
24 0 52 1 0 0
25 1 53 1 1 0
26 1 1 0 54 0 1
27 1 0 55 0 1
28 1 0 0
Number of Bankrupt Predictions/Opinions 29 6 7
Total Number of Predictions/Opinions Reported 43 28 31
*Auditors Opinion Code (AUOP Compustat code)
0=unadited => blank 3=no opinion => code 1
1=unqualied => code 0 4=unqualied with additional explanatory
language added => code 1
2=qualied => code 1 5=adverse opinion = code 1
Altmans Multiple Discrimination Analysis
Model (1968) Zscore:
Cybinskis Temporal Model (1998) Risk of
Bankruptcy:
A Zscore (>1.8) is classied as not bankrupt
=> code 0
Probability less than 0.5 => code 0
A Zscore (<1.8) is classied as bankrupt =>
code 1
Probability greater than 0.5 => code 1
Pacic Accounting Review Vol. 17, No. 1, June 2005 17
Table 2c
Extent of Agreement between the Temporal Model, Altmans Model and Auditors
Opinion in the Second Last Reporting Period Prior to Bankruptcy/Liquidation
(Service Industry)
Code 1 denotes either a bankrupt prediction or an audit not unqualied (see codes
below)
Firm
Number
Temporal Altman Auditor Firm
Number
Temporal Altman Auditor
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
1 1 0 28 0 0 0
2 0 1 1 29 0
3 0 0 0 30 1 0 0
4 0 31 0
5 0 1 32 0
6 1 0 1 33 1 1 0
7 0 0 0 34 0 0 0
8 1 35 0 0 0
9 0 36 1 1 0
10 1 0 0 37 1 1 0
11 1 0 0 38 1 1 0
12 1 39 0 0 0
13 0 0 40 0 1 0
14 0 1 1 41 0
15 1 1 42 1 0 1
16 0 1 1 43 0 1 1
17 1 1 44 1 1 1
18 1 1 1 45 0 0
19 0 0 0 46 1 0 0
20 0 0 0 47 0
21 0 0 1 48 0
22 1 1 1 49 0 0 0
23 0 1 0 50 1 1 0
24 1 0 0 51 0 0 0
25 0 0 0 52 1 0 0
26 1 0 0 53 1 1 0
27 0 1 1 54 0
Number of Bankrupt Predictions/Opinions 23 17 13
Total Number of Predictions/Opinions Reported 54 38 43
*Auditors Opinion Code (AUOP Compustat code)
0=unadited => blank 3=no opinion => code 1
1=unqualied => code 0 4=unqualied with additional explanatory
language added => code 1
2=qualied => code 1 5=adverse opinion = code 1
Altmans Multiple Discrimination Analysis
Model (1968) Zscore:
Cybinskis Temporal Model (1998) Risk of
Bankruptcy:
A Zscore (>1.8) is classied as not bankrupt
=> code 0
Probability less than 0.5 => code 0
A Zscore (<1.8) is classied as bankrupt =>
code 1
Probability greater than 0.5 => code 1
18 Pacic Accounting Review
Table 2d
Extent of Agreement between the Temporal Model, Altmans Model and Auditors
Opinion in the Second Last Reporting Period Prior to Bankruptcy/ Liquidation
(Trade Industry)
Code 1 denotes either a bankrupt prediction or an audit not unqualied (see codes
below)
Firm
Number
Temporal Altman Auditor Firm
Number
Temporal Altman Auditor
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
Prob>0.5 Zscore<1.8
not
unqualied
opinion*
1 0 30 0 1
2 1 31 1 1 0
3 0 32 0
4 0 33 0 0 0
5 0 1 34 1 1 1
6 1 0 0 35 0 1
7 0 36 0
8 0 37 0 0 0
9 0 0 38 0 0
10 0 39 1 0 0
11 1 40 1
12 1 0 0 41 1 0 0
13 0 0 0 42 0 0
14 0 1 43 0 0
15 0 1 44 0
16 0 1 45 0 0 0
17 0 0 46 1
18 0 0 0 47 0 1 1
19 0 0 48 0
20 0 1 0 49 0
21 0 0 50 1 0 0
22 1 51 1 1 1
23 1 1 0 52 1
24 0 53 0 0 0
25 1 54 0 0 0
26 1 0 0 55 0 0 0
27 0 1 0 56 1
28 0 0 57 1 0 1
29 1
Number of Bankrupt Predictions/Opinions 20 8 9
Total Number of Predictions/Opinions Reported 46 33 36
*Auditors Opinion Code (AUOP Compustat code)
0=unadited => blank 3=no opinion => code 1
1=unqualied => code 0 4=unqualied with additional explanatory
language added => code 1
2=qualied => code 1 5=adverse opinion = code 1
Altmans Multiple Discrimination Analysis
Model (1968) Zscore:
Cybinskis Temporal Model (1998) Risk of
Bankruptcy:
A Zscore (>1.8) is classied as not bankrupt
=> code 0
Probability less than 0.5 => code 0
A Zscore (<1.8) is classied as bankrupt =>
code 1
Probability greater than 0.5 => code 1
Pacic Accounting Review Vol. 17, No. 1, June 2005 19
Next, pairwise comparisons of the three decision entities can be made as shown in
Tables 3a-3d by cross-tabulating the binary decision outcome and applying the chi-
square test for independence (or non-agreement) for each pair of decision-makers
10
.
Note the data is reduced here to just those rms for which complete data exists for
both decisions.
As a test of independence now, the null and alternative hypotheses are:
H
0
: The two categorical variables (binary decision sets for each entity)
are independent (ie. there is no relationship between them).
11
against the alternative:
H
1
: The two categorical variables are dependent (ie. they are related in
that they predominately agree or predominately disagree).
12
Note that the rule of ve applies for both a chi-squared test of a multinomial experiment
in Tables 2a-2d, as well as for a chi-squared test of independence (contingency
table) in Tables 3a-3d. The expected values should be at least ve to ensure that the
(continuous) chi-squared distribution provides an adequate approximation of the
(discrete) sampling distribution. Note that if an observed value is less than ve it is
possible that the expected value may be ve or greater and the rule is still satised.
Where possible, cells can be combined in order to satisfy this rule.
13
The rule of ve
is satised here for all of the cells in Tables 3a-3b (i.e. for the Service Industry data)
but not for all cells of the Trade Industry tables in Tables 3c-3d where Fishers Exact
Test may be applied using the hypergeometric distribution, or a Mantel-Haenszel
Chi-Squared Test is applied (see Conover 3
rd
ed. 1999, pp.188-193).
10
Note that the two extreme cases that would result in rejection of the null hypothesis of independance is
actually that either all of the decisions agree (+ve agreement) or all disagree (ve agreement).
11
This implies that their joint probability is equal to the product of their marginal probabilities of occurrence
and conditional probabilities do not enter the formula. If the null hypothesis cannot be rejected, this means
that the data shows no evidence of any relationship (either +ve or ve agreement) between the decision
entities.
12
Hence it is a two-tailed test of independence. If signicant, one gauges whether the direction of agreement
is positive or negative by the ratio of agreements: disagreements in the table.
13
Note that the rule of ve is somewhat conservative. A discussion of alternatives to the rule of ve can
be found in Conover (1971, p.152) and in Siegel (1956, p.178).
20 Pacic Accounting Review
Table 3a
Chi-Squared Tests for Independence of Two Categories/Variables in the Last
Reporting Period before Bankruptcy/Liquidation (Service Industry).
In each case H
0
: The two categories are independent (ie. not generally related) vs.
H
1
: the two categories are not independent
(ie. they are related - the predictions/opinions either predominantly agree
or predominantly disagree).
Contingency Tables
Data taken from nancial reports tendered in the last reporting period prior to
bankruptcy/liquidation
Temporal model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Temporal Not bankrupt 7 8 15
Model Bankrupt 18 16 34
Predictions Total 25 24 49
Test Statistic Chi-Squared = 0.16
P-Value = 0.69
Ratio of Agreements: Disagreements 23:26
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Temporal model predictions vs Altman model predictions
Altman Model Predictions
Not bankrupt Bankrupt
Total
Temporal Not Bankrupt 6 7 13
Model Bankrupt 9 21 30
Predictions Total 15 28 43
Test Statistic Chi-Squared = 1.04.
P-Value = 0.31
Ratio of Agreements: Disagreements 27:16
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Altman model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Altman Model Not bankrupt 12 2* 14
Predictions Bankrupt 9 16 25
Total 21 18 39
Test Statistic Chi-Squared = 8.9
P-Value = 0.003
Ratio of Agreements: Disagreements 28:11
Conclusion: Not Independent/Predominant Agreement the outcomes of the two
decision entities are related.
*
Note: the expected value of this cell is 6.5 > 5 so Chi-Squared is valid under the Rule of Five.
Pacic Accounting Review Vol. 17, No. 1, June 2005 21
Table 3b
Chi-Squared Tests for Independence of Two Categories/Variables in the Second
Last Reporting Period before Bankruptcy/Liquidation (Service Industry).
In each case H
0
: The two categories are independent (ie. not generally related) vs.
H
1
: the two categories are not independent
(ie. they are related - the predictions/opinions either predominantly agree
or predominantly disagree).
Temporal model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Temporal Not bankrupt 16 7 23
Model Bankrupt 14 6 20
Predictions Total 30 13 43
Test Statistic Chi-Squared = 0.001
P-Value = 0.98
Ratio of Agreements: Disagreements 22:21
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Temporal model predictions vs Altman model predictions
Altman Model Predictions
Not bankrupt Bankrupt
Total
Temporal Not Bankrupt 12 7 19
Model Bankrupt 9 10 19
Predictions Total 21 17 38
Test Statistic Chi-Squared = 0.96
P-Value = 0.33
Ratio of Agreements: Disagreements 22:16
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Altman model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Altman Model Not bankrupt 18 3* 21
Predictions Bankrupt 8 8 16
Total 26 11 37
Test Statistic Chi-Squared = 5.54
P-Value = 0.02
Ratio of Agreements: Disagreements 26:11
Conclusion: Not Independent/Predominant Agreement the outcomes of the two
decision entities are related.
*
Note: the expected value of this cell is 6.5 > 5 so Chi-Squared is valid under the Rule of Five.
22 Pacic Accounting Review
Table 3c
Chi-Squared Tests for Independence of Two Categories/Variables in the Last
Reporting Period before Bankruptcy/Liquidation (Trade Industry).
In each case H
0
: The two categories are independent (ie. not generally related) vs.
H
1
: the two categories are not independent
(ie. they are related - the predictions/opinions either predominantly agree
or predominantly disagree).
Temporal model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Temporal Not bankrupt 4* 0* 4
Model Bankrupt 12 3* 15
Predictions Total 16 3 19
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 0.9
P-Value 0.98 P-Value = 0.34
Ratio of Agreements: Disagreements 7:12
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Temporal model predictions vs Altman model predictions
Altman Model Predictions
Not bankrupt Bankrupt
Total
Temporal Not Bankrupt 3* 1* 4
Model Bankrupt 10 3* 13
Predictions Total 13 4 17
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 0.006
P-Value 1.0 P-Value = 0.94
Ratio of Agreements: Disagreements 6:11
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Altman model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Altman Model Not bankrupt 21 1* 22
Predictions Bankrupt 2* 4 6
Total 23 5 28
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 11.96
P-Value 0.003 P-Value = 0.0005
Ratio of Agreements: Disagreements 25:3
Conclusion: Not Independent/Predominant Agreement the outcomes of the two
decision entities are related.
*
Note: the expected values of the asterisked cells are <5 so a Chi-Squared Test of Independence is not
valid. Both a Fishers Exact Test and a Mantel-Haenszel Chi-Sqaured Test are valid.
Pacic Accounting Review Vol. 17, No. 1, June 2005 23
Table 3d
Chi-Squared Tests for Independence of Two Categories/Variables in the Second
Last Reporting Period before Bankruptcy/Liquidation (Trade Industry).
In each case H
0
: The two categories are independent (ie. not generally related) vs.
H
1
: the two categories are not independent
(ie. they are related - the predictions/opinions either predominantly agree
or predominantly disagree).
Temporal model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Temporal Not bankrupt 11 3* 14
Model Bankrupt 8 3* 11
Predictions Total 19 6 25
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 0.11
P-Value 1.0 P-Value = 0.74
Ratio of Agreements: Disagreements 14:11
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Temporal model predictions vs Altman model predictions
Altman Model Predictions
Not bankrupt Bankrupt
Total
Temporal Not Bankrupt 8 3* 11
Model Bankrupt 7 4* 11
Predictions Total 11 7 22
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 0.2
P-Value 1.0 P-Value = 0.65
Ratio of Agreements: Disagreements 12:10
Conclusion: Independent. Neither the number of agreements or disagreements are
signicantly large enough to reject the hypothesis that the outcomes of the two decision
entities are unrelated.
Altman model predictions vs Auditors opinion
Auditor Opinion
Unqualied Not Unqualied
Total
Altman Model Not bankrupt 21 4 25
Predictions Bankrupt 5 3* 8
Total 26 7 33
Test Statistic Fishers Mantel-Haentszel Chi-
Exact Test Squared = 1.63
P-Value 0.32 P-Value = 0.20
Ratio of Agreements: Disagreements 24:9
Conclusion: Not Independent/Predominant Agreement the outcomes of the two
decision entities are related.
*
Note: the expected values of the asterisked cells are <5 so a Chi-Squared Test of Independence is not
valid. Both a Fishers Exact Test and a Mantel-Haenszel Chi-Sqaured Test are valid.
24 Pacic Accounting Review
(6) RESULTS
For both industry datasets in the last reporting period before bankruptcy/liquidation,
the binary decision outcomes are summarized in Table 4a below.
Table 4a
Summary of binary decision outcomes in the last reporting period before
bankruptcy/liquidation
SERVICE INDUSTRY DATASET
Temporal
Model
Altman
Model
Auditor's
Opinion
Number of Bankrupt Predictions/Not Unqualied Opinions 38 72% 28 65% 24 48%
Number of Nonbankrupt Predictions/Unqualied Opinions 15 15 26
Total Number of Predictions/Opinions Reported 53 43 50
TRADE INDUSTRY DATASET
Temporal
Model
Altman
Model
Auditor's
Opinion
Number of Bankrupt Predictions/Not Unqualied Opinions 29 67% 6 21% 7 23%
Number of Nonbankrupt Predictions/Unqualied Opinions 14 22 24
Total Number of Predictions/Opinions Reported 43 28 31
For both industry datasets in the second-last reporting period before bankruptcy/
liquidation, the binary decision outcomes are summarized in Table 4b below.
Table 4b
Summary of binary decision outcomes in the second last reporting period before
bankruptcy/liquidation
SERVICE INDUSTRY DATASET
Temporal
Model
Altman
Model
Auditor's
Opinion
Number of Bankrupt Predictions/Not Unqualied Opinions 23 43% 17 45% 13 30%
Number of Nonbankrupt Predictions/Unqualied Opinions 31 21 30
Total Number of Predictions/Opinions Reported 54 38 43
TRADE INDUSTRY DATASET
Temporal
Model
Altman
Model
Auditor's
Opinion
Number of Bankrupt Predictions/Not Unqualied Opinions 20 43% 8 24% 9 25%
Number of Nonbankrupt Predictions/Unqualied Opinions 26 25 27
Total Number of Predictions/Opinions Reported 46 33 36
Tables 2a and 2b show the extent of agreement between the temporal model, Altmans
model and the auditors opinion for individual rms in the last reporting period prior
to bankruptcy/liquidation for the service industry and the trade industry datasets
respectively. Table 4a shows that the temporal model identied 72% of the service
industry bankrupt rms as distressed
14
at this time compared with 65% for the Altman
model, whilst only 48% of the audited bankrupt rms were denied an unqualied
going concern opinion by the auditor.
14
The denition of distressed here is having a bankruptcy risk estimate greater than 0.5.
Pacic Accounting Review Vol. 17, No. 1, June 2005 25
With regards to the last comparison, it is worth pointing out that the auditor is given
an advantageous position (as explained next) and nevertheless, still showed the lowest
percentage of correct decisions. Firstly, if a company is in the process of liquidation at the
time of submitting their nancial reports, Standard and Poors assigns a qualied code
regardless, even if the opinion is not actually qualied. The authors are not able to know
to what extent this occurred for the companies in the datasets used here. Secondly, if the
auditor refuses to express an opinion regarding the companys ability to sustain operations
as a going concern, it is also regarded as not unqualied (i.e. code 1 in this study) as the
authors have regarded non-commital as a denial, to some extent, of an unqualied report.
So, in both instances, since we are dealing with just bankrupt rms, the auditor would have
been coded with a correct decision without actually having made a decision.
Notwithstanding the above, the null hypothesis of equal proportions of correct
decisions by the three decision entities is rejected at the .04 level of signicance [
2
2
=
6.42, p=0.040]. The follow-up Z-tests, for paired differences in the overall proportion
of correct decisions made, show that outcomes from the temporal model and Altmans
model are not statistically signicantly different from each other [Z=0.69, p=0.49] and
that both give signicantly higher correct classications than the auditors [p=0.007,
p= 0.049 respectively].
Tables 2c and 2d show the gures for the second last reporting period before failure
for the service industry and trade industry datasets respectively. The accuracy of the
decision is not as straightforward here as in the nal year before failure since the
rms all survived another reporting period. Note that the temporal model is based on
discriminations between rms in their previous surviving years against their nal year
before bankruptcy so a not bankrupt decision is a correct classication at this time
within that model structure. A bankrupt decision therefore signals that the rm is
already in trouble despite its continued survival. Altman (1968), on the other hand,
used his model to ascertain whether a rm would fail for up to 5 periods into the future
(though he noted it was accurate for up to only two periods, p. 604).
Table 4b shows that, for the service industry dataset, Altmans model signalled
bankruptcy for 45% of the bankrupt rms two reporting periods prior to bankruptcy,
whereas the temporal model gure was 43%, and only 30% of the audited rms
were denied an unqualied going concern opinion. Whether such comparisons
are meaningful or not, there was not enough evidence in the data to reject the null
hypothesis of equal proportions of bankrupt/not unqualied decisions made by the
three decision entities [
2
2
=2.2, p=0.33].
Table 4a shows that for the out-of-sample predictions using the trade industry dataset,
in the nal reporting period before failure, the temporal model still identied 67%
26 Pacic Accounting Review
of these bankrupt rms as failing even though the model was formulated specically
for the service industry. This compared with only 21% for the Altman model also
formulated on a different sample of manufacturing rms, while just 23% of the audited
bankrupt rms were denied an unqualied going-concern opinion by the auditor.
There is a statistically signicant difference in prediction accuracy here, with the
null hypothesis of equal proportions of correct decisions by the three decision entities
rejected [
2
2
= 21.2, p<0.0001], and the temporal model outperforming the other two
decision entities [both p<0.0001].
For the trade industry dataset at two reporting periods prior to bankruptcy, the temporal
model signalled bankruptcy for 43% of the bankrupt rms, whereas Altmans model
gure was 24%, and 25% of the audited rms were denied an unqualied going-
concern opinion at this time. The null hypothesis of equal proportions of bankrupt/not
unqualied decisions made by the three decision entities can be rejected at the 10%
level of signicance but not the 5% level [
2
2
=5, p= 0.08], but the statistically more
powerful pairwise Z-test comparisons show that the decisions of the auditor and the
Altman model are not statistically signicantly different from each other [Z=0.07,
p= 0.94] whereas the temporal model again signals more bankruptcies than the other
two entities [both p=0.04].
Tables 3a-3d give pairwise cross-tabulations of the binary decisions of the three
decision-entities and the respective tests for independence (no relationship) for each
pair. For the trade industry dataset, there were too many missing values and too few
bankrupt decisions arising from both Altmans model and the auditors to give valid
chi-squared tests of independence with the temporal model for paired contingency
tables in both nal reporting periods. Consequently other nonparametric tests have
been employed here
15
as detailed in the Analysis section above.
For pairwise comparisons between the temporal model and the other two decision
entities, for both the nal reporting periods before failure and for both the service
industry and the trade industry datasets, there is not enough evidence to reject the
null hypothesis that the decision outcomes are unrelated. In other words, they dont
consistently agree or disagree [all p>0.33]. In contrast, for the comparisons between
the auditors decisions and Altmans atemporal model, there is predominant agreement
[p<.02]. The only exception occurs in the second last reporting period for the trade
industry dataset where the total number of agreements for the sample size of 33 is
not signicantly large enough to reject the hypothesis that the decision outcomes of
15
The actual distribution of the test statistic is discrete and can be approximated by a continuous chi-
squared distribution when the sample size is large. However, the approximation is poor if the expected cell
frequencies are small (the rule of ve convention is that no more than 20% of cell frequencies less than
ve). Fishers Exact Test or a Mantel-Haenszel Test is appropriate in these cases.
Pacic Accounting Review Vol. 17, No. 1, June 2005 27
the auditors and from Altmans model are unrelated [p=0.32]. Nevertheless, for this
comparison, the ratio of agreements:disagreements is 24:9 and agreement does occur
predominantly on nonbankrupt/unqualied decisions (21 of the 24 agreements).
(7) DISCUSSION
The macroeconomic environment of rms has largely been excluded from empirical
analyses of business failure. This may explain the inconsistencies in the prediction
accuracy of the various bankruptcy models when they are applied to more recent
data, as well as auditors reluctance to rely more on them in a going-concern decision.
Based on the ndings of this study, we suggest here that the auditors could indeed
have beneted from the information supplied by the bankruptcy models. In the nal
reporting period for the service industry dataset, this study has shown that with respect
to the total percentage of accurate decisions, both bankruptcy models outperform the
auditor. Moreover, on comparing both models against the auditors opinions we nd
that in the nal reporting period before bankruptcy, the temporal model gave superior
prediction accuracy on both datasets (i.e. including the holdout dataset).
In the second last reporting period before bankruptcy, we nd that the margin of
difference in prediction accuracy between the bankruptcy models and the auditors
opinions is reduced and it is signicantly different only for the trade industry dataset
and only between the temporal model and the auditors (43% to 25% resp.) .
It is not surprising, then, to nd that there is no overall agreement between the temporal
model and both the other decision models on individual rm decisions in both reporting
periods before failure. They clearly signal different rms as failing.
For the service industry dataset, the Type I (false negative) error rate for the temporal
model was 28% in the nal reporting period before failure. In other words the model
classied slightly more than a quarter of the bankrupt rms as not distressed or
able to survive another reporting period. This compares with 35% of the bankrupt
rms predicted as not bankrupt by the Altman model and slightly more than half
given an unqualied going-concern opinion by the auditors. The differences in Type
I errors were even more startling for the trade industry dataset that was out-of-sample
for both the Altman model and the temporal model formulations; one third for the
temporal model compared to 79% for the Altman model and 77% for the auditors.
The temporal model correctly classied more of the (bankrupt) rms as risking failure
in the next year for both its estimation sample (as expected) and for another holdout
sample of rms, and the difference was statistically signicant in all but one case.
28 Pacic Accounting Review
This study also found that the Altman model and the auditors agree more often on
individual rms. There is consistently strong agreement across three of the four
comparison tables between the auditors and the Altman model [p<.003, p<.003,
p<.02 respectively]. Both decision entities predominantly make nonbankrupt/
unqualied decisions and they both agree on 70-89% of all their decisions. These
results could indicate that they both have a bankrupt/not unqualied outcome for
only the most distressed rms, i.e., those with a very high risk of bankruptcy in the
temporal model.
Clearly, the higher bankruptcy classication rates for the temporal model would
suggest that, for a sample of distressed or problem companies at least, a more complex
failed-rm model including macroeconomic factors in its formulation can perform
far better than an atemporal model or the auditors decision process, especially in
providing support in the form of a risk assessment.
(8) CONCLUSION
Professional audit standards require auditors to understand the client entity and
its economic environment by using various operating indicators such as nancial
indicators and management attributes and/or deciencies. There is no professional
requirement for any more sophisticated analysis of the entitys business environment
using statistical modelling. The problem with using operating indicators is that they
provide only a simplistic and static measure of the entitys business environment when
auditors are supposed to give a going-concern opinion that in reality predicts the
entitys viability or otherwise (for 12 months). It is argued that a bankruptcy model
that includes a temporal approach can provide a sophisticated tool to assist forming
a going-concern opinion and complement the auditors professional judgement.
This study has shown that newer models like the temporal model presented by Cybinski
(2000, 2003) can improve decision accuracy over the static or atemporal models of
the past, when used as an adjunct to the auditors tools in the going-concern decision.
One reason is simply because they are more sensitive to changing macroeconomic
conditions and how they impact on distressed rms. Hence temporal models are
more useful for out-of-sample predictions of distress (or bankruptcy risk), although
we need always to be mindful of limitations due to external validity concerns when
using models for the assessment of a particular rms insolvency risk (other than in the
industry in which the model was estimated and, in the case of the Cybinski temporal
model, for other than failed rms). Nevertheless these limitations do not preclude the
application of these models in a practical way when researchers/auditors use them for
explanatory purposes rather than for forecasting - as a decision support.
Pacic Accounting Review Vol. 17, No. 1, June 2005 29
Although exploratory in nature, the formulation of a temporal model for failure risk is
informative concerning the possible comparative effects of the internal ratios and the
external economy on failure risk and the means of examining these effects together.
The fact that reasonable results were obtained when a particular temporal model for
the service industry was applied to the trade industry group is an encouraging result
for testing external validity of such models in future research.
Improved bankruptcy modelling will also, no doubt, engender greater public
condence in auditor objectivity with the professional use of quantitative decision
support. Current audit procedures require the auditor to trust client management
for information in an intensive interactive relationship, which has led to standards
that focus on prescriptive behavioural parameters for that relationship (Windsor and
Ashkanasy 1995). Rather than introducing more of the same in the imminent revision
of auditing standards, the inclusion of sophisticated and objective approaches to audit
procedures such as statistical modelling should be seriously considered. This would
allow for a more impartial analysis of the client rm in a more holistic environment
and provide an opportunity for auditors to increase their professional decision-making
expertise.
30 Pacic Accounting Review
REFERENCES
AICPA, 2001. Codication of Statements on Auditing Standard, (AICPA, New York).
Altman, E., 1968. Financial ratios, discriminant analysis and the prediction of corporate bankruptcy. Journal
of Finance, 23(4), (September), 589 609.
Altman, E.I., 1982. Accounting implications of failure prediction models, Journal of Accounting, Auditing
and Finance, (Fall), 4-19.
Altman, E., Haldeman, R., and P. Narayan, 1977. Zeta analysis. Journal of Banking and Finance, (June),
29-54.
Altman, E.I. and T.P. McGough, 1974. Evaluation of a company as a going concern. Journal of Accountancy,
(December), 50-57.
AICPA, 1978. The Commission on Auditors Responsibilities: Report, Conclusions, and Recommendations
(AICPA).
Aziz, A., Emanuel, D.C., and Lawson, G.H.,1988. Bankruptcy prediction an investigation of cash ow
based models. Journal of Management Studies, 25, 5, (September), 419 437.
Beaver, W.H., 1966. Financial ratios as predictors of failure. Journal of Accounting Research (Supplement),
71-111.
Browning, L., 6 February, 2005. Sorry, said the auditor, but we want a divorce. The New York Times,
Business (http://www.nytimes.com).
Bryan, D., S.L.Tiras, and C.M. Wheatley, 2000. The relation of audit opinion and auditor change with
bankruptcy emergence. Paper presented at 2001 AAA Audit Section Midyear Meeting.
Casterella, J.R., B.L. Lewis, and P.L. Walker, 2000. Modelling the audit opinions issued to bankrupt
companies: a two-stage empirical analysis. Decision Sciences, 31 (2) (Spring).
Casey, C. and N. Bartczak, 1984. Cash ow -its not the bottom line. Harvard Business Review (July-
August), 61-66.
Casey, C. and N. Bartczak, 1985. Using operating cash ow data to predict nancial distress: some
extensions. Journal of Accounting Research, (Spring), 384-401.
Chen, K.C.W., and B.K.Church, 1992. Default on debt obligations and the issuance of going-concern
opinions. Auditing: A Journal of Practice & Theory, 11(2), 30-49.
Chen, K. and T. Shimerda, 1981. An empirical analysis of useful nancial ratios. Financial Management
10, 1(Spring),51-60.
Conover, W.J., 1971. Practical nonparametric statistics, (John Wiley, New York)
Conover, WJ, 1999. Practical nonparametric statistics, 3rd ed. (John Wiley, New York)
Cybinski, P.J., 2003. Doomed rms: an econometric analysis of the path to failure, Ashgate Publishing
Ltd., UK.
Pacic Accounting Review Vol. 17, No. 1, June 2005 31
Cybinski, P.J., and J.Forster, 2002. The macroeconomic environment and the process of business failure:
explorations with U.S. rms in an economically volatile period, 1974-1988. International Journal of
Business and Economics, 2 (1),(Fall), 13-23.
Cybinski, P.J., 2000. The path to failure: where are bankruptcy studies at now. Journal of Business and
Management, 7 (1), Spring, 11-39.
Day, K. and A.B. Crenshaw, 16 January, 2002. SEC, Accounting rms redrafting audit rules. Washington
Post, E01.
Deakin, E.B., 1972. A discriminant analysis of predictors of business failure. Journal of Accounting
Research, (Spring), 167 179.
Dimitras, A.I., S.H.Zanakis, and C. Zopounidis, 1996. A survey of business failures with an emphasis
on prediction methods and industrial applications. European Journal of Operational Research, 90, 487-
513.
Dugan, M.V., and C.V.Zavgren, 1989. How a bankruptcy model could be incorporated as an analytical
procedure. CPA Journal, (May), 64-65.
Gadenne, D., and E.R. Iselin, 1996. The role of accounting and nance information in nancial distress
prediction: a study of auditors, bankers and security analysts. Pacic Accounting Review, 8 (2), December,
45-68.
Gentry, J.A., P. Newbold, and D.T. Whitford, 1985. Classifying bankrupt rms with funds ow components.
Journal of Accounting Research, (Spring),146-160.
Geordgiades, G., 2001. Miller GAAS Practice, Current SASs, SSAEs and SSARSs in Practice Manual,
(Aspen Law & Business, New York).
Gilbert, L.R., K. Menon, and K.B. Schwartz, 1990. Predicting bankruptcy for rms in nancial distress.
Journal of Business Finance and Accounting,17, 1 (Spring), 161-171.
Graham, L.E., J. Damens, and G. Van Ness, 1991. Developing risk advisor: an expert system for risk
identication. Auditing: A Journal of Practice & Theory, (Spring), 69-96.
Hill, N.T., S.E. Perry, and S. Andes, 1996. Evaluating rms in nancial distress: an event history analysis.
Journal of Applied Business Research, 12 (3) 60-71.
Hopwood, W., J.C. McKeown, and J.F. Mutchler, 1994. A reexamination of auditor versus model accuracy
within the context of the going-concern opinion decision. Contemporary Accounting Research, (Spring),
409-431.
Houghton, K.A., 1984. Accounting data and the prediction of business failure: the setting of priors and the
age of data. Journal of Accounting Research, 22(1), Spring, 361-368.
International Federation of Accountants, 1989. Going concern. International Auditing Guideline, 23,
(revised October).
Johnson, V.E. and L.K. Khurana, 1993. Companies in trouble: what are the auditors responsibilities?
Journal of Commercial Lending, 76 (4) 52-57.
32 Pacic Accounting Review
Jones, F.L., 1987. Current techniques in bankruptcy prediction. Journal of Accounting Literature, 131-
164.
Kane,G., P. Graybeal, and F. Richardson, 1996. Recession-induced stress and the prediction of corporate
failure. Contemporary Accounting Research, 13 (2), Fall, 631-650.
Kida, T., 1980. An investigation into auditors continuity and related qualication judgements. Journal of
Accounting Research, (Autumn), 506-523.
Ketz, J.E., and R.F. Kochanek, 1982. Cash ow: assessing a companys real nancial health. Financial
Executive, July, 34-40.
Koh, H.C., and L.N. Killough, 1990. The use of multiple discriminant analysis in the assessment of the
going-concern status of an audit client. Journal of Business Finance and Accounting, (Spring), 178-192.
Koh, H.C., and J.C., Oliga, 1990. More on AUP17 and going-concern prediction models. Australian
Accountant (October) 67-71.
Labaton, S., 16th November 2003. S.E.C.s Oversight of mutual funds is said to be lax. New York Times,
(http://www.nytimes.com/2003/11/16/business/16FUND).
Largay, J.A., and C.P. Stickney, 1980. Cash ows, ratio analysis and the W.T.Grant Company bankruptcy.
Financial Analysts Journal, July-August, 51-54.
Lev, B., 1974. Financial statement analysis: a new approach, (Prentice Hall, Inc. Englewood Cliffs
N.J.)
Levitan, A.S., and J.A. Knoblett, 1985. Indicators of exceptions to the going concern assumption. Auditing:
A Journal of Practice & Theory (Fall), 26-39.
Louwers, T.J., 1998. The relation between going-concern opinions and the auditors loss function. Journal
of Accounting Research 36 (1), Spring.
McKeown, J.C., J.F. Mutchler, and W. Hopwood, 1991. Towards an explanation of auditor failure to modify
the audit opinions of bankrupt companies. Auditing: A Journal of Practice & Theory, 10, supplement,
1-13.
Mahzin,R.,1988. Predicting bankruptcy with an electronic spreadsheet. Journal of Accountancy,
(January),.98-102.
Martin, D., 1977. Early warning of bank failure. Journal of Banking and Finance, 1, 249 276.
Menon, K. and K.Schwartz, 1986. The auditors report for companies facing bankruptcy. The Journal of
Commercial Bank Lending, (January), 42-52.
Mensah, Y.M., 1984. An examination of the stationarity of multivariate bankruptcy prediction models: a
methodological study. Journal of Accounting Research, 22, 1, (Spring), 380-395.
Mutchler, J.F., W. Hopwood, and J.C. McKeown, 1997. The inuence of contrary information and
mitigating factors on audit opinion decisions on bankrupt companies. Journal of Accounting Research,
35 (2), 295-310.
Pacic Accounting Review Vol. 17, No. 1, June 2005 33
Ohlsen, J.,1980. Financial ratios and the probabilistic prediction of bankruptcy. Journal of Accounting
Research, (Spring),109 131.
Partington, G.H., M. Peat, and M.J. Stevenson, 1991. Predicting the probability and timing of corporate
nancial distress: preliminary results for the Australian sector. SABE Working Paper: 91/10, University
College of North Wales, Bangor, U.K.
Pearlstein, S., and P. Behr, 2nd December, 2001. At Enron, the fall came quickly. Washington Post, A01.
Press, S.J., and S. Wilson, 1978. Choosing between logistic regression and discriminant analysis. Journal
of the American Statistical Association, 73, (December), 699 705.
Raghunathan, K., B.L. Lewis, and J.H. Evans III., 1994. An empirical investigation of problem audits.
Research in Accounting Regulation, 8, 33-58.
Richardson, F.M.,G.D. Kane, and P.Lobingier, 1998. The impact of recession on the prediction of corporate
failure. Journal of Business Finance & Accounting, 5(1/2), 167-186
Rose, P.S., W.T. Andrews, and G.A. Giroux, 1982. Predicting business failure: a macroeconomic perspective.
Journal of Accounting, Auditing and Finance, 6, (Fall), 20-31.
Siegel, S., 1956. Nonparametric statistics for the behavioral sciences, (McGraw-Hill, New York)
Simnett, R., and K.Trotman, 1989. Auditor versus model: information choice and information processing.
The Accounting Review, 64(3), 514-528.
Tafer, R.J., 1984. Empirical methods for the monitoring of U.K. corporations. Journal of Banking and
Finance, (June), 199-227.
Theodossiou, P.T., 1993. Predicting shifts in the mean of a multivariate time series process: an application
in predicting business failures. Journal of the American Statistical Association 88, (422), 441-449.
Windsor, C. A., and N.M. Ashkanasy, 1995. The effect of client management bargaining power, moral
reasoning development, and belief in a just world on auditor independence, Accounting, Organizations
and Society, 701 720
Wood, D., and J. Piesse, 1987. Information value of MDA based nancial indicators. Journal of Business
Finance and Accounting, (Winter) 27-38.
Zavgren, C., 1983. The prediction of corporate failure: the state of the art. Journal of Accounting Literature,
1-38.
Zmijewski, M.D., 1984. Methodological issues related to the estimation of nancial distress prediction
models. Journal of Accounting Research, .22(supplement), 59 86.
34 Pacic Accounting Review
APPENDIX A
THE ALTMAN MODEL(1968)
Concept Calculation in Standard and Poors COMPUSTAT database.
ZSCORE=1.2
*
(WCAP/AT)+1.4
*
(RE/AT)+3.3
*
(EBIT/AT)
+0.6
*
(@VALUE(PRCCF
*
CSHO,CEQ)+PSTK)/(AT-CEQ-PSTK)+.999
*
(SALE/AT)
This concept is a bankruptcy prediction model developed by Edward Altman at New York University in
1968.
Altmans (1968) Multiple Discriminant Analysis model was written:
Z = .012X
1
+ .014X
2
+ .033X
3
+ .006X
4
+ .999X
5
where
X
1
= Working capital/total Assets
X
2
= Retained earnings/total assets
X
3
= EBIT/total assets
X
4
= Market value equity/book value of total debt
X
5
= Sales/total assets
Note that in this formulation X
1
to X
4
must be calculated as absolute % values hence the the coefcients
of these ratios are one hundredth those of the COMPUSTAT formulation.
The sample on which the model is based was composed of 66 manufacturing corporations with 33 rms
in each of two groups; a bankrupt group and a non-bankrupt group.
THE MODEL BY CYBINSKI (2000, 2003)
The path to failure was analyzed using a stepwise logit model of probability of failure in the next
reporting period using the dependent variable 1 for bankrupt in the nal year before failure and 0
for surviving in all previous years. The stepwise regression was based on the nal four consecutive
years of nancial statements available in Standard and Poors COMPUSTAT database for sixty bankrupt
service industry rms.
The parameter estimates for the nal logit model of rm failure risk (using goodness of t criterion) are
listed below.
*
Extract from SAS output.
Pacic Accounting Review Vol. 17, No. 1, June 2005 35
The Estimated (Logit) Model: Analysis of Maximum Likelihood Estimates
#
Parameter Standard Wald Pr >
Variable Estimate Error Chi-Square Chi-Square
INTERCEPT 1.4658 0.3972 13.6212 0.0002
PC3 0.9115 0.1818 25.1319 0.0001
PC4 0.4133 0.1404 8.6650 0.0032
PC5 -0.7695 0.2497 9.4930 0.0021
PC2_1 0.4736 0.1327 12.7349 0.0004
PC5_1 -0.8011 0.1790 20.0306 0.0001
INT1 -0.0206 0.00441 21.8895 0.0001
INT2 -0.0166 0.00383 18.8065 0.0001
INT3 -0.0821 0.0533 2.3675 0.1239
INT4 - 0.6916 0.2952 5.4874 0.0192
INT5_1 - 2.2866 0.6560 12.1513 0.0005
INT5_4 1.6171 0.5183 9.7339 0.0018
Model Chi-Square of 120.776 with 11 DF (p=0.0001), Residual Chi-Square = 8.8668 with 4 DF
(p=0.0645).
Note: the residual chi-square value is nearly signicant at 0.05 level - i.e. lack-of-t is not signicant.
The overall signicance of the above model was p=0.0001 with an overall classication accuracy for
predicting a nal or surviving year for the 60 service industry rms of 72% in the estimation sample, a
type I error rate (probability of misclassifying a nal year before bankruptcy) of 29%, and a Type II error
rate (probability of misclassifying a surviving year as a nal one) of 28%.
#This is a minimum adequate model and was estimated from an original set of variables comprising the
current and lagged values of: -
(a) Twenty-three nancial ratios considered relevant to bankruptcy in the current literature, and
(b) Five principal components representing the macro-environment of the U.S. matched by year.
THE INTERNAL VARIABLES IN THE FINAL MODEL: THE FINANCIAL RATIOS.
The following are the ratio labels in the model above (bracketed by type) with their denitions and
explanation notes (and the formula using COMPUSTAT names).
INT1 (liquidity) working capital/total assets (%) where working capital = (current assets-current liabilities).
[(ACT-LCT)/AT x100]
INT2 (leverage) total liabilities/total assets (%) or the debt ratio [LT/AT x 100]
This ratio is interpreted as a measure of the rms capital structure -the higher the debt ratio, the greater
the chance of predicting failure.
INT3 (cash-ow) cash ow from operations
**
/total current liabilities [(FOPT+WCAPCH)/LCT]
INT4 (leverage) a binary dummy variable taken from interest coverage after tax = (net income before
extraordinary items + interest expense)/interest expense [(IB+XINT)/XINT
*
] or COMPUSTAT ratio, IC.
INT5_1 AND INT5_4 (turnover) are respectively, the lowest and highest dummy variable categories of sales/
net plant (property plant and equipment total on balance sheet minus depreciation) [SALE/PPENT
*
]
**
Cash Flow is dened here as Total Funds from Operations plus Working Capital Changes - taken from,
the Statement of Changes/Statement of Cash Flows.
*
The denominator of the ratio is often equal to zero so there was a need to categorize this ratio..
36 Pacic Accounting Review
THE EXTERNAL VARIABLES IN THE FINAL MODEL: THE MACROECONOMIC
VARIABLES.
Refer to Cybinski (2000, 2003) for more detail on these factors and the economic series upon which they
are loaded.
PC2_1 Cost of Capital and Borrowing Factor (lagged one year)
PC3 Labour Market Tightness Factor
PC4 Construction Activities Factor
PC5 Expenditures Factor
PC5_1 Expenditures Factor (lagged one year)
Three lag periods were initially used in the stepwise regression analysis. Loss of degrees of freedom,
and non-orthogonality between lagged variables resulted in only one lag period showing any statistical
signicance (p<0.05), and then for only two of the ve macro-economic variables, shown above.
Note: Both models rated Working capital/total assets as the best indicator of ultimate discontinuance.