Professional Documents
Culture Documents
Editor-in-Chief
Prof. Janusz Kacprzyk
Systems Research Institute
Polish Academy of Sciences
ul. Newelska 6
01-447 Warsaw
Poland
E-mail: kacprzyk@ibspan.waw.pl
ABC
Author
Prof. Lotfi A. Zadeh
University of California
Berkeley
USA
It is a great honor and pleasure for me to write this foreword to this very special
and unorthodox book project on computing with words (CWW, for short) by Pro-
fessor Lotfi A. Zadeh. This book is a logical sequence of slides on CWW which
have been presented for years by the author at a multitude of conferences, con-
gresses and other scientific gatherings.
The first question a reader can ask is that it may be somehow unclear how and
why a book can be comprised of slides and not, as usually, of a plain text, possibly
with some formulas, tables, figures, etc. as it is usually the case. This question is
however related to a more fundamental question, why plenary talks are needed if
one could be able to read the contents in the form of an article. There is clearly no
simple answer, and yet people all over the world accept plenary talks as a vital
part of conferences, both small and large. In plenary talks authors can convey in a
more general, and hence more inspiring way, new ideas and views, can reach a
wider audience, possibly from beyond their areas of interest and activity. From the
slides, moreover, the reader can probably readily see the author’s opinion and
views regarding various issues.
The author of this book, Professor Lotfi A. Zadeh, is a special person in science
and many other realms. Though to many younger people he is best known as the
founder of fuzzy sets theory, one should bear in mind that before his development
of the theory of fuzzy sets he has been one of the most inspiring and prominent
representative of fields like systems science, automatic control, signal processing,
and even optimization. Just to give an example, he has been one of the originators
of the famous state space approach that has been for decades used by thousands of
people in hundreds of areas in all kinds of mathematical modeling, optimization,
control, etc.
After such an illustrious career in “hard” and “crisp” areas of research, he has
been – probably since the early 1960s – coming to a conclusion that to be able to
realistically model real world, usually human centric systems, “softer” tools and
techniques are needed, and he proposed in the mid-1960s the theory of fuzzy sets.
This was a remarkable achievement in that, for the first time, a conceptually obvi-
ous and intuitively appealing set of tools and techniques was proposed to handle
imprecise information exemplified by “large number”, “high temperature,” “much
more than,” etc. The use of natural language, the only fully natural means of ar-
ticulation and communication for human beings is clearly a source of that uncer-
tainty. Fuzzy set theory has since its inception enjoyed a tremendous, unprece-
dented growth, and it is difficult to find another area in which in such a short time
VIII Foreword
so many relevant papers have been published, so many people have been working
in, so many citations have appeared, etc.
The success of fuzzy sets theory, which after a decade or two has become a
well established academic discipline with thousands of papers and hundreds of ac-
tive scholars and researchers, has not stopped Zadeh from further work, and his
inspiring role for the world scientific community has not diminished. His ideas
which have influenced many people, triggered new research and scholarly direc-
tions are too numerous to mention.
One of them is computing with words (CWW), termed sometimes also in a
longer form as computing with words and perceptions (CWP), originated by
Zadeh in the early or mid-1990s, which has rapidly attracted much attention from
scholars and researchers from around the world. I was privileged to be part of
those who have been since the very beginning convinced that CWW is a real
breakthrough and will have a lasting impact on many areas in which systems and
processes should be modeled, and we are to operate in a human centric context in
the sense that human specific features are crucial, among them the human willing-
ness and propensity to use natural language. As a result, a two volume book on
CWW edited by Zadeh and myself was edited in 1990 and appeared in the present
book series. This book has helped to establish the new area of CWW, attract many
new people working in both theory and applications, and has also–in my case –
focused my research interests and activity for years.
What is exactly CWW, will become clear to the reader while reading this book,
maybe – better to say – by following the line of thought reflected in the slides.
Moreover, he or she will be able to follow the evolution of the concept which has
clearly culminated in what might be called CWW2, the second generation of
CWW. This has been for some time advocated by Zadeh who has once again seen
challenges and opportunities, and has found ingenious ways to formulate and im-
plement them.
Basically, as the constituent words of CWW clearly indicate, there is “comput-
ing (computation)” and “words (language).” It deals therefore with a natural prob-
lem: since for human beings the only fully natural means of articulation and com-
munication, and since in science we are in general trying to perform a quantitative
analysis, then it would be beneficial to develop a computational system in which
the objects of computation would be words, phrases and propositions instead of
numbers. One can obviously notice that a similar problem is addressed by various
tools of computational linguistic, natural language processing, generation, etc.
These areas, however, are not the same; they have different agendas and use dif-
ferent paradigms. From our point of view it is enough to say that they fail to grasp
and process imprecision which is a crucial characteristic feature of natural lan-
guage. They also fail to adequately and fully represent computational problems
stated in natural language. What is so common, at least in a vast majority of ap-
plied science, is that there is a real problem—a problem which is perceived by
human beings who use natural language to describe it, and then—in traditional
approaches—are forced to jump from natural language to numbers because the
Foreword IX
tools available do require that. CWW can do this, i.e. provide a direct transition
from natural language to computation, both at the level of representation and
processing! I think that this feature alone is enough for attracting a large commu-
nity of readers to the fascinating area of CWW.
I will not write more about the fascinating field of CWW, various rationales
and solutions employed, and results obtained because they will be shown in this
book. My main message is that the richness of ideas and vision of the author will
certainly imply that many people who have either been not exposed to CWW or
have not been fully convinced about its power, will appreciate it and try to look
deeper into its foundations or apply it to solve their problems.
I am sure that the fully innovative idea of this book as a collection of slides will
be found convincing and inspiring for many individuals from many fields of sci-
ence and technology and will trigger further research in the fascinating field of
computing with words. As the Editor in chief of Studies in Fuzziness and Soft
Computing, the largest book series on fuzzy sets and soft computing in the world,
I am honored and proud that this innovative Zadeh’s book will appear therein.
I have been urged by some of my close friends to write a book on Computing with
Words. At this stage of my life, it is difficult for me to do so. I am grateful to
Springer and to my good friend, Professor Janusz Kacprzyk, Editor of the series
on "Studies in Fuzziness and Soft Computing," for making it possible to describe
in print the principal concepts and ideas which underlie Computing with Words.
I consider Computing with Words to be an important chapter in my work. What
lies between the covers of this volume is a substantially revised and updated ver-
sion of a PPT file of a lecture which I gave at USC in 2010.
What is Computing With Words (CWW) and what does it have to offer? I will
preface my response with a bit of history.
In 1996, I wrote a paper entitled "Fuzzy Logic = Computing with Words," pub-
lished in the IEEE Transactions on Fuzzy Systems. (Zadeh 1996) What I meant by
equality was that, in large measure, applications of fuzzy logic involve the concept
of a linguistic variable. (Zadeh 1973, 1975a) My paper evoked a number of criti-
cal comments, suggesting that Computing with Words is merely another name
for Natural Language Processing.
This was, and remains, a common misconception. The concepts and ideas
which were described in my 1996 paper have little in common with Natural Lan-
guage Processing. Computing with Words and Natural Language Processing have
different agendas and different application areas.
Basically, Computing with Words is a system of computation in which the ob-
jects of computation are words, phrases, propositions, questions, commands and
other types of semantic entities drawn from natural language. What is important to
note is that there are two levels of complexity in Computing with Words.
In Level 1 CWW (CWW1), the objects of computation are words, phrases and
simple propositions such as Robert is tall, X is small, if X is small then Y is large,
etc. Today, most applications of fuzzy logic are applications of Level 1 CWW.
The same applies, more broadly, to research literature.
At this juncture, there are over 250,000 papers and books with fuzzy in the title.
What should be underscored is that, in large measure, this literature relates to
Level 1 CWW.
In Level 2 CWW (CWW2), the objects of computation include possi-
bly complex propositions exemplified by: Usually it takes Robert about an hour to
get home from work. It is very unlikely that there will be a significant decrease in
the price of oil in the near future. Brian is much taller than most of his close
friends, etc. In Level 1 CWW, there is no need for semantics of natural languages.
In Level 2 CWW, semantics of natural languages plays an important role.
XII Preface
The genesis of Level 2 CWW was my 1999 paper, “From computing with num-
bers to computing with words—from manipulation of measurements to manipula-
tion of perceptions,” published in IEEE Transactions on Circuits and Systems 45.
(Zadeh 1999) In this basic paper, a foundation was laid for what I called the com-
putational theory of perceptions, or CTP for short.
The point of departure in this theory is the observation that a natural language
is basically a system for describing perceptions. In CTP, this observation suggests
a key idea—the idea that computation with perceptions can be reduced to compu-
tation with natural language descriptions of perceptions. What is used for this pur-
pose is the formalism of Level 2 CWW.
The centerpiece of Level 2 CWW is what I call restriction-based semantics of
natural languages, or RS for short. In Level 2 CWW, RS is used in the main for
precisiation of meaning. Furthermore, in RS, an unconventional definition of a
proposition is employed.
More concretely, RS serves to translate a natural language into a mathematical
language in which the objects of computation are well-defined—though not con-
ventional—mathematical constructs.
For this purpose, traditional approaches to representation of meaning of proposi-
tions are put aside. Instead, a proposition, p, is defined as a restriction (Zadeh
1975b) on the values which a variable X—a variable which is associated with p—
can take. The concept of a restriction plays a key role in restriction-based semantics.
Restriction on p is represented as X isr R, where X is the restricted variable, R
is the restricting relation and r is an indexical variable which defines the way in
which R restricts X. Restriction-based semantics is the only system of computa-
tion which has the capability to precisiate natural language. Restriction-based se-
mantics employs concepts and techniques drawn from fuzzy logic.
Computing with Words has an important ramification for mathematics. It opens
the door to construction of mathematical solutions of computational problems
which are stated in a natural language. Traditional mathematics does not have this
capability. The need for this capability will become increasingly evident as we
move further into the age of automation of everyday reasoning and decision-
making.
Concluding Remark. In conclusion, I believe that in coming years, Computing
with Words will gain recognition both as an important tool for the conception, de-
sign and utilization of intelligent systems, and as a system of computation which
empowers mathematics to construct mathematical solutions of computational
problems which are stated in a natural language.
Important Note. What should be underscored is that what follows is restricted to
exposition of only Level 2 CWW, since Level 1 CWW is amply covered in the
literature.
Part I: Introduction
Phase 1—Precisiation...................................................................................41
Phase 2—Computation................................................................................73
Appendix .......................................................................................................91
References....................................................................................................139
INTRODUCTION
1/263
WHAT IS
COMPUTING
WITH WORDS
(CWW)?
2/263
3/263
EXAMPLE
CWN CWW
z Dana is 25 years z Dana is young
old z Tandy is a few
z Tandy is 3 years years older than
older than Dana Dana
z Tandy is (25+3) z Tandy is (young +
years old few) years old
z In CWW, young and few are interpreted as
labels of fuzzy numbers. Fuzzy arithmetic
is used to find the sum of young and few.
4/263
ESSENCE OF CWW
z In essence, CWW is a system of
computation in which the objects of
computation are words, phrases and
propositions drawn from a natural
language. The carriers of information are
propositions. It is important to note that
CWW is the only system of computation
which offers a capability to compute with
information described in a natural
language.
5/263
What Is Computing with Words (CWW)? 5
KEY POINT
z In particular, CWW opens the door to
construction of mathematical solutions of
computational problems which are stated
in a natural language. For convenience,
such problems will be referred to as CNL
problems. Here are a few simple
examples of CNL problems.
7/263
6 What Is Computing with Words (CWW)?
8/263
9/263
What Is Computing with Words (CWW)? 7
10/263
11/263
8 What Is Computing with Words (CWW)?
13/263
What Is Computing with Words (CWW)? 9
NOTE
z When A poses a CNL problem to B, B is
likely to be unsure of how imprecise
terms such as most, tall, usually, etc.
should be interpreted. If this is the case,
B can ask A to precisiate the meaning of
such terms. In constructing mathematical
solutions to CNL problems, what is
assumed is that the imprecise terms are
labels of fuzzy sets with specified
membership functions.
14/263
15/263
10 What Is Computing with Words (CWW)?
16/263
17/263
What Is Computing with Words (CWW)? 11
18/263
19/263
12 What Is Computing with Words (CWW)?
NL q
CWW
p engine ans(q/I)
I
+p
NL
NL
20/263
SIMPLE EXAMPLE
Question, q: What is Vera’s age?
Information set, I:
p1: Vera has a son in mid-twenties.
p2: Vera has a daughter in mid-
thirties.
+p3(world knowledge): Usually raw information
mother’s age at birth of child is (unprecisiated)
between approximately 20, *20,
and approximately 40, *40.
(*a denotes approximately a)
21/263
What Is Computing with Words (CWW)? 13
EXAMPLE—VERA’S AGE
z First step, partial precisiation of the
information set, I*:
p1*: Age(Son) is *25
p2*: Age(Daughter) is *35
+p3*: Age(Mother.at.birth) is usually
[*20,*40]
z ans(q/I): Age(Vera) is
(*25+usually[*20,*40]) Λ (conjunction)
(*35+usually[*20,*40])
z Note. For simplicity “usually” is
interpreted as “always.”
22/263
KEY IDEA
z A prerequisite to computation is
precisiation of meaning. Raw
(unprecisiated) natural language cannot
be computed with. Precisiation of
meaning has a position of centrality in
CWW.
z Understanding of meaning is a
prerequisite to precisiation of meaning.
23/263
14 What Is Computing with Words (CWW)?
PHASES OF CWW
CWW= [PRECISIATION COMPUTATION]
CWW Granular computing
Phase 1 q* Phase 2
q
precisiation computation ans(q/I)
I
I*
precisiation computation
module module
fuzzy logic
NOTE
z To facilitate understanding of the basic
ideas which underlie CWW, a clarification
dialogue is included in the Appendix.
25/263
What Is Computing with Words (CWW)? 15
26/263
27/263
16 What Is Computing with Words (CWW)?
EXAMPLES
z Level 1 (basic):
Robert is young
X is small
If X is small then Y is large
z Level 2 (advanced):
It is very unlikely that there will be a
significant decrease in the price of oil in
the near future.
28/263
NOTE
z Historically, Level 2 CWW may be viewed
as a sequel to and a generalization of
Level 1 CWW. Today, it is Level 1 CWW
that is in preponderant use and a center
of research activity. In coming years, the
intrinsic importance of Level 2 CWW is
likely to gain recognition, leading to a
wide variety of new application areas.
29/263
What Is Computing with Words (CWW)? 17
NOTE
z Generally, Level 2 CWW is needed for
construction of mathematical solutions of
computational problems which are stated
in a natural language.
z Linguistic variables and fuzzy if-then
rules (Takagi and Sugeno 1985, Bardossy
and Duckstein 1995, Yen and Langari
1999, Mendel 2001) fall within the
province of Level 1 CWW.
30/263
NOTE
z In part, linguistic variables and fuzzy if-
then rules are widely used because the
underlying theory is easy to understand
and easy to apply.
31/263
18 What Is Computing with Words (CWW)?
NOTE
z Level 1 CWW is associated with an
extensive literature and a wide range of
applications. Level 2 CWW is not, at least
at this stage of its development. For this
reason, exposition of CWW in this
presentation is focused on Level 2 CWW.
More specifically, what will not be
discussed is the widely used machinery
of linguistic variables and fuzzy if-then
rules.
32/263
33/263
What Is Computing with Words (CWW)? 19
34/263
IMPORTANT POINTS
z Most words (phrases) in a natural
language are labels of classes with
unsharp boundaries. Examples: near,
soft, fast, tall, hand, etc. Fuzziness of
words is a concomitant of fuzziness of
perceptions.
z Words(phrases) are precisiated through
graduation.
36/263
EXAMPLE—GRADUATION OF MIDDLE-AGE
z Imprecision of meaning = fuzziness of meaning
z Computational model of middle-age (trapezoidal
fuzzy set)
membership function of
μ middle age
1
0.8
core of middle-age
0 40 45 55 60
43
definitely not middle-age definitely not middle-age
definitely
middle-age
z Note: Parameters are context-dependent
37/263
What Is Computing with Words (CWW)? 21
Grade
Grade
Grade
Low
Not Low
0 30 130 180 0 54 0 5
Speed Throttle Shift
Control Rules:
1. If (speed is low) and (shift is high) then (-3)
2. If (speed is high) and (shift is low) then (+3)
3. If (throt is low) and (speed is high) then (+3)
4. If (throt is low) and (speed is low) then (+1)
38/263
z Rationale A.
Use words when numbers are not known
or are too costly to obtain. Use of words
is a necessity.
39/263
22 What Is Computing with Words (CWW)?
z Rationale B.
Words are good enough.
Numbers are known but there is a
tolerance for imprecision which can be
exploited by employing words in place of
numbers, aiming at a reduction in cost
and achieving simplicity. Use of words is
advantageous.
40/263
z Rationale C.
Linguistic summarization.
Words are used to summarize numerical
information. Use of words is expedient.
41/263
What Is Computing with Words (CWW)? 23
use of words
A B C
necessary advantageous expedient
Numbers
are known.
There is a
Numbers Linguistic
tolerance for
not known summarization
imprecision.
Words are
good enough.
42/263
NOTE
z Today, most applications of CWW1,
especially in the realm of consumer
products, are based on Rationales B and
C. A key role is played by linguistic
summarization.
43/263
24 What Is Computing with Words (CWW)?
0
X
z The Fuzzy Logic Gambit is employed in
many applications of fuzzy logic, especially
in the realm of consumer products
45/263
What Is Computing with Words (CWW)? 25
NATURAL-LANGUAGE-BASED (LINGUISTIC)
SYSTEM MODELIZATION (LEVEL1 CWW)
I (information set)
linguistic model
46/263
47/263
26 What Is Computing with Words (CWW)?
48/263
NL NM NS 1.0 ZR PS PM PL
x
0
Minimum Maximum
x
0
Target Point
X=A・θ+B・(dθ/dt)=NS
NM NS ZR PS PM
Y=C・x+D・(dx/dt)=NS
PM NS PS (PL)
PS NS PM
ZR NM ZR PM
NS NM PS
NM (NL) NS PS
50/263
HISTORICAL NOTE
z In science, there is a deep-seated
tradition of according much more respect
to numbers than to words. The
countertraditional spirit of the advocacy
of the use of words evoked criticism and
derision rather than approbation. What
was not recognized is that the deliberate
sacrifice of precision is a gambit—a
gambit which opens the door to important
applications.
z A typical negative view was that of Rudolf
Kalman, a brilliant system scientist and a
good friend.
52/263
COMMENT
(Kalman 1972)
I would like to comment briefly on
Professor Zadeh’s presentation. His
proposals could be severely, ferociously,
even brutally criticized from a technical
point of view. This would be out of place
here. But a blunt question remains:
Is Professor Zadeh presenting important
ideas or is he indulging in wishful
thinking?
53/263
What Is Computing with Words (CWW)? 29
60/263
KEY POINT
z What Kalman and other critics of CWW
did not realize is that precisiation of
meaning opens the door to construction
of a system of computation which offers
an important capability that traditional
systems of computation do not have—
the capability to compute and reason with
information described in a natural
language.
61/263
What Is Computing with Words (CWW)? 33
62/263
NOTE
z In addition to playing a pivotal role in
CWW, precisiation of meaning is
important in its own right. More
concretely, precisiation of meaning is
needed in a variety of fields, among them
legal reasoning, wording of contracts
and specifications, definition of
concepts, human-machine
communication, etc. For such
applications, CWW offers an effective
method of precisiation.
64/263
NOTE
z It is of interest to note that the concept of
precisiation, in the sense in which it is
used in CWW, does not exist within
linguistics or computational linguistics.
65/263
What Is Computing with Words (CWW)? 35
SUMMARY
z CWW= precisiation of semantic entities,
mainly words, phrases and propositions,
followed by computation with precisiated
semantic entities
(computational/mathematical models of
semantic entities.)
computational
CWW = precisiation models
computation
66/263
*25 *20
f-mark
0 0 0 0 0
belief honesty
1 1
precisiation
f-mark f-mark
0 0
68/263
MORE ON Z-MOUSE
z If I am not sure what the degree is, and I
am allowed to use a Z-mouse, I will put a
fuzzy f-mark on the scale.
z A fuzzy f-mark reflects imprecision of my
perception.
z A Z-mouse reads my f-mark and
represents it internally into a trapezoidal
fuzzy set—a fuzzy set which serves as an
object of computation for the machinery
of Computing with Words.
69/263
What Is Computing with Words (CWW)? 37
70/263
*3:50pm
*4pm
5pm
f-mark
0 0 0 0
71/263
COMPUTING
WITH
WORDS—
HOW?
72/263
PHASE 1—
PRECISIATION
Restriction-based
Semantics (RS)
73/263
PRECISIATION OF MEANING
z Basically, precisiation involves
construction of computational/
mathematical models of words, phrases,
propositions, questions and other types
of semantic entities.
z Precisiation of meaning goes beyond
representation of meaning.
74/263
µ computational model
of young (fuzzy set)
1
precisiation young*
young
0 20 30 Age
75/263
Swedes/Swedes) is most
µ µ
tall(fuzzy set) most(fuzzy set)
1 1
cointension
z precisiand = model of meaning
z extension= name-based meaning
z intension = attribute-based meaning
z cointension = qualitative measure of proximity of
meanings
= qualitative measure of proximity of
the model (precisiand) and the object
of modeling (precisiend)
77/263
PRECISIATION = MODELIZATION
z Let p be a proposition drawn from a
natural language. In CWW, precisiation of
p involves construction of a
computational/mathematical model of p.
In this perspective, precisiation may be
viewed as a form of modelization.
z A desideratum of precisiation/modeli-
zation is high cointension.
78/263
44 Phase 1—Precisiation
COINTENSION PRINCIPLE
z A precisiend has a multiplicity of
precisiands.
z Generally, achievement of cointensive
precisiation requires that if the precisiend
is fuzzy so must be the precisiand.
z Crisp definitions of fuzzy concepts is the
norm in science. What is widely
unrecognized is that, in general, crisp
definitions of fuzzy concepts are not
cointensive.
79/263
MP: p = restriction on X
82/263
46 Phase 1—Precisiation
83/263
EXAMPLES
z 8 ≤ X ≤ 10
z X is small
z Usually X is small
z X is normally distributed with mean 9 and
variance 2.
z It is likely that X is between 8 and 10.
84/263
Phase 1—Precisiation 47
REPRESENTATION OF A RESTRICTION
z A restriction (generalized constraint),
R(X), may be represented as:
R(X): X isr R
where X is the restricted (constrained)
variable, R is the restricting (constraining)
relation and r is an indexical variable
which defines how R restricts X.
85/263
RESTRICTIONS
z There are many different kinds of
restrictions. The principal restrictions are:
possibilistic (r=blank); probabilistic (r=p)
and combinations of possibilistic and
probabilistic restrictions. A special case
of a combination of possibilistic and
probabilistic restrictions is a Z-restriction
(r=z) (Zadeh 2011)
86/263
48 Phase 1—Precisiation
EXAMPLES
z Possibilistic restriction (r=blank):
R(X): X is A
where A is a fuzzy set in U with the
membership function µA. A plays the role
of the possibility distribution of X (Zadeh
1978)
Poss(X=u)= µA(u)
87/263
PROBABILISTIC RESTRICTION
z Probabilistic restriction (r=p):
R(X): X isp P
Prob(u≤X≤u+du)=p(u)du
Z-RESTRICTION
z Z-restriction (r=z):
R(X): X isz Z
Prob(X is A) is B
89/263
X isz (A,B)
90/263
50 Phase 1—Precisiation
EXAMPLES OF Z-RESTRICTIONS
z Usually temperature is low
temperature isz (low, usually)
z Important note
Usually X is A,
where A is a fuzzy set, is a Z-restriction
91/263
R(X): X isr R
92/263
Phase 1—Precisiation 51
R( X ) : ∫ μ( u ) p( u )du is likely
R
is an indirect restriction on p.
93/263
COLLECTION OF RESTRICTIONS—
GRANULATION
94/263
52 Phase 1—Precisiation
0 granulated Age
Granulation plays a pivotal role in fuzzy
logic (Zadeh 1997) and, especially, in
granular computing. (Zadeh 1998, Lin 1998,
Pedrycz and Bargiela 2002) Linguistic
variables are employed extensively in
applications of fuzzy logic.
95/263
NOTE
z Note. A granule is a restriction but not
every restriction is a granule. Informally,
a granule is a restriction in which the
values which X can take are drawn
together by similarity, proximity or
functionality.
96/263
Phase 1—Precisiation 53
Z-numbers
Level 3
intervals
Level 1
97/263
RESTRICTION-BASED SEMANTICS
z In CWW, precisiation of propositions is
carried out through the use of what is
referred to as restriction-based
semantics, RS.
z The point of departure—and a key idea
in RS—is that of representing the
precisiated meaning of a proposition, p,
as a restriction
precisiation
p X isr R
z The expression X isr R is referred to as
a canonical form of p.
98/263
54 Phase 1—Precisiation
NOTE
z Equating a proposition drawn from a
natural language to a restriction bridges
the divide between linguistics and
mathematics.
100/263
Phase 1—Precisiation 55
NOTE
z X need not be a scalar variable.
Example:
z p: Robert gave a ring to Anne, X may be
represented as the 3-tuple (Giver,
Recipient, Object), with the
corresponding values of R being (Robert,
Anne, Ring).
101/263
NOTE
z A semantic network may be viewed as a
canonical form of p, with X as an n-ary
variable.
102/263
56 Phase 1—Precisiation
KEY IDEA
Proposition = Restriction
103/263
KEY POINTS
z The answers to these questions define
the meaning of p.
z Typically, in the case of propositions
drawn from a natural language, X and R
are implicit (hidden).
z Generally, X and R are identified by
inspection. Choice of X is influenced by
world knowledge.
104/263
Phase 1—Precisiation 57
KEY POINTS
z R is determined by X.
z X and R are referred to, respectively, as
the focal variable and the focal relation.
z X and R are analogous to the subject and
predicate of a sentence.
105/263
NOTE
z In general, the focal variable, X, is not
unique. However, it is usually the case
that among possible choices either there
is one that has higher plausibility than
others, or there are a few that are closely
related. For example, if
p: Leslie is much taller than Ixel
then a plausible choice of X is
X: Height(Leslie)
106/263
58 Phase 1—Precisiation
107/263
NOTES
z Restriction-based semantics is rooted in
test-score semantics (Zadeh 1981)
z Restriction-based semantics may be
viewed as a generalization of traditional
approaches to semantics of natural
languages—mainly possible-world
semantics and truth-conditional
semantics (Lambert 1970)
z Restriction-based semantics has a far
greater precisiation capability than
possible-world and truth-conditional
semantics.
108/263
Phase 1—Precisiation 59
109/263
CF(p): X isr R
110/263
60 Phase 1—Precisiation
NOTE
z It is important to note that representing a
proposition as a restriction is greatly
facilitated by the fact that restrictions in a
natural language are predominantly
possibilistic. Possibilistic restrictions are
easiest to compute with.
111/263
112/263
Phase 1—Precisiation 61
113/263
NOTE
ED=POPULATION.SWEDES[Name;
Height]+TALL[Height;µ]+
MOST[Proportion;µ],
where + plays the role of a comma.
115/263
ADDITIONAL EXAMPLE OF ED
z Note. This and other examples are
discussed in greater detail in Zadeh
1983a.
z p: Brian is much taller than most of his
friends.
X: Height of Brian.
R: Much taller than most of his friends.
ED = HEIGHT[Name; Height]+
FRIENDS.BRIAN[Name; µ]+
116/263
Phase 1—Precisiation 63
117/263
118/263
64 Phase 1—Precisiation
119/263
120/263
Phase 1—Precisiation 65
121/263
122/263
66 Phase 1—Precisiation
CLARIFICATION OF MEANING
z A preliminary step is that of clarification,
if needed, of the meaning of the given
proposition. This step requires world
knowledge.
Examples:
z Overeating causes obesity clarification
Most of those who overeat are obese.
z Obesity is caused by overeating clarification
Most of those who are obese, overeat.
123/263
● Clarification (disambiguation) of a
predicate.
clarification1
Mostly tall Swedes
clarification2
Most of tall Swedes
125/263
126/263
68 Phase 1—Precisiation
127/263
128/263
Phase 1—Precisiation 69
KEY CONCEPTS
z More concretely, X* and R* may be
expressed as:
X*= f(ED)
R*= g(ED)
z The precisiated canonical form, CF*(p): X*
isr R*, induces a restriction on ED which
will be referred to as the generalized
intension of p, µ(p).
z The generalized intension of p may be
viewed as a representation of a deep
semantic structure of p.
129/263
130/263
70 Phase 1—Precisiation
SUMMARY OF PROCEDURE
identification explanatory
of X and R database
Step 1 Step 2
p X, R ED
precisiated
canonical form
Step 3 X* isr R* computational
ED (µ (p)) /mathematical
model of p
generalized
intension
131/263
NOTE
THE CONCEPT OF A PROTOFORM
z A protoform, (prototypical form) of p,
denoted as Pr(p), is an abstracted version
of the generalized intension of p (Zadeh
2006a). Pr(p) represents an abstracted
deep semantic structure of p. Simple
examples.
Pr(Robert is tall)=A(B) is C
132/263
Phase 1—Precisiation 71
133/263
CONCLUSION
z In RS, a precisiated meaning of a
proposition, p, is equated to its
precisiated canonical form, CF*(p): X* isr
R*, with the understanding that X* isr R*
is described as a procedure.
134/263
72 Phase 1—Precisiation
136/263
137/263
138/263
Phase 1
p1 p1* : X1 isr1 R1
. .
. .
I pn-1 pn-1*: X isr R I*
precisiation n-1 n-1 n-1
Pn pn*: X isr R
n n n
q q*
Phase 2
X1 isr1 R1
.
I*
.
computation
Xn-1 isrn-1 Rn-1 ans(q/I)
Xn isrn Rn with restrictions
q*
139/263
Phase 2—Computation 75
140/263
141/263
76 Phase 2—Computation
NOTE
z The calculi of fuzzy if-then rules in Level 1
CWW may be viewed as special cases of
propagation of possibilistic restrictions.
142/263
143/263
Phase 2—Computation 77
f(X) is A
g(X) is ?B
144/263
μY ( v ) = supu μ A ( f ( u ))
subject to
v = g( u )
145/263
78 Phase 2—Computation
NOTE
z In a more general setting, the extension
principle is concerned with propagation
of restrictions—restrictions on both
functions and their arguments.
Schematically,
Z = g(X,Y)
z There are many different ways in which X,
Y and g may be restricted. Only a few
have been explored.
146/263
147/263
Phase 2—Computation 79
µ(p)
extension
ans(q/p)
principle
µ(q)
148/263
149/263
80 Phase 2—Computation
150/263
DIGRESSION
z In fuzzy logic, proportion is defined as a
relative ΣCount. (Zadeh 1983b) More
specifically, if A and B are fuzzy sets in U,
U={u1, …, un}, the ΣCount(cardinality) of
A is defined as:
ΣCount ( A ) = Σ i μ A ( ui )
151/263
Phase 2—Computation 81
ΣCount ( A I B )
ΣCount ( B / A ) =
ΣCount ( A )
Σ i ( μ A ( ui ) ∧ μ B ( ui ))
=
Σ i μ A ( ui )
152/263
EXAMPLE (CONTINUED)
In application to the example under
consideration, assume that the height of ith
Swede, Namei, is hi and that the grade of
membership of hi in tall is µtall(hi), i=1, …, n.
On this understanding, X may be expressed
as:
1 n
X = ( Σ μ ( h ))
n i =1 tall i
Step 2. Construction of ED.
The needed information is contained in the
explanatory database, ED, where
153/263
82 Phase 2—Computation
ED= POPULATION.SWEDES[Name;
Height]+
TALL[Height; µ]+
MOST[Proportion; µ]
154/263
1
X* = ( Σi μ tall ( hi ))
n
R* = most
or equivalently, as:
R* = MOST[Proportion; µ]
155/263
Phase 2—Computation 83
1 n
CF * ( p ) : ( Σ μ ( h )) is most
n i =1 tall i
Equivalently,
1 n
μ( p ) = μ most ( ( Σ μtall ( hi )))
n i =1
156/263
z Precisiation of q
q: What is the average height, have, of
Swedes?
q* may be expressed as a function of ED
1 n
q* : ? have = Σ hi = ans( q / I )
n i =1
1 n
( Σ μ ( h )) is most
n i =1 tall i
1 n
Σ(h ) is ?have
n i =1 i
158/263
1 n
μ have ( v ) = suph μ most ( Σ μ ( h ))
n i =1 tall i
subject to:
1 n
v= Σ(h )
n i =1 i
159/263
Phase 2—Computation 85
TRUTH-VALUE
The truth-value of p, t(p, ED+), is the degree
to which the restriction X* isr R* is
satisfied. More concretely,
1
t ( p , ED + ) = μ most ( Σi μtall ( hi ))
n
Note. The right-hand side of this equation
may be viewed as a restriction on ED, with
µmost, µtall and h instantiated.
160/263
161/263
86 Phase 2—Computation
z By definition,
∫
h max
h min
h( u )du = 1
z In terms of h, precisiation of q may be
expressed as:
q* : ? have = ∫ h max
h min
uh( u )du
162/263
X* = ∫ h max
h min
μtall ( u )h( u )du
R* = most
163/263
Phase 2—Computation 87
CF * ( p ) : ∫ h max
h min
μtall( u )h( u )du is most
z Equivalently,
μ( p ) = μ most ( ∫ h max
h min
μtall ( u )h( u )du )
where µ(p) is the generalized intension of
p.
164/263
∫
h max
h min
μtall ( u )h( u )du is most
∫
h max
h min
uh( u )du is ?have
h min
μtall ( u )h( u )du )
165/263
88 Phase 2—Computation
subject to
v=∫ h max
h min
uh( u )du
and
∫
h max
h min
h( u )du = 1
SUMMATION
z In essence, Computing with Words is a
system of computation in which the
objects of computation are words,
phrases and propositions drawn from a
natural language.
167/263
Phase 2—Computation 89
168/263
169/263
APPENDIX
170/263
EXAMPLE 1
Step 1. Precisiation of I (information set)
z To begin with, let us rewrite I as:
171/263
92 Appendix
172/263
173/263
Appendix 93
∫ μtall ( u ) pH ( u )du
R
174/263
175/263
94 Appendix
176/263
177/263
Appendix 95
NOTE
z Note that for given µprobable, µtall and pH, the
right-hand side of the above expression
evaluates to a number in the interval [0, 1]
which may be interpreted as the
possibility of pH or the truth-value of I
given µprobable, µtall and pH. It is important
to observe that the expression:
178/263
μ( p ) = μ A ( ∫ μ B ( u ) p( u )du )
R
179/263
96 Appendix
NOTE
z It is of interest to observe that the
propositions “Probably John is tall,”
“Most Swedes are tall,” and “Usually, it
takes Robert about an hour to get home
from work” have identical protoforms.
What this observation brings to light is
that seemingly very different propositions
drawn from a natural language may have
the same mathematical deep structure.
180/263
181/263
Appendix 97
Version 1
Version 1.
z What is the probability that John is
short? precisiation
∫ μ s ( u ) pH ( u )du is ?Ps
R
182/263
Version 2
Version 2.
z What is the probability that John is very
short? precisiation
183/263
98 Appendix
Version 3
Version 3.
z What is the probability that John is not
very tall? precisiation
185/263
Appendix 99
186/263
= 1 − ∫ μt ( u ) pH ( u )du
R
= 1 − probable
187/263
100 Appendix
= 1 − ∫ μt ( u ) pH ( u )du
R
= 1 − probable
189/263
Appendix 101
190/263
Version 3.
z The shortcut does not work in the case of
Version 3 since not very tall may not be a
subset of not tall. What has to be
employed in Version 3 is a version of the
extension principle (Zadeh 1965, 1975a).
z The problem we are faced with may be
expressed as an inference schema:
191/263
102 Appendix
∫ μt ( u ) pH ( u )du is probable
R
∫ μ nvt ( u ) pH ( u )du is ?Pnvt
R
192/263
194/263
subject to
v = ∫ μ nvt ( u ) pH ( u )du
R
195/263
104 Appendix
196/263
197/263
Appendix 105
Clarification.
Most Swedes are much taller than most
Italians.
Step 1. Identification of X and R.
X= Proportion of Swedes who are
much taller than most Italians.
R= Most
198/263
Step 2. Construction of ED
POPULATION.SWEDES[Name;
Height] +
POPULATION.ITALIANS[Name;
Height] +
MUCH.TALLER[Height1; Height2; µ] +
MOST[Proportion; µ]
EXAMPLE 3
Find the degree, aij, to which NameSi is
much taller than NameIj
aij= µMUCH.TALLER[Height1=hi;
Height2=kj; µ]
201/263
Appendix 107
1
qi = μ MOST [Pr oportion = Σ j aij ; μ ]
n
1
X* = Σi qi
m
202/263
Precisiation of R
R*= MOST[Proportion; µ]
The precisiated canonical form may be
expressed as CF*(p)= X* is R*, where
1
X* =
Σi qi
m
R*= MOST[Proportion; µ]
Additional examples may be found in
cited papers.
203/263
108 Appendix
204/263
DIALOGUE
Robert: Lotfi, restriction-based semantics
looks complicated to me. Can you explain
in simple terms the basic ideas which
underlie RS?
205/263
Appendix 109
206/263
207/263
110 Appendix
208/263
209/263
Appendix 111
210/263
211/263
112 Appendix
213/263
Appendix 113
X isr R
214/263
215/263
114 Appendix
216/263
217/263
Appendix 115
219/263
116 Appendix
220/263
221/263
Appendix 117
222/263
223/263
118 Appendix
224/263
225/263
Appendix 119
226/263
force
Age
227/263
120 Appendix
228/263
229/263
Appendix 121
230/263
231/263
122 Appendix
232/263
233/263
Appendix 123
234/263
ED= POPULATION.SWEDES[Name;
Height]+
TALL[Height; µ]+
MOST[Proportion; µ]
236/263
238/263
239/263
126 Appendix
240/263
241/263
Appendix 127
243/263
128 Appendix
244/263
245/263
Appendix 129
246/263
249/263
Appendix 131
250/263
1 n
t = μ most ( ∑ μ ( h ))
n i =1 tall i
251/263
132 Appendix
252/263
253/263
Appendix 133
254/263
256/263
subject to
1 n
v= (∑h )
n i =1 i
258/263
259/263
136 Appendix
260/263
261/263
Appendix 137
263/263
References
Zadeh, L.: Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and
Systems 1, 3–28 (1978)
Zadeh, L.: Test-score semantics for natural languages and meaning representation
via PRUF. In: Rieger, B. (ed.) Empirical Semantics, pp. 281–349.
Brockmeyer, Bochum (1981). Also Technical Memorandum 246, AI Center,
SRI International, Menlo Park, CA, 1981.
Zadeh, L.: A fuzzy-set-theoretic approach to the compositionality of meaning:
propositions, dispositions and canonical forms. Journal of Semantics 3, 253–
272 (1983a)
Zadeh, L.: A computational approach to fuzzy quantifiers in natural languages.
Computers and Mathematics 9, 149–184 (1983b)
Zadeh, L.: Fuzzy logic = computing with words. IEEE Transactions on Fuzzy
Systems 2, 103–111 (1996)
Zadeh, L.: Toward a theory of fuzzy information granulation and its centrality in
human reasoning and fuzzy logic. Fuzzy Sets and Systems 90, 111–127 (1997)
Zadeh, L.: Some reflections on soft computing, granular computing and their roles
in the conception, design and utilization of information/intelligent systems.
Soft Computing 2, 23–25 (1998)
Zadeh, L.: From computing with numbers to computing with words—from
manipulation of measurements to manipulation of perceptions. IEEE
Transactions on Circuits and Systems 45, 105–119 (1999)
Zadeh, L.: A new direction in AI—toward a computational theory of perceptions.
AI Magazine 22(1), 73–84 (2001)
Zadeh, L.: Toward a perception-based theory of probabilistic reasoning with
imprecise probabilities. Journal of Statistical Planning and Inference, Elsevier
Science 105, 233–264 (2002)
Zadeh, L.: Precisiated natural language (PNL). AI Magazine 25(3), 74–91 (2004)
Zadeh, L.: Generalized theory of uncertainty (GTU)—principal concepts and ideas.
Computational Statistics and Data Analysis 51, 15–46 (2006a)
Zadeh, L.: From search engines to question answering systems—The problems of
world knowledge, relevance, deduction and precisiation. In: Sanchez, E. (ed.)
Fuzzy Logic and the Semantic Web, Ch. 9, pp. 163–210. Elsevier, Amsterdam
(2006b)
Zadeh, L.: A note on Z-numbers. Information Sciences 181, 2923–2932 (2011)