Professional Documents
Culture Documents
C- [Mac67] C-
Fuzzy C-Means FCM[Bez81] C- J. MacQueen
[Mac67] C
C-1
2
34
Outlier
5
C
J. C. Bezdek [Bez81]
C-
FCM
Gustafson-Kessel
[GK79] C- [Bez81]
C- [Dav90]R. O. Duda P. E. Hart
[DH73] R. Krishnapuram
[KK00] K. L. Wu M. S. Yang [WY02]
FCM
FCM Y. Ohashi
[Oha84] FCM
R. N. Dave [Dav91] NC
NC Ohashi
[DK97]R. Krishnapuram J. M. Keller [KK93][BCM96][KK96]
C-Possibilistic C-Means PCM
PCM NC
PCM FCM
5.2
C-KFCM- KFCM-5.3 C-
KPCM
5.4 ROC
Benchmark
5.5
5.6
5.2
C-FCM
HCM
5.2.1
FCM J. C. Bezdek [Bez81] C- HCM
X = { x i , i = 1, 2,..., n} X R p c v i
(i = 1,2,..., c) i u ik (i = 1,2,..., c, k = 1,2,..., n) k i
n
J m (U , v ) = u ikm || x k v i || 2
i =1 k =1
(5.1)
U = {u ik } v = (v1 , v 2 , ..., v c ) m > 1
c
u
i =1
ik
= 1, k = 1,2,..., n
(5.2)
5.25.1
(1 / || x k v i || 2 ) 1 /( m 1)
u ik =
(1 / || x
j =1
, i = 1, 2,..., c, k = 1,2,..., n
2 1 /( m 1)
v j || )
(5.3)
n
vi =
m
ik
xk
k =1
n
, i = 1,2,..., c
m
ik
k =1
(5.4)
U v J. C. Bezdek [Bez81]
z=f(z) U v U v
5.1 FCM HCM
HCM
Outlier
5.2.2 KFCM-
: F
x R p ( x) R q q > p
F F 5.4
F vi
n
v i = ik ( x k ), i = 1, 2,..., c
k =1
(5.5)
KFCM-
c
J m (U , v ) = J m (U , 1 , 2 ,..., c ) = u ikm || ( x k ) il ( x l ) || 2
i =1 k =1
(5.6)
l =1
i = ( i1 , i 2 ,..., in ) T , i = 1,2,..., c
5.6
n
|| ( xk ) il ( xl ) ||2
l =1
= ( xk )T ( xk ) 2 il ( xk )T ( xl ) + il ( xk )T ij ( x j )
l =1
l =1 j =1
(5.7)
F
F K ( x, y ) K ( x , y ) = ( x ) T ( y )
K ( x, y ) Mercer [Mer09]
K ( x, y ) 5.75.6
c
J m (U , 1 , 2 ,..., c ) = u ikm ( K kk 2 iT K k + iT K i )
i =1 k =1
(5.8)
K ij = K ( x i , x j ), i , j = 1,2,..., n K k = ( K k 1 , K k 2 ,..., K kn ) T , k = 1,2,..., n
K = ( K 1 , K 2 ,..., K n ), k = 1, 2,..., n
5.85.2
u ik =
(1 /( K kk 2 iT K k + iT K i )) 1 /( m 1)
c
(1 /( K
kk
2 K k + K j ))
T
j
T
j
, i = 1, 2,..., c, k = 1, 2,..., n
1 /( m 1)
j =1
(5.9)
n
i =
m
ik
K 1 K k
k =1
, i = 1,2,..., c
m
ik
k =1
(5.10)
KFCM-
Step1 c m
Step2 i K K 1
Step3
a5.9
b
5.10
i 5.5
5.7
SVM FCM F
5.5
FCM 10
KFCM-
5.2.3 KFCM-
KFCM-
J m (U , v ) =
u
i =1 k =1
m
ik
|| ( x k ) (v i ) || 2
(5.11)
vi i = 1,2,..., c
5.6
|| ( x k ) ( v i ) || 2 = K ( x k , x k ) + K ( v i , v i ) 2 K ( x k , v i )
(5.12)
d ( x, y ) = || ( x) ( y ) ||
(5.13)
d ( x, y )
FCM
5.125.115.2 5.11
uik =
(1/( K ( xk , xk ) + K (v j , v j ) 2 K ( xk , v j )))1/( m 1)
(5.14)
j =1
vi =
u
k =1
n
m
ik
K% ( xk , vi ) xk
u K% ( xk , vi )
k =1
m
ik
(5.15)
Sigmoid
5.15 K ( x k , vi )
~
K ( x k , vi ) = K ( xk , vi )
K ( xk , vi )
~
K ( x k , vi ) =
K (v i , v i )
d 1
d
(1-K ( xk , vi ) ) (1 K ( xk , vi ) )
Sigmoid K% ( xk , vi ) =
(1-K (vi , vi ) ) (1 K (vi , vi ) )
5.11 vi 0
n
J m
K (vi , vi )
K ( x k , vi )
)
= u ikm (
2
vi
vi
vi
k =1
n
= u ( d (v v i + c )
k =1
m
ik
T
i
d 1
(5.16)
2v i 2d ( x v i + c )
T
k
d 1
xk ) = 0
K ( x k , vi )
~
5.16 vi 5.15 K ( xk , vi ) =
K
(
v
,
v
)
i
i
d 1
d
KFCM-
Step1 c m
Step2 v i
Step3
a5.14
b
5.15
5.14
5.15 KFCM- KFCM
5.2.4 KFCM-
[Hub81] KFCM-
M-
{x i , i = 1, 2,..., n}
n
L ( ) = ( x k )
(5.16)
k =1
L( ) 0 M-
n
n
( x k )
L ( )
=
= ( xk )
k =1
k =1
( x ) =
(5.17)
( x ) ( x ) = ( x ) 2 M-
( x ) =| x | M-
5.17
n
w
= n k w k
k =1
wk
(5.18)
k =1
wk =
( xk )
5.18
xk
IF ( x; F , )
IF ( x; F , ) =
(x )
( x )dPX ( x)
(5.19)
PX (x) X IF
IF GES ( , )
GES ( , ) = sup | IF ( x; , ) |
(5.20)
GES ( , ) GES
KFCM-5.11
{vi }
5.15
M-
K ( x, y ) = e ( x y )
/ 2
K ( x, y ) = e |x y|/
( x ) = 1 K ( x, ) = 1 K ( x )
( x ) = e ( x )
( x ) = e | x |/
2
(x )
2
1
sign( x )
/ 2
~ ( x )
lim ( x ) = lim ( x ) = 0
x
(5.21)
( x ) GES ( , ) KFCM-
2
( x ) = ( x ) ( x ) = 2( x)
GES ( , ) = FCM