6/10/15

OUTLINE
1
2
3
4
5

1
18 Euler

Erdos & Renyi 1960

Watts & Stogatz Cornell university

1998 small-world networks

Barabasi & Albert Notre dame u.

1999 scale-free networks

Scale-Free Networks

p(k ) ~ k
R. Albert, H. Jeong, and A.-L. Barabsi Diameter of the World Wide Web
401, 130-131 (1999).
Non-homogeneous nature of scale-free network

Nature

santa fe institute introducion

2.1
1.2.6 Moody Race 2001 American Journal of Sociology School In

tegration and Friendship Segregation in America

direct-network

2.2
2007 C. A. Hidalgo A.L. Barabsi Science The Prod

uct Space Conditions the Development of Nations

2.3
Bruno Goncalves Human dynamics revealed through Web a

nalytics 2008

WHY WE TWITTER UNDERSTANDING MICROBLOGGING USA

GE AND COMMUNITIES

Boltzmann
Shannon
Jaynes

NUMBER OF MICRO-STATES
For given a macro-state (n1,n2,,nm)
There are many micro-states to realize it

e1

e2

ei

er

n1

n2

ni

nr

N!
W ( n1 , n2 , , nm )
n1! n2 ! nm !

3.1

BOLTZMANN

For given a macro-state (n1,n2,,nm) There are many micro-states to r

ealize it:

W ( n1 , n2 , , nm )

N!
n1! n2 ! nm !

S=k ln W

s
K
w

3.2

I S pi log pi
i 1

lnW ln[ N !/ ( n1 ! n2 !...nr !)]

Q ln x!=xlnx-x
lnW ( N ln N N ) [( n1 ln n1 n1 ) ... (nr ln nr nr )]
Q N n1 n2 ... nr
lnW N ln N n1 ln n1 ... nr ln nr
( n1 ... nr ) ln N n1 ln n1 ... nr ln nr
n1
n
n
n2 ln 2 ... nr ln r
N
N
N
n1 ln p1 n2 ln p2 ... nr ln pr
n1 ln
r

ni ln pi
i 1

N pi ln pi
i 1

3.3 JAYNES FRAMEWORK

Another view to statistical mechanics

Subjective explanation of probability
Subjective statistical physics

MAXENT FRAMEWORK

S pi log pi

max

s.t.

pE
i

s constraints

ij

E j ,

j 1,2,..., s

 (MEP)
S pi log 2 pi

pi i =i
N
b
S a f x ln f x dx 1
n

1
f x

LAGRANGIAN METHOD
.
n
f x1 .x.2 , x
m
n)

m<n

)0

y.
x. 2. , x
1(x 1

y.
x
. .2 , x
2 (x1

)0

...
ym (x1.
x2 . . , x

)0

F
F.
(x1 x.2 . , x.
. f, (x
x 1 x 2 y. .n.),xC1 1(x1 x 2
n ).
C2y.
x
. .2 , x
2 (x 1

) ...y
Cm m (x1 x 2

:
ym
F
f
y1
0
C1
... Cm
X 1
X 1
X 1
X 1
...
ym
y1
F
f
0
C1
... Cm
X n
X n
X n
X n

. . . , xn )

1 f x dx

a

2 1

C1

F f =0 f x F

F f x ln f x dx C1

ln f x C1 1

f x dx 1

1
,a x b
f ba
0, x a x b

f x

2.
2

f x dx
xf x dx

x l Nf ( x) dx
C 3
C
2
1

1 F

F f =0

f x ln f x dx C1

C
f x dx 1

a
xf x dx

ln f x 1 C C
2 3
x
1

1 ux
f x e
u

1000

H
i
s
t
o
g
r
a
m00..18

FX

Frequncy

3
0
2
0
0
.
6
0
.
4
1
0
0
.
2
0
.
0
.
2
0
.
4
0
.
6
0
.
8
0
.
1
0
.
0
00
.2
0
.4
0
.
6
0
.
8
0
.
1
0
.
0
V
A
R
0
2
V
A
R
01

3
b

1 f x dx

x 4

f x ln xdx

2
C
2
4

b
b
b
C
u
1
F f x ln f x dx C1 f x dx 1
f x ln xdx
a
a

2 a

F f =0
ln f x 1 C1 C2 ln x

,
1 x b

f ( x) exp 1 C1 x C2

u
-1 f x f x

Zipf
1
1
ln u

1 1 ln1u
f x
x
ln u

4.

f x exp 1 Ci ui x

ui x
i
i
Ci

2 m
ki

ki ui x f x dx i 1

 (MEPP)

REFERENCE
Wulingfei Maximum Entropy , Bayesian Inference and Evolution


From Statistical Physics to Maximum Entropy Framework