, . . . , (. 13.7)
. 13.7.
, X (x 1,..., xn) Y (y 1,..., yn). , X Y (X, Y) . X , , . , , , , xi =1, , xi =0 - . , 32 .
, , . :
1. (X, Y) X .
2. .
3. () ( ).
4. , .
5. 1 4 , .
1 2 , .
. 3 OUT . 4 , .
1 2 , . 3 4 , . .
. X, Y. Y T :
e = T - Y
, NET . F NET OUT . OUT . , .
|
|
. W, wij - i (, 2) j ( 3). NET - :
NET = XW.
F NET OUT:
OUT = F (XW).
.
. . , - . 13.3. .
p j q (.13.8). OUT k, T, , [ OUT (1- OUT)], k, , ,
d = OUT (1- OUT) (T - OUT)
d OUT j, .
D wpq, k = hdq,k * OUTp,q
dq,k - d q k; OUTp,q - j.
h (0,01£ h £1) . :
wpq,k (n +1)= wpq,k (n)+D wpq,k | (13.17) |
wpq,k (n) - k q n ( ); , , , .
. 13.8. |
wpq,k (n +1) - n +1 .
. , , . , d . d , .
d, , , :
dp,j = OUTp,j (1- OUTp,j)(S dq,k×wpq,k) | (13.18) |
d c (13.16) (13.17) ( 13.9).
. 13.9. |
d , . , .
. Dk - d W k, . d - Dj :
1. d - Dk W ¢ k, .
|
|
Dj = Dk × W ¢ k | (13.19) |
2. :
$ [ OUTj (I- OUTj)] | (13.20) |
$ . OUTj - j i - , 1.