, :
ETL;
ETL ;
ETL - ;
ETL - ;
ETL-;
:
, , ;
ETL -;
ETL -.
: [3], [14], [33], [ [ 32 ] 32], [51].
, . , .
, . , .
ETL (extraction, transformation, loading , ) .
ETL ETL, , ETL -. ETL , , , .
ETL - , , . , ETL - -. ETL .
ETL - . ETL . -, , , , , . -, ETL . ETL , . , ETL - 80% . -, ETL . -, ETL , . -, ETL .
|
|
. 15.1 ETL - .
. 15.1. ETL
, ETL , , , Data mining.
, ETL .
( ), ( ).
, , , .
, .
ETL-
ETL. , (Data Staging Area), , , . 15.2.
. 15.2. ETL-
. ETL ETL - , . 15.3.
. 15.3. ETL-
, . . , .
ETL, , . . MPP .
, , ETL - .
1. ETL - , , , .
2. , ETL -.
3. ETL -.
4. log- , . log- ETL -.
, , ETL - .
|
|
1. ETL - ETL -, . ETL .
2. ETL - . ETL -, .
3. ETL - . . .
, ETL - - ETL -, , ETL -. . , , ETL .
ETL-
, ETL .
ETL-, -, , .
, , .
, , ETL.
ETL-
, . .
, (, ). - . , : SMS-. .
, , , , , , , .
, . .
. 15.4.
, . 15.5.
. 15.4.
. 15.5. ETL-
, - .
|
|
.
ETL- ETL -. (IBM, Oracle, MicroSoft), (Sunopsis). ETL - , .
, , , . ETL -: 1) ; 2) ETL.
, ETL . ETL -.
:
, , - ;
, ;
;
(), ;
.
ETL -:
, , , ETL;
, , ETL;
, , ETL, ;
;
ETL , , .
ETL, - ERP-. , . ERP- , -, . , ETL ERP-, ERP- . ERP- ETL , ERP-.
.
, .
, , . , , , , ( ETL / ).
|
|
: 336.71: 004.73
. . , . . ,
. ,
. . , ,
̲ OLAP-˲
ֲ.
. -
-
. -
.
- OLAP.
² . , , OLAP-,
ETL-, OLTP-, .
. -
.
-
.
.
-
OLAP.
. , , OLAP-,
ETL-, OLTP-, .
ANNOTATION. Current article describes the data warehouse (storage) creation
for a bank. DW will help to analyze the banking activity. It was analyzed the main
data warehouse architectures and was shown the necessity of the DW creation
for the banking data. It was reviewed and analyzed conceptual approaches for
the building a data warehouse model. The article presents the main types of
analysis of the banking activity on the base of the data warehouse and shows the
methods for creation of the information-analytical banking system on the OLAP
technology base.
KEY WORDS. Data warehouse (storage), data mart, OLAP-system,
EL-system, OLTP-system, analytical task.
-
. -
,
() -
- -
. . , . . , 2011 .
- , ,
볺 -
,
(OLTP- OnLine Transactional Processing). -
-
, -
(̲S Management Information
Systems), ,
.
, -
,
,
. -
,
-
.
-
-.
, -
OLAP (On-Line Analytical Processing). -
-
.
, .
, -
(Data Warehouse).
-
|
|
,
.
-
OLA (On-Line AnalyticalProcessing), , -
,
(Data Mining). Data Mining
, ,
,
.
OLA
Data Mining. [7, 8] -
OLA Mining OLAM.
-
-, , -
, [5].
: -
.
(Corporate
Information Factory CIF)
(nterprise Data Warehouses EDW)
, -
,
. -
, .
,
.
ʳ (data marts) -
, -
, , . ʳ -
,
ʳ
( )
.
34 .
-
-
㳿.
-
:
(Corporate Information Factory,
CIF) [5] (Data
Warehouse Bus, BUS) ʳ (Ralph Kim-
ball) [6].
CIF
, -
.
,
-. -
. ,
, -.
,
3.
-
.
-
.
C (data-mart bus
architecture with linked dimensional data marts BUS)
ʳ (Ralph Kimball)
.
-
,
. -
, -
() ,
.
, -,
- .
.
, ,
-
-.
,
, -
, [1, 3].
[4] -
:
DW = < DB, rf, RF, rm, R, func>,
DB ;
rf ;
RF rf;
rm ;
R rm;
func ().
-
. -
: ()
.
㳿:
볿 .
, -
-
, .
, -
-
.
볿 ,
,
,
on-line-. 㳿
볿
.
, on-line
.
- ,
볺 , -
, -
c
, 볺
.
볺 볿
,
- .
.
,
,
, -
-
.
, -
-
, , ,
,
,
. , -
,
-
-
.
.
.
,
-
,
.
OLTP-, . ʳ-
T-.
OLTP-
. 1.
...
OLTP-
OLTP-
OLTP-
OLTP-
ϳ
ϳ
ELT
OLAP (OLAM) Data Mining
. 1. OLTP-
,
. , -
. -
, - .
-, -
, -, .
ETL- (Extraction, Transformation, Loading),
, -
. ETL- -
OLTP- , -.
, ,
, ,
, ,
, , -
, ,
.
-
, .
OLAP-㳿
.
, -
, -
, ,
.
-
,
-
, ᒺ ()
.
[2]: ,
+
볺 + ,
( ), -
.
(, -
, ), ( ), ,
, .
RS-DataHouses : , , -
( ), ,
, Forex- SWAP, -
. , -
,
, ,
,
.
, ,
, , ,
, , -
, , (, -
, ,
).
,
. , -
:
1. - , -
, , , .
-
.
2. , -
.
, -
.
3. ,
.
,
.
4.
.
5. -
, -, -.
6.
. -
, , -
,
.
,
: ,
, 볺, -
, , -
, .
. -
[9].
,
OLTP-
(Oracle, SQLServer, Sybase, DB2), -
(dimensional model)
(star schema) (snowflake schema),
.
Basel II,
,
. -
,
, -
.
-
- ,
:
OLTP-,
;
ELT- , -
;
;
OLAP -;
.
-
IBM Cognos SAP Business Objects,
OLAP. - (Business
Intelligence, BI) --
-
: Actuate, Arcplan, Brio, Computer Associates,
Crystal, Hummingbird, Hyperion, Informatica, Information Builders,
Microsoft, MicroStrategy, Oracle, Peoplesoft, ProClarity, SAP, SAS,
Siebel.
˳
1. . I.
http://www.ibm.com/developerworks/ru/library/sabir/axd_1/index.html. 2. ., . RS-DataHouse // -
RS-Club. 4. 2006. . 6468.
3. . , ,
. . 1: . . .: , 2001
4. .., ..
.http://www.vstu.vinnica.ua/~oeipt/-
files/index_18.files/6.pdf
5. W. H. Inmon, Building the Data Warehouse, QED/Wiley, 1991.
6. Data-Warehousing-Kimball-Model-vs-Inmon-Model
http://www.scribd.com/doc/15487492/
7. Hap J. OLA Mining An Integration of OLA with Data Mining //
Proc. IFIP Conf jn Data Semantics Switzerland. 1997
8. Parsaye K. OLA and Data Mining: Bridging the Gap// Database
Programming and Design. 1997. 2.
9. . . : . .
.: , 2004. 348 .
12.05.2011 .
: " ETL OLAP . . ." :
1 |
ETL OLAP . . |
2 |
1000 , . , . , . : , . |
3 |
OLAP OLAP () OLTP OLAP (), . |
4 |
OLAP |
5 |
6 |
7 |
8 |
: , . , .. , |
9 |
10 |
11 |
1 |
12 |
1 |
13 |
14 |
1 |
15 |
1 2007I5051059341828813,823398274185 504,051387501229592443301392 MAPE 0,450131,54610,85 MAD 2,35562375730151432 158 800 |
16 |
OLAP MS SQL Server 2005 , . OLAP VSFSS, , 80% OLAP-, . . , . . |
ETL OLAP
..
. .. ,
03028, , 43, . 70.
.: 524 5330, [email protected]
BI .
OLAP .
In the report questions of use of decisions BI in the financial organisations of Ukraine are considered. Practical recommendations about
construction OLAP of decisions and their application for forecasting of accounting balance are resulted.
-, ,
, . ,
.
, ,
, , .
IT,
.
, , , ,
.
:
1. , :
) ;
) .
2. .
3. .
4. .
, ,
,
. OLAP,
OLTP.
OLAP , OLTP .
, ETL .
OLAP , API MDX.
,
OLAP pivot-.
ETL, OLAP BI.
, OLAP
.
: OLAP, BI, SSIS, REPORTS, ETL
OLAP (Online analysis processing)
OLTP (Online transaction processing)
ETL (Extract Transform Load)
MDX (Multidimensional Expressions)
BI (Business Intelligent)
VSFSS Visual studio for sql server
SQL (Structural query language)
DDL (Data definition language)
1.
80% ,
.
OLAP- .
, ,
. ,
, ,
. , ,
.
,
, , OLTP , ,
, , OLAP .
OLAP .
OLAP
.
. .
. 1000 ,
. ,
. ,
.
: ,
.
BI .
2. OLAP
.
1. OLAP .
2. () OLTP OLAP .
3. (), .
4. .
1. OLAP . OLAP .
, :
- , , , ,
;
- , , ,
, ;
- .
OLAP [1, 2]
2. OLTP OLAP. OLAP OLTP
. , OLTP , OLAP
. ,
OLTP OLAP.
, , .
OLAP ETL,
:
- , .. OLTP ;
- , .. OLTP OLAP ;
- , .. OLAP .
3. , . OLAP ().
, (measures), (dimensions)
( ).
,
; ,
. , .
,
. ,
, .
4. .
. :
- OLAP;
- ;
- , ,
;
- ;
- , .
3. OLAP-
BI- MS SQL Server 2005,
.
, 2.
:
1. OLAP ,
SQL DDL. MS SQL Server 2005 Visio 2003
(2007).
2. Visual Studio 2005, MS SQL Server
2005 ( 2, 3, 4):
) (Integration services project). ,
OLAP ( ), .. ETL;
) (Analysis services project).
. ,
, , ,
// / ,
, ;
) (Report server project (Report server project wizard)).
, pivot-, ,
, ..
1 OLAP .
. 1.
. 1.
DimBalance , ; DimDayDate ,
. , ,
..; DimAlgArticle , , ..;
DimAlgItem ; FactAmounts , , .
2 OLTP OLAP.
. 2.3.
3 (), .
, . 2.
, (
). , Bank Analit.ds;
(Data Sources Views),
, 3.1. , Bank
Analit.dsv; , Bank Analit.cube. ,
3:
) ;
) ;
)
, , . 3.1:
DimBalance.dim; DimDayDate.dim; DimAlgItem.dim; DimAlgArticle.dim.
4. .
MS Excel 2003, . 4; MS SQL Server 2005 Reports Services,
. 5.
, MS Excel 2003
pivot-,
.
, VSFS
.
. 4. MS Excel 2003
. 2. OLAP
. 3. OLAP
. 5.
4.
, [4] ,
. ,
,
.
:
1. ,
.
2. .
3. , ..
, .
4. .
5. .
[4] , .
.
.
, ,
0 .
2001 2006. 0
.
(. 6 7):
1. -0,774.
2. 0 0,947.
2 4 6 8 10 12 14 16 18 20 22 24
2 4 6 8 10 12 14 16 18 20 22 24
500
. 6.
2 4 6 8 10 12 14 16 18 20 22 24
2 4 6 8 10 12 14 16 18 20 22 24
. 7. 0
,
.
, .
, . 8 9,
.
(
). ,
, .
4- .
1 2 3 4 5 6
1,0
0,8
0,6
0,4
0,2
0,0
-0,2
-0,4
-0,6
-0,8
-1,0
1 2 3 4 5 6
1,0
0,8
0,6
0,4
0,2
0,0
-0,2
-0,4
-0,6
-0,8
-1,0
. 8.
1 2 3 4 5 6
1,0
0,8
0,6
0,4
0,2
0,0
-0,2
-0,4
-0,6
-0,8
-1,0
1 2 3 4 5 6
1,0
0,8
0,6
0,4
0,2
0,0
-0,2
-0,4
-0,6
-0,8
-1,0
. 9.
0
2.
0
2007 I 505 10593418 28813,82289 398274185,2
504,05 13875012 29592 443301392
MAPE 0,4501 31,54 6 10,85
MAD 2,3556 2 375 730 1514 32 158 800
, MAPE 1,8 ,
.
,
.