Digital Symposium Collection 2000

Extending Practical Pre-Aggregation in On-Line Analytical Processing Torben Bach Pedersen, Christian S. Jensen, and Curtis E. Dyreson   View Paper (PDF)   Return to Aggregation Algorithms Abstract On-Line Analytical Processing (OLAP) based on a dimensional view of data is being used increasingly for the purpose of analyzing very large amounts of data. To improve query performance, modern OLAP systems use a technique known as practical pre-aggregation, where select combinations of aggregate queries are materialized and reused to compute other aggregates; full pre-aggregation, where all combinations of aggregates are materialized, is infeasible. However, this reuse of aggregates is contingent on the dimension hierarchies and the relationships between facts and dimensions satisfying stringent constraints, which severely limits the scope of practical pre-aggregation. This paper significantly extends the scope of practical pre-aggregation to cover a much wider range of realistic situations. Specifically, algorithms are given that transform "irregular" dimension hierarchies and fact-dimension relationships, which often occur in real-world OLAP applications, into well-behaved structures that, when used by existing OLAP systems, enable practical pre-aggregation. The algorithms have low computational complexity and may be applied incrementally to reduce the cost of updating OLAP structures. References Note: References link to DBLP on the Web. [1] Elena Baralis , Stefano Paraboschi , Ernest Teniente : Materialized Views Selection in a Multidimensional Database. VLDB 1997 : 156-165 [2] ... [3] Divesh Srivastava , Shaul Dar , H. V. Jagadish , Alon Y. Levy : Answering Queries with Aggregation Using Views. VLDB 1996 : 318-329 [4] Curtis E. Dyreson : Information Retrieval from an Incomplete Data Cube. VLDB 1996 : 532-543 [5] Jim Gray , Surajit Chaudhuri , Adam Bosworth , Andrew Layman , Don Reichart , Murali Venkatrao , Frank Pellow , Hamid Pirahesh : Data Cube: A Relational Aggregation Operator Generalizing Group-by, Cross-Tab, and Sub Totals. Data Mining and Knowledge Discovery 1(1) : 29-53(1997) [6] Ashish Gupta , Venky Harinarayan , Dallan Quass : Aggregate-Query Processing in Data Warehousing Environments. VLDB 1995 : 358-369 [7] Himanshu Gupta , Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Index Selection for OLAP. ICDE 1997 : 208-219 [8] Himanshu Gupta : Selection of Views to Materialize in a Data Warehouse. ICDT 1997 : 98-112 [9] Himanshu Gupta , Inderpal Singh Mumick : Selection of Views to Materialize Under a Maintenance Cost Constraint. ICDT 1999 : 453-470 [10] Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Implementing Data Cubes Efficiently. SIGMOD Conf. 1996 : 205-216 [11] ... [12] ... [13] Ralph Kimball : The Data Warehouse Toolkit: Practical Techniques for Building Dimensional Data Warehouses. John Wiley 1996, ISBN 0-471-15337-0 [14] ... [15] Hans-J. Lenz , Arie Shoshani : Summarizability in OLAP and Statistical Data Bases. SSDBM 1997 : 132-143 [16] ... [17] ... [18] Inderpal Singh Mumick , Dallan Quass , Barinderpal Singh Mumick : Maintenance of Data Cubes and Summary Tables in a Warehouse. SIGMOD Conference 1997 : 100-111 [19] ... [20] ... [21] Torben Bach Pedersen , Christian S. Jensen : Multidimensional Data Modeling for Complex Data. ICDE 1999 : 336-345 [22] ... [23] Dallan Quass , Jennifer Widom : On-Line Warehouse View Maintenance. SIGMOD Conference 1997 : 393-404 [24] Maurizio Rafanelli , Arie Shoshani : STORM: A Statistical Object Representation Model. SSDBM 1990 : 14-29 [25] Amit Shukla , Prasad Deshpande , Jeffrey F. Naughton , Karthikeyan Ramasamy : Storage Estimation for Multidimensional Aggregates in the Presence of Hierarchies. VLDB 1996 : 522-531 [26] Dimitri Theodoratos , Timos K. Sellis : Data Warehouse Configuration. VLDB 1997 : 126-135 [27] Jennifer Widom : Research Problems in Data Warehousing. CIKM 1995 : 25-30 [28] ... [29] ... [30] Jian Yang , Kamalakar Karlapalem , Qing Li : Algorithms for Materialized View Design in Data Warehousing Environment. VLDB 1997 : 136-145 BIBTEX @inproceedings{DBLP:conf/vldb/PedersenJD99,   author    = {Torben Bach Pedersen and                 Christian S. Jensen and                 Curtis E. Dyreson},    editor    = {Malcolm P. Atkinson and                 Maria E. Orlowska and                 Patrick Valduriez and                 Stanley B. Zdonik and                 Michael L. Brodie},    title     = {Extending Practical Pre-Aggregation in On-Line Analytical Processing},    booktitle = {VLDB'99, Proceedings of 25th International Conference on Very                 Large Data Bases, September 7-10, 1999, Edinburgh, Scotland,                 UK},    publisher = {Morgan Kaufmann},    year      = {1999},    isbn      = {1-55860-615-5},    pages     = {663-674},    crossref  = {DBLP:conf/vldb/99},    bibsource = {DBLP, http://dblp.uni-trier.de} } }, Copyright(C) 2000 ACM