Digital Symposium Collection 2000

Aggregation Algorithms for Very Large Compressed Data Warehouses Jianzhong Li, Doron Rotem, and Jaideep Srivastava   View Paper (PDF)   Return to Aggregation Algorithms Abstract Many efficient algorithms to compute multidimensional aggregation and Cube for relational OLAP have been developed. However, to our knowledge, there is nothing to date in the literature on aggregation algorithms on compressed data warehouses for multidimensional OLAP. This paper presents a set of aggregation algorithms on very large compressed data warehouses for multidimensional OLAP. These algorithms operate directly on compressed datasets without the need to first decompress them. They are applicable to data warehouses that are compressed using variety of data compression methods. The algorithms have different performance behavior as a function of dataset parameters, sizes of outputs and main memory availability. The analysis and experimental results show that the algorithms have better performance than the traditional aggregation algorithms. References Note: References link to DBLP on the Web. [1] Jim Gray , Surajit Chaudhuri , Adam Bosworth , Andrew Layman , Don Reichart , Murali Venkatrao , Frank Pellow , Hamid Pirahesh : Data Cube: A Relational Aggregation Operator Generalizing Group-by, Cross-Tab, and Sub Totals. Data Mining and Knowledge Discovery 1(1) : 29-53(1997) [2] ... [3] ... [4] Damianos Chatziantoniou , Kenneth A. Ross : Querying Multiple Features of Groups in Relational Databases. VLDB 1996 : 295-306 [5] ... [6] ... [7] George Colliat : OLAP, Relational, and Multidimensional Database Systems. SIGMOD Record 25(3) : 64-69(1996) [8] Mostafa A. Bassiouni : Data Compression in Scientific and Statistical Databases. TSE 11(10) : 1047-1058(1985) [9] Mark A. Roth , Scott J. Van Horn : Database Compression. SIGMOD Record 22(3) : 31-39(1993) [10] Yihong Zhao , Prasad Deshpande , Jeffrey F. Naughton : An Array-Based Algorithm for Simultaneous Multidimensional Aggregates. SIGMOD Conference 1997 : 159-170 [11] Goetz Graefe : Query Evaluation Techniques for Large Databases. Computing Surveys 25(2) : 73-170(1993) [12] Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Implementing Data Cubes Efficiently. SIGMOD Conf. 1996 : 205-216 [13] Himanshu Gupta , Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Index Selection for OLAP. ICDE 1997 : 208-219 [14] Yannis Kotidis , Nick Roussopoulos : An Alternative Storage Organization for ROLAP Aggregate Views Based on Cubetrees. SIGMOD Conference 1998 : 249-258 [15] Nick Roussopoulos , Yannis Kotidis , Mema Roussopoulos : Cubetree: Organization of and Bulk Updates on the Data Cube. SIGMOD Conference 1997 : 89-99 [16] Sameet Agarwal , Rakesh Agrawal , Prasad Deshpande , Ashish Gupta , Jeffrey F. Naughton , Raghu Ramakrishnan , Sunita Sarawagi : On the Computation of Multidimensional Aggregates. VLDB 1996 : 506-521 [17] Arie Shoshani : Statistical Databases: Characteristics, Problems, and some Solutions. VLDB 1982 : 208-222 [18] Meng Chang Chen , Lawrence McNamee : On the Data Model and Access Method of Summary Data Management. TKDE 1(4) : 519-529(1989) [19] Jaideep Srivastava , Jack S. Eddy Tan , Vincent Y. Lum : TBSAM: An Access Method for Efficient Processing of Statistical Queries. TKDE 1(4) : 414-423(1989) [20] Zbigniew Michalewicz : Statistical and Scientific Databases. Ellis Horwood 1992 [21] Susan J. Eggers , Arie Shoshani : Efficient Access of Compressed Data. VLDB 1980 : 205-211 [22] ... [23] ... BIBTEX @inproceedings{DBLP:conf/vldb/LiRS99,   author    = {Jianzhong Li and                 Doron Rotem and                 Jaideep Srivastava},    editor    = {Malcolm P. Atkinson and                 Maria E. Orlowska and                 Patrick Valduriez and                 Stanley B. Zdonik and                 Michael L. Brodie},    title     = {Aggregation Algorithms for Very Large Compressed Data Warehouses},    booktitle = {VLDB'99, Proceedings of 25th International Conference on Very                 Large Data Bases, September 7-10, 1999, Edinburgh, Scotland,                 UK},    publisher = {Morgan Kaufmann},    year      = {1999},    isbn      = {1-55860-615-5},    pages     = {651-662},    crossref  = {DBLP:conf/vldb/99},    bibsource = {DBLP, http://dblp.uni-trier.de} } }, Copyright(C) 2000 ACM