Digital Symposium Collection 2000

DynaMat: A Dynamic View Management System for Data Warehouses Yannis Kotidis and Nick Roussopoulos   View Paper (PDF)   Return to Datacubes and Data Warehouses Abstract Pre-computation and materialization of views with aggregate functions is a common technique in Data Warehouses. Due to the complex structure of the warehouse and the different profiles of the users who submit queries, there is need for tools that will automate the selection and management of the materialized data. In this paper we present DynaMat, a system that dynamically materializes information at multiple levels of granularity in order to match the demand (workload) but also takes into account the maintenance restrictions for the warehouse, such as down time to update the views and space availability. DynaMat unifies the view selection and the view maintenance problems under a single framework using a novel “goodness” measure for the materialized views. DynaMat constantly monitors incoming queries and materializes the best set of views subject to the space constraints. During updates, DynaMat reconciles the current materialized view selection and refreshes the most beneficial subset of it within a given maintenance window. We compare DynaMat against a system that is given all queries in advance and the pre-computed optimal static view selection. The comparison is made based on a new metric, the Detailed Cost Savings Ratio introduced for quantifying the benefits of view materialization against incoming queries. These experiments show that DynaMat’s dynamic view selection outperforms the optimal static view selection and thus, any sub-optimal static algorithm that has appeared in the literature. References Note: References link to DBLP on the Web. [AAD+96] Sameet Agarwal , Rakesh Agrawal , Prasad Deshpande , Ashish Gupta , Jeffrey F. Naughton , Raghu Ramakrishnan , Sunita Sarawagi : On the Computation of Multidimensional Aggregates. VLDB 1996 : 506-521 [ACT97] ... [Aut] ... [BDD+98] Randall G. Bello , Karl Dias , Alan Downing , James Feenan Jr. , William D. Norcott , Harry Sun , Andrew Witkowski , Mohamed Ziauddin : Materialized Views in Oracle. VLDB 1998 : 659-664 [BPT97] Elena Baralis , Stefano Paraboschi , Ernest Teniente : Materialized Views Selection in a Multidimensional Database. VLDB 1997 : 156-165 [CR94] Chungmin Melvin Chen , Nick Roussopoulos : The Implementation and Performance Evaluation of the ADMS Query Optimizer: Integrating Query Result Caching and Matching. EDBT 1994 : 323-336 [DDJ+98] Lyman Do , Pamela Drew , Wei Jin , Vish Jumani , David Van Rossum : Issues in Developing Very Large Data Warehouses. VLDB 1998 : 633-636 [DFJ+96] Shaul Dar , Michael J. Franklin , Björn Þór Jónsson , Divesh Srivastava , Michael Tan : Semantic Data Caching and Replacement. VLDB 1996 : 330-341 [DR92] Alex Delis , Nick Roussopoulos : Performance and Scalability of Client-Server Database Architectures. VLDB 1992 : 610-623 [DRSN98] Prasad Deshpande , Karthikeyan Ramasamy , Amit Shukla , Jeffrey F. Naughton : Caching Multidimensional Queries Using Chunks. SIGMOD Conference 1998 : 259-270 [GBLP96] Jim Gray , Adam Bosworth , Andrew Layman , Hamid Pirahesh : Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total. ICDE 1996 : 152-159 [GHRU97] Himanshu Gupta , Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Index Selection for OLAP. ICDE 1997 : 208-219 [GL95] Timothy Griffin , Leonid Libkin : Incremental Maintenance of Views with Duplicates. SIGMOD Conference 1995 : 328-339 [GMS93] Ashish Gupta , Inderpal Singh Mumick , V. S. Subrahmanian : Maintaining Views Incrementally. SIGMOD Conference 1993 : 157-166 [Gup97] Himanshu Gupta : Selection of Views to Materialize in a Data Warehouse. ICDT 1997 : 98-112 [HRU96] Venky Harinarayan , Anand Rajaraman , Jeffrey D. Ullman : Implementing Data Cubes Efficiently. SIGMOD Conf. 1996 : 205-216 [JMS95] H. V. Jagadish , Inderpal Singh Mumick , Abraham Silberschatz : View Maintenance Issues for the Chronicle Data Model. PODS 1995 : 113-124 [KB96] Arthur M. Keller , Julie Basu : A Predicate-based Caching Scheme for Client-Server Database Architectures. VLDB Journal 5(1) : 35-47(1996) [Kim96] Ralph Kimball : The Data Warehouse Toolkit: Practical Techniques for Building Dimensional Data Warehouses. John Wiley 1996, ISBN 0-471-15337-0 [KR98] Yannis Kotidis , Nick Roussopoulos : An Alternative Storage Organization for ROLAP Aggregate Views Based on Cubetrees. SIGMOD Conference 1998 : 249-258 [MQM97] Inderpal Singh Mumick , Dallan Quass , Barinderpal Singh Mumick : Maintenance of Data Cubes and Summary Tables in a Warehouse. SIGMOD Conference 1997 : 100-111 [RK86] Nick Roussopoulos , Hyunchul Kang : Preliminary Design of ADMS±: A Workstation-Mainframe Integrated Architecture for Database Management Systems. VLDB 1986 : 355-364 [RKR97] Nick Roussopoulos , Yannis Kotidis , Mema Roussopoulos : Cubetree: Organization of and Bulk Updates on the Data Cube. SIGMOD Conference 1997 : 89-99 [RL85] Nick Roussopoulos , Daniel Leifker : Direct Spatial Search on Pictorial Databases Using Packed R-Trees. SIGMOD Conference 1985 : 17-31 [Rou91] Nick Roussopoulos : An Incremental Access Method for ViewCache: Concept, Algorithms, and Cost Analysis. TODS 16(3) : 535-563(1991) [SDN98] Amit Shukla , Prasad Deshpande , Jeffrey F. Naughton : Materialized View Selection for Multidimensional Datasets. VLDB 1998 : 488-499 [SS94] Sunita Sarawagi , Michael Stonebraker : Efficient Organization of Large Multidimensional Arrays. ICDE 1994 : 328-336 [SSV96] Peter Scheuermann , Junho Shim , Radek Vingralek : WATCHMAN : A Data Warehouse Intelligent Cache Manager. VLDB 1996 : 51-62 [TS97] Dimitri Theodoratos , Timos K. Sellis : Data Warehouse Configuration. VLDB 1997 : 126-135 [ZDN97] Yihong Zhao , Prasad Deshpande , Jeffrey F. Naughton : An Array-Based Algorithm for Simultaneous Multidimensional Aggregates. SIGMOD Conference 1997 : 159-170 BIBTEX @inproceedings{DBLP:conf/sigmod/KotidisR99,   author    = {Yannis Kotidis and                 Nick Roussopoulos},    editor    = {Alex Delis and                 Christos Faloutsos and                 Shahram Ghandeharizadeh},    title     = {DynaMat: A Dynamic View Management System for Data Warehouses},    booktitle = {SIGMOD 1999, Proceedings ACM SIGMOD International Conference                 on Management of Data, June 1-3, 1999, Philadephia, Pennsylvania,                 USA},    publisher = {ACM Press},    year      = {1999},    isbn      = {1-58113-084-8},    pages     = {371-382},    crossref  = {DBLP:conf/sigmod/99},    bibsource = {DBLP, http://dblp.uni-trier.de} } }, Copyright(C) 2000 ACM