ACM SIGMOD Anthology ACM SIGMOD dblp.uni-trier.de

Query Caching and Optimization in Distributed Mediator Systems.

Sibel Adali, K. Selçuk Candan, Yannis Papakonstantinou, V. S. Subrahmanian: Query Caching and Optimization in Distributed Mediator Systems. SIGMOD Conference 1996: 137-148
@inproceedings{DBLP:conf/sigmod/AdaliCPS96,
  author    = {Sibel Adali and
               K. Sel\c{c}uk Candan and
               Yannis Papakonstantinou and
               V. S. Subrahmanian},
  editor    = {H. V. Jagadish and
               Inderpal Singh Mumick},
  title     = {Query Caching and Optimization in Distributed Mediator Systems},
  booktitle = {Proceedings of the 1996 ACM SIGMOD International Conference on
               Management of Data, Montreal, Quebec, Canada, June 4-6, 1996},
  publisher = {ACM Press},
  year      = {1996},
  pages     = {137-148},
  ee        = {http://doi.acm.org/10.1145/233269.233327, db/conf/sigmod/AdaliCPS96.html},
  crossref  = {DBLP:conf/sigmod/96},
  bibsource = {DBLP, http://dblp.uni-trier.de}
}
BibTeX

Abstract

Query processing and optimization in mediator systems that access distributed non-proprietary sources pose many novel problems. Cost-based query optimization is hard because the mediator does not have access to source statistics information and furthermore it may not be easy to model the source's performance. At the same time, querying remote sources may be very expensive because of high connection overhead, long computation time, financial charges, and temporary unavailability. We propose a cost-based optimization technique that caches statistics of actual calls to the sources and consequently estimates the cost of the possible execution plans based on the statistics cache. We investigate issues pertaining to the design of the statistics cache and experimentally analyze various tradeoffs. We also present a query result caching mechanism that allows us to effectively use results of prior queries when the source is not readily available. We employ the novel invariants mechanism, which shows how semantic information about data sources may be used to discover cached query results of interest.

Copyright © 1996 by the ACM, Inc., used by permission. Permission to make digital or hard copies is granted provided that copies are not made or distributed for profit or direct commercial advantage, and that copies show this notice on the first page or initial screen of a display along with the full citation.


BibTeX

Printed Edition

H. V. Jagadish, Inderpal Singh Mumick (Eds.): Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, Montreal, Quebec, Canada, June 4-6, 1996. ACM Press 1996 BibTeX , SIGMOD Record 25(2), June 1996
Contents

Online Edition: ACM Digital Library

[Index Terms]

References

[1]
Serge Abiteboul, Anthony J. Bonner: Objects and Views. SIGMOD Conference 1991: 238-247 BibTeX
[2]
Serge Abiteboul, Sophie Cluet, Tova Milo: Querying and Updating the File. VLDB 1993: 73-84 BibTeX
[3]
Sibel Adali, K. Selçuk Candan, Su-Shing Chen, Kutluhan Erol, V. S. Subrahmanian: The Advanced Video Information System: Data Structures and Query Processing. Multimedia Syst. 4(4): 172-186(1996) BibTeX
[4]
Sibel Adali, V. S. Subrahmanian: Amalgamating Knowledge Bases, III: Algorithms, Data Structures, and Query Processing. J. Log. Program. 28(1): 45-88(1996) BibTeX
[5]
Sibel Adali, Ross Emery: A Uniform Framework for Integrating Knowledge in Heterogeneous Knowledge Systems. ICDE 1995: 513-520 BibTeX
[6]
...
[7]
José A. Blakeley, Neil Coburn, Per-Åke Larson: Updating Derived Relations: Detecting Irrelevant and Autonomously Computable Updates. ACM Trans. Database Syst. 14(3): 369-400(1989) BibTeX
[8]
Stefano Ceri, Jennifer Widom: Deriving Production Rules for Incremental View Maintenance. VLDB 1991: 577-589 BibTeX
[9]
Umeshwar Dayal: Queries and Views in an Object-Oriented Data Model. DBPL 1989: 80-102 BibTeX
[10]
Umeshwar Dayal, Hai-Yann Hwang: View Definition and Generalization for Database Integration in a Multidatabase System. IEEE Trans. Software Eng. 10(6): 628-645(1984) BibTeX
[11]
Narain H. Gehani, H. V. Jagadish, William D. Roome: OdeFS: A File System Interface to an Object-Oriented Database. VLDB 1994: 249-260 BibTeX
[12]
Ashish Gupta, Dinesh Katiyar, Inderpal Singh Mumick: Counting solutions to the View Maintenance Problem. Workshop on Deductive Databases, JICSLP 1992: 185-194 BibTeX
[13]
Ashish Gupta, Inderpal Singh Mumick, V. S. Subrahmanian: Maintaining Views Incrementally. SIGMOD Conference 1993: 157-166 BibTeX
[14]
Eric N. Hanson: A Performance Analysis of View Materialization Strategies. SIGMOD Conference 1987: 440-453 BibTeX
[15]
Alfons Kemper, Christoph Kilger, Guido Moerkotte: Function Materialization in Object Bases: Design, Realization, and Evaluation. IEEE Trans. Knowl. Data Eng. 6(4): 587-608(1994) BibTeX
[16]
Laks V. S. Lakshmanan, Fereidoon Sadri, Iyer N. Subramanian: On the Logical Foundations of Schema Integration and Evolution in Heterogeneous Database Systems. DOOD 1993: 81-100 BibTeX
[17]
Laks V. S. Lakshmanan, Fereidoon Sadri, Iyer N. Subramanian: Logic and Algebraic Languages for Interoperability in Multidatabase Systems. J. Log. Program. 33(2): 101-149(1997) BibTeX
[18]
...
[19]
James J. Lu, Guido Moerkotte, Joachim Schü, V. S. Subrahmanian: Efficient Maintenance of Materialized Mediated Views. SIGMOD Conference 1995: 340-351 BibTeX
[20]
James J. Lu, Anil Nerode, V. S. Subrahmanian: Hybrid Knowledge Bases. IEEE Trans. Knowl. Data Eng. 8(5): 773-785(1996) BibTeX
[21]
Amihai Motro: Superviews: Virtual Integration of Multiple Databases. IEEE Trans. Software Eng. 13(7): 785-798(1987) BibTeX
[22]
...
[23]
Marc H. Scholl, Christian Laasch, Markus Tresch: Updatable Views in Object-Oriented Databases. DOOD 1991: 189-207 BibTeX
[24]
Amit P. Sheth, James A. Larson: Federated Database Systems for Managing Distributed, Heterogeneous, and Autonomous Databases. ACM Comput. Surv. 22(3): 183-236(1990) BibTeX
[25]
Oded Shmueli, Alon Itai: Maintenance of Views. SIGMOD Conference 1984: 240-255 BibTeX
[26]
Michael Stonebraker, Anant Jhingran, Jeffrey Goh, Spyros Potamianos: On Rules, Procedures, Caching and Views in Data Base Systems. SIGMOD Conference 1990: 281-290 BibTeX
[27]
V. S. Subrahmanian: Amalgamating Knowledge Bases. ACM Trans. Database Syst. 19(2): 291-331(1994) BibTeX
[28]
...
[29]
Gio Wiederhold: Mediators in the Architecture of Future Information Systems. IEEE Computer 25(3): 38-49(1992) BibTeX
[30]
...
[31]
Patricia G. Selinger, Morton M. Astrahan, Donald D. Chamberlin, Raymond A. Lorie, Thomas G. Price: Access Path Selection in a Relational Database Management System. SIGMOD Conference 1979: 23-34 BibTeX
[32]
Danette Chimenti, Ruben Gamboa, Ravi Krishnamurthy: Towards on Open Architecture for LDL. VLDB 1989: 195-203 BibTeX
[33]
Surajit Chaudhuri, Kyuseok Shim: Query Optimization in the Presence of Foreign Functions. VLDB 1993: 529-542 BibTeX
[34]
Surajit Chaudhuri, Ravi Krishnamurthy, Spyros Potamianos, Kyuseok Shim: Optimizing Queries with Materialized Views. ICDE 1995: 190-200 BibTeX
[35]
Jeffrey D. Ullman: Principles of Database and Knowledge-Base Systems, Volume II. Computer Science Press 1989, ISBN 0-7167-8162-X
Contents BibTeX
[36]
Chung-Min Chen, Nick Roussopoulos: Adaptive Selectivity Estimation Using Query Feedback. SIGMOD Conference 1994: 161-172 BibTeX
[37]
Hisao Tamaki, Taisuke Sato: OLD Resolution with Tabulation. ICLP 1986: 84-98 BibTeX
[38]
David Scott Warren: Memoing for Logic Programs. Commun. ACM 35(3): 93-111(1992) BibTeX
[39]
Xiaolei Qian: Query Folding. ICDE 1996: 48-55 BibTeX
[40]
...
[41]
...
[42]
Weimin Du, Ravi Krishnamurthy, Ming-Chien Shan: Query Optimization in a Heterogeneous DBMS. VLDB 1992: 277-291 BibTeX
[43]
Qiang Zhu, Per-Åke Larson: A Query Sampling Method of Estimating Local Cost Parameters in a Multidatabase System. ICDE 1994: 144-153 BibTeX
[44]
Hongjun Lu, Beng Chin Ooi, Cheng Hian Goh: Multidatabase Query Optimization: Issues and Solutions. RIDE-IMS 1993: 137-143 BibTeX

Referenced by

  1. Todd D. Millstein, Alon Y. Levy, Marc Friedman: Query Containment for Data Integration Systems. PODS 2000: 67-75
  2. Diego Calvanese, Giuseppe De Giacomo, Maurizio Lenzerini, Moshe Y. Vardi: View-Based Query Processing for Regular Path Queries with Inverse. PODS 2000: 58-66
  3. Laura M. Haas, Renée J. Miller, B. Niswonger, Mary Tork Roth, Peter M. Schwarz, Edward L. Wimmers: Transforming Heterogeneous Data with Database Middleware: Beyond Integration. IEEE Data Eng. Bull. 22(1): 31-36(1999)
  4. Naveen Ashish, Craig A. Knoblock, Cyrus Shahabi: Selectively Materializing Data in Mediators by Analyzing Source Structure, Query Distribution and Maintenance Cost. Workshop on Web Information and Data Management 1999: 33-37
  5. Mary Tork Roth, Fatma Ozcan, Laura M. Haas: Cost Models DO Matter: Providing Cost Information for Diverse Data Sources in a Federated System. VLDB 1999: 599-610
  6. Daniela Florescu, Alon Y. Levy, Dan Suciu, Khaled Yagoub: Optimization of Run-time Management of Data Intensive Web-sites. VLDB 1999: 627-638
  7. Alin Deutsch, Lucian Popa, Val Tannen: Physical Data Independence, Constraints, and Optimization with Universal Plans. VLDB 1999: 459-470
  8. Zachary G. Ives, Daniela Florescu, Marc Friedman, Alon Y. Levy, Daniel S. Weld: An Adaptive Query Execution System for Data Integration. SIGMOD Conference 1999: 299-310
  9. Hasan Davulcu, Juliana Freire, Michael Kifer, I. V. Ramakrishnan: A Layered Architecture for Querying Dynamic Web Content. SIGMOD Conference 1999: 491-502
  10. Diego Calvanese, Giuseppe De Giacomo, Maurizio Lenzerini, Moshe Y. Vardi: Rewriting of Regular Expressions and Regular Path Queries. PODS 1999: 194-204
  11. Anthony Tomasic, Louiqa Raschid, Patrick Valduriez: Scaling Access to Heterogeneous Data Sources with DISCO. IEEE Trans. Knowl. Data Eng. 10(5): 808-823(1998)
  12. Daniela Florescu, Alon Y. Levy, Alberto O. Mendelzon: Database Techniques for the World-Wide Web: A Survey. SIGMOD Record 27(3): 59-74(1998)
  13. Sihem Amer-Yahia, Sophie Cluet, Claude Delobel: Bulk-Loading Techniques for Object Databases and an Application to Relational Data. VLDB 1998: 534-545
  14. Mary F. Fernández, Daniela Florescu, Jaewoo Kang, Alon Y. Levy, Dan Suciu: Catching the Boat with Strudel: Experiences with a Web-Site Management System. SIGMOD Conference 1998: 414-425
  15. Sophie Cluet, Claude Delobel, Jérôme Siméon, Katarzyna Smaga: Your Mediators Need Data Conversion! SIGMOD Conference 1998: 177-188
  16. Sibel Adali, Piero A. Bonatti, Maria Luisa Sapino, V. S. Subrahmanian: A Multi-Similarity Algebra. SIGMOD Conference 1998: 402-413
  17. Hubert Naacke, Georges Gardarin, Anthony Tomasic: Leveraging Mediator Cost Models with Heterogeneous Data Sources. ICDE 1998: 351-360
  18. George A. Mihaila, Louiqa Raschid, Anthony Tomasic: Equal Time for Data on the Internet with WebSemantics. EDBT 1998: 87-101
  19. Laurent Amsaleg, Philippe Bonnet, Michael J. Franklin, Anthony Tomasic, Tolga Urhan: Improving Responsiveness for Wide-Area Data Access. IEEE Data Eng. Bull. 20(3): 3-11(1997)
  20. Daniela Florescu, Daphne Koller, Alon Y. Levy: Using Probabilistic Information in Data Integration. VLDB 1997: 216-225
  21. Mary F. Fernández, Daniela Florescu, Jaewoo Kang, Alon Y. Levy, Dan Suciu: STRUDEL: A Web-site Management System. SIGMOD Conference 1997: 549-552
  22. Laura M. Haas, Donald Kossmann, Edward L. Wimmers, Jun Yang: An Optimizer for Heterogeneous Systems with NonStandard Data and Search Capabilities. IEEE Data Eng. Bull. 19(4): 37-44(1996)
  23. Alon Y. Levy, Anand Rajaraman, Joann J. Ordille: Querying Heterogeneous Information Sources Using Source Descriptions. VLDB 1996: 251-262
BibTeX
ACM SIGMOD Anthology - DBLP: [Home | Search: Author, Title | Conferences | Journals]
ACM SIGMOD Anthology: Copyright © by ACM (info@acm.org), Corrections: anthology@acm.org
DBLP: Copyright © by Michael Ley (ley@uni-trier.de), last change: Sat May 16 23:40:31 2009