Digital Symposium Collection 2000

User-Defined Table Operators: Enhancing Extensibility for ORDBMS Michael Jaedicke and Bernhard Mitschang   View Paper (PDF)   Return to Implementing Advanced Data Models Note: The quality of the PDF contained herein reflects that of the material supplied to the DiSC'00 Production Team. Abstract Currently parallel object-relational database technology is setting the direction for the future of data management. A central enhancement of object-relational database technology is the possibility to execute arbitrary user-defined functions within SQL statements. We show the limits of this approach and propose user-defined table operators as a new concept that allows the definition and implementation of arbitrary user-defined N-ary database operators, which can be programmed using SQL or Embedded SQL (with some extensions). Our approach leads to a new dimension of extensibility that allows to push more application code into the server with full support for efficient execution and parallel processing. Furthermore it allows performance enhancements of orders of magnitude for the evaluation of many queries with complex user-defined functions as we show for two concrete examples. Finally, our implementation perception guarantees that this approach fits well into the architectures of commercial object-relational database management systems. References Note: References link to DBLP on the Web. [1] Gennady Antoshenkov , Mohamed Ziauddin : Query Processing and Optimization in Oracle Rdb. VLDB Journal 5(4) : 229-237(1996) [2] François Bancilhon , Peter Buneman (Eds.): Advances in Database Programming Languages, Papers from DBPL-1, September 1987, Roscoff, France. ACM Press / Addison-Wesley 1990, ISBN 0-201-50257-7 Contents [3] ... [4] ... [5] Giannis Bozas , Michael Jaedicke , Andreas Listl , Bernhard Mitschang , Angelika Reiser , Stephan Zimmermann : On Transforming a Sequential SQL-DBMS into a Parallel One: First Results and Experiences of the MIDAS Project. Euro-Par, Vol. II 1996 : 881-886 [6] ... [7] Michael J. Carey , Nelson Mendonça Mattos , Anil Nori : Object-Relational Database Systems: Principles, Products, and Challenges (Tutorial). SIGMOD Conference 1997 : 502 [8] Donald D. Chamberlin : A Complete Guide to DB2 Universal Database. Morgan Kaufmann 1998, ISBN 1-55860-482-0 [9] Surajit Chaudhuri , Kyuseok Shim : Optimization of Queries with User-defined Predicates. VLDB 1996 : 87-98 [10] Stefan Deßloch , Nelson Mendonça Mattos : Integrating SQL Databases with Content-Specific Search Engines. VLDB 1997 : 528-537 [11] David J. DeWitt , Jim Gray : Parallel Database Systems: The Future of High Performance Database Systems. CACM 35(6) : 85-98(1992) [12] Goetz Graefe : Query Evaluation Techniques for Large Databases. Computing Surveys 25(2) : 73-170(1993) [13] Goetz Graefe : The Cascades Framework for Query Optimization. Data Engineering Bulletin 18(3) : 19-29(1995) [14] Ralf Hartmut Güting : Second-Order Signature: A Tool for Specifying Data Models, Query Processing, and Optimization. SIGMOD Conference 1993 : 277-286 [15] Laura M. Haas , Johann Christoph Freytag , Guy M. Lohman , Hamid Pirahesh : Extensible Query Processing in Starburst. SIGMOD Conference 1989 : 377-388 [16] Joseph M. Hellerstein , Michael Stonebraker : Predicate Migration: Optimizing Queries with Expensive Predicates. SIGMOD Conference 1993 : 267-276 [17] Joseph M. Hellerstein , Jeffrey F. Naughton : Query Execution Techniques for Caching Expensive Methods. SIGMOD Conf. 1996 : 423-434 [18] ... [19] ... [20] ... [21] Michael Jaedicke , Bernhard Mitschang : On Parallel Processing of Aggregate and Scalar Functions in Object-Relational DBMS. SIGMOD Conference 1998 : 379-389 [22] ... [23] ... [24] ... [25] Guy M. Lohman : Grammar-like Functional Rules for Representing Query Optimization Alternatives. SIGMOD Conference 1988 : 18-27 [26] ... [27] Bernhard Mitschang , Hamid Pirahesh , Peter Pistor , Bruce G. Lindsay , Norbert Südkamp : SQL/XNF - Processing Composite Objects as Abstractions over Relational Data. ICDE 1993 : 272-282 [28] W. O'Connell , Ion Tim Ieong , D. Schrader , C. Watson , G. Au , Alexandros Biliris , S. Choo , P. Colin , G. Linderman , Euthimios Panagos , J. Wang , T. Walters : A Content-Based Multimedia Server for Massively Parallel Architectures. SIGMOD Conf. 1996 : 68-78 [29] Michael A. Olson , Wei Hong , Michael Ubell , Michael Stonebraker : Query Processing in a Parallel Object-Relational Database System. Data Engineering Bulletin 19(4) : 3-10(1996) [30] Jack A. Orenstein : A Comparison of Spatial Query Processing Techniques for Native and Parameter Spaces. SIGMOD Conference 1990 : 343-352 [31] Jignesh M. Patel , David J. DeWitt : Partition Based Spatial-Merge Join. SIGMOD Conf. 1996 : 259-270 [32] Jignesh M. Patel , Jie-Bing Yu , Navin Kabra , Kristin Tufte , Biswadeep Nag , Josef Burger , Nancy E. Hall , Karthikeyan Ramasamy , Roger Lueder , Curt Ellman , Jim Kupsch , Shelly Guo , David J. DeWitt , Jeffrey F. Naughton : Building a Scaleable Geo-Spatial DBMS: Technology, Implementation, and Evaluation. SIGMOD Conference 1997 : 336-347 [33] Hamid Pirahesh , Bernhard Mitschang , Norbert Südkamp , Bruce G. Lindsay : Composite-Object Views in Relational DBMS: An Implementation Perspective. EDBT 1994 : 23-30 [34] Praveen Seshadri , Miron Livny , Raghu Ramakrishnan : The Case for Enhanced Abstract Data Types. VLDB 1997 : 66-75 [35] Michael Stonebraker : Inclusion of New Types in Relational Data Base Systems. ICDE 1986 : 262-269 [36] Michael Stonebraker , Paul Brown , Dorothy Moore: Object-Relational DBMSs, Second Edition. Morgan Kaufmann 1998, ISBN 1-55860-452-9 [37] Michael Stonebraker : Implementation of Integrity Constraints and Views by Query Modification. SIGMOD Conference 1975 : 65-78 BIBTEX @inproceedings{DBLP:conf/vldb/JaedickeM99,   author    = {Michael Jaedicke and                 Bernhard Mitschang},    editor    = {Malcolm P. Atkinson and                 Maria E. Orlowska and                 Patrick Valduriez and                 Stanley B. Zdonik and                 Michael L. Brodie},    title     = {User-Defined Table Operators: Enhancing Extensibility for ORDBMS},    booktitle = {VLDB'99, Proceedings of 25th International Conference on Very                 Large Data Bases, September 7-10, 1999, Edinburgh, Scotland,                 UK},    publisher = {Morgan Kaufmann},    year      = {1999},    isbn      = {1-55860-615-5},    pages     = {494-505},    crossref  = {DBLP:conf/vldb/99},    bibsource = {DBLP, http://dblp.uni-trier.de} } }, Copyright(C) 2000 ACM