Data Migration Loader

A specialised data loading and migration PL/SQL package solution with XML support.

The loader has been developed as a light weight contender for the more sophisticated ETL available on the market. The application is a single Oracle PL/SQL package driven via XML configuration/metadata files. Running and monitoring of loads is performed via HTML based screens (ready to use if the Oracle HTTP listener is enabled).

  • Supports data loading methods via CREATE TABLE AS ... Oracle partition exchange, INSERT APPEND, PL/SQL bulk loading.

  • PL/SQL bulk loading option processes and records data loading exceptions on individual rows. Also able to perform update if row already existing by using the MERGE command.

  • Closely coupled with the dbi Data Migration Methodology supporting the various data transformation, validation, and reporting stages and associated tasks.

  • Driven by XML configuration files. The characteristics of each data load batch is defined by an XML document. The overall migration schedule is also controlled by an XML configuration document itemising all of the individual loads and their dependencies.

  • Supports Oracle performance enhancing features such as index disable and rebuild, statistics calculation, trigger and constraint disable/enable.

  • Alerting of events during loading via e-mail and/or SMS.

  • HTML front end application to submit, stop, resubmit loads, and to review built-in and custom reports. HTML is generated via XSL applied to XML output, enabling the opportunity to customise the screens and reports, including using your own corporate colours and graphics.

  • XML configuration files enable very flexible source control, deployment, and maintainability.

  • Built in object dependency monitoring and reporting to manage impact analysis.

  • Built in performance analysis and monitoring features to identify problematic loads.

  • A pure Oracle PL/SQL solution contained in one package for ease of deployment and support. All XML, HTML, SMTP functionality uses Oracle's built-in support for these technologies, via PL/SQL native language features and/or built-in PL/SQL packages.

For future releases, we are looking at extending the sophistication of the tool:

  • Define multiple dependencies between loads (i.e. splits and joins waiting for all) to enable multi-threaded loading.

  • Generation of XML documents and messages to perform tasks such as invoke services and instantiate business processes in a BPM. : Copyright 2005 - 2010 Database Innovations Ltd : Last modified: 27/08/10