Skip to main content
KinetiShift

Integration · Databricks

Oracle change data capture into Databricks.

KinetiShift reads committed changes through Oracle's documented LogMiner interface and lands them in Databricks at near-real-time (seconds-class) latency. It runs in your own environment — your Azure subscription or on-premises — so your data stays in your network.

Landing modes

Two ways to land Oracle data in Databricks.

Default

MERGE into a current-state table

One idempotent MERGE per source commit keeps a Unity Catalog managed Delta table matching the current state of the Oracle table.

Statements run on a SQL warehouse through the SQL Statement Execution API — no JDBC or ODBC driver to install.

Recommended for new Databricks deployments

Change log + Lakeflow AUTO CDC

Every change is appended to a <table>__changes table. A supplied Lakeflow Declarative Pipelines template (SQL or Python) uses AUTO CDC to build SCD type 1 and type 2 tables from it.

Cost note: this mode runs a serverless pipeline in your Databricks workspace, so it adds your own pipeline compute cost on top of the SQL warehouse.

Tables without a primary key can be sent to an append-only change-log table.

Sign-in

Three ways to authenticate. Tokens refresh automatically.

Databricks OAuth M2M

A Databricks service principal with an OAuth client ID and secret.

Microsoft Entra ID service principal

Sign in with an Entra ID application you already manage.

Azure managed identity

No secret to store or rotate. The Azure Marketplace deployment creates the identity for you.

Least privilege

One schema, one warehouse.

KinetiShift needs only these grants — nothing workspace-wide:

GRANT USE CATALOG
  ON CATALOG <catalog> TO <principal>;
GRANT USE SCHEMA, CREATE TABLE, SELECT, MODIFY
  ON SCHEMA <catalog>.<schema> TO <principal>;
-- plus CAN USE on one SQL warehouse

Schema changes

When the Oracle table changes.

  • Applies added columns to a Databricks SQL warehouse (with --apply-ddl).
  • Handles renamed columns.
  • Picks up new tables.

Supports Oracle RAC.

Try it against one of your Oracle databases.

KinetiShift is on the Azure Marketplace with a 30-day free trial on the Standard plan. Cancel before the trial ends and you aren't charged.