Skip to content

Make sqlglot a required dependency#2324

Merged
robinld merged 1 commit into
DataJunction:mainfrom
robinld:robind/sqlglot-required-dependency
Jul 10, 2026
Merged

Make sqlglot a required dependency#2324
robinld merged 1 commit into
DataJunction:mainfrom
robinld:robind/sqlglot-required-dependency

Conversation

@robinld

@robinld robinld commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

DJ transpiles generated SQL per dialect via sqlglot and has no realistic fallback, yet sqlglot was only an optional extra (transpilation, and duplicated in bigquery).

Promote sqlglot to a core dependency and drop the now-redundant optional plumbing:

  • pyproject.toml: add sqlglot>=18.0.1 to core dependencies; remove the transpilation extra and the duplicate entry in the bigquery extra.
  • transpilation.py: import sqlglot at module top level matched against settings.transpilation_plugins.
  • Makefile / CI: drop --extra transpilation from uv sync.
  • requirements/docker.txt: update the documented export command
  • uv.lock: sqlglot moves from the extras to the core dependency set.

@robinld robinld requested a review from shangyian July 9, 2026 21:07
@netlify

netlify Bot commented Jul 9, 2026

Copy link
Copy Markdown

Deploy Preview for thriving-cassata-78ae72 canceled.

Name Link
🔨 Latest commit 3e30dd4
🔍 Latest deploy log https://app.netlify.com/projects/thriving-cassata-78ae72/deploys/6a5012e664007e0008101147

DJ transpiles generated SQL per dialect via sqlglot and has no realistic
fallback, yet sqlglot was only an optional extra (`transpilation`, and
duplicated in `bigquery`).

Promote sqlglot to a core dependency and drop the now-redundant optional
plumbing:

- pyproject.toml: add `sqlglot>=18.0.1` to core dependencies; remove the
  `transpilation` extra and the duplicate entry in the `bigquery` extra.
- transpilation.py: import sqlglot at module top level
- Drop the now-invalid `--extra transpilation` from every `uv sync`
  invocation: Makefile, CI (test.yml), the server Dockerfile, and
  docker-compose.
- requirements/docker.txt: update the documented export command
- uv.lock: sqlglot moves from the extras to the core dependency set.
- CONTRIBUTING.rst: refresh the stale "Adding new dependencies" and setup
  instructions (now uses uv).
@robinld robinld force-pushed the robind/sqlglot-required-dependency branch from 2e88dbe to 3e30dd4 Compare July 9, 2026 21:30
@robinld robinld merged commit 88b9d5e into DataJunction:main Jul 10, 2026
21 checks passed
@robinld robinld deleted the robind/sqlglot-required-dependency branch July 10, 2026 12:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants