Skip to content

⚡ Bolt: Single-pass expression normalization - #8

Merged
SayanthRock merged 1 commit into
mainfrom
bolt-optimization-single-pass-normalization-16922693729256795883
Aug 9, 2026
Merged

⚡ Bolt: Single-pass expression normalization#8
SayanthRock merged 1 commit into
mainfrom
bolt-optimization-single-pass-normalization-16922693729256795883

Conversation

@SayanthRock

@SayanthRock SayanthRock commented Aug 8, 2026

Copy link
Copy Markdown
Member

User description

💡 What: Refactored normalize_expression to use a single pass character stream approach, integrating operator replacement (== and !=), keyword replacement, and numeric separator removal directly into the state machine.
🎯 Why: Previously, normalize_expression invoked remove_numeric_separators, followed by two .replace calls, and finally normalize_keywords. Each step iterated over the string completely and allocated new intermediate String instances. This caused huge heap traffic and was generally slow in tight loops. Additionally, the naive .replace calls could improperly touch literal strings containing those operators (e.g., 'foo != bar').
📊 Impact: Reduces allocations for expression normalization from 4+ strings to just 1 pre-sized string. Cuts the number of string iterations down to a single O(N) pass. Also fixes a correctness bug regarding operators inside quoted strings.
🔬 Measurement: Verify by running cargo test to ensure all parsing and code generation still functions identically to the previous version. The performance improvement can be measured by reduced peak memory usage and fewer instruction counts for the normalize_expression pipeline.


PR created automatically by Jules for task 16922693729256795883 started by @SayanthRock


CodeAnt-AI Description

Speed up expression normalization while preserving quoted text

What Changed

  • Expressions are normalized in a single scan, reducing temporary string creation and repeated processing
  • Operators such as != and ==, numeric separators, and supported keywords are converted during normalization
  • Operators and keywords inside quoted strings remain unchanged

Impact

✅ Faster expression processing
✅ Lower memory use during parsing
✅ Preserved quoted string contents

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

Summary by CodeRabbit

  • Bug Fixes
    • Improved expression normalization for numeric separators, operators, and keywords.
    • Preserved the contents of quoted strings during normalization.
    • Added consistent handling for != and == operators.

Consolidates `normalize_expression` logic into a single pass string processor.
Removes redundant `.replace` calls and intermediate string allocations.

Co-authored-by: SayanthRock <202829406+SayanthRock@users.noreply.github.com>
@google-labs-jules

Copy link
Copy Markdown
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

Copilot AI lite review requested due to automatic review settings August 8, 2026 21:54
@ai-coding-guardrails

Copy link
Copy Markdown

You've hit your review limit for the week, but don't worry you'll get some more next week!

Contact us at hello@zenable.io if you want this rate limit to go away

@codeant-ai

codeant-ai Bot commented Aug 8, 2026

Copy link
Copy Markdown

🤖 CodeAnt AI — Review Status

Status Commit Started (UTC) Finished (UTC)
✅ Reviewed your PR 06e6257 Aug 08, 2026 · 21:54 21:56

@codeant-ai

codeant-ai Bot commented Aug 8, 2026

Copy link
Copy Markdown

Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.

@codeant-ai codeant-ai Bot added the size:M This PR changes 30-99 lines, ignoring generated files label Aug 8, 2026
@coderabbitai

coderabbitai Bot commented Aug 8, 2026

Copy link
Copy Markdown

Review Change Stack

📝 Walkthrough

Walkthrough

The expression normalizer now combines numeric-separator removal, operator normalization, keyword uppercasing, and quoted-string preservation in one character scan.

Changes

Expression Normalization

Layer / File(s) Summary
Single-pass expression normalizer
compiler/rockql-sql/src/lib.rs
normalize_expression now writes directly to the output buffer. It preserves quoted text, removes numeric separators, converts != to <> and == to =, and uppercases SQL keywords. Separate helper functions were removed.

Estimated code review effort: 2 (Simple) | ~10 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely describes the main change: refactoring expression normalization into a single-pass implementation.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
📝 Generate docstrings
  • Create stacked PR
  • Commit on current branch
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch bolt-optimization-single-pass-normalization-16922693729256795883

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@compiler/rockql-sql/src/lib.rs`:
- Around line 199-212: The numeric-separator handling around the word-token
construction currently removes underscores from identifiers such as metric_1_2.
Restrict the skip logic in the tokenizer to underscores within numeric literal
tokens only, preserving underscores in identifier tokens; add a regression test
covering metric_1_2 and its generated SQL reference.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 1d281157-e11a-4464-8c11-655ba9334252

📥 Commits

Reviewing files that changed from the base of the PR and between ac7a9f1 and 06e6257.

⛔ Files ignored due to path filters (1)
  • Cargo.lock is excluded by !**/*.lock
📒 Files selected for processing (1)
  • compiler/rockql-sql/src/lib.rs

Comment thread compiler/rockql-sql/src/lib.rs
Comment thread compiler/rockql-sql/src/lib.rs
Comment thread compiler/rockql-sql/src/lib.rs
Comment thread compiler/rockql-sql/src/lib.rs
@SayanthRock
SayanthRock merged commit f2c322f into main Aug 9, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M This PR changes 30-99 lines, ignoring generated files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants