Text-to-SQL on Oracle: two prompt rules took a light model from 35% to 64%

Description and use

Adding two Oracle‑specific rules to the prompt raised Gemini 2.5 Flash first‑try accuracy on UniQL from 35 % to 64.5 %, reducing failures from 694 to 85.

Problem

Oracle’s reserved word syntax caused low first‑try accuracy of a light LLM on the UniQL benchmark.

Outcome

First‑try accuracy improved from 35.0% to 64.5% (≈15 points above best published model) by adding two Oracle rules to the prompt; failures dropped from 694 to 85.

Workflow

• Run schemagate on UniQL Oracle questions with Gemini 2.5 Flash
• Detect Oracle target and inject two prompt rules: disallow "AS" before table alias and require quoting of reserved words "DATE" and "NUMBER"
• Execute queries, record first‑try accuracy
• Optionally run error‑repair loop for remaining failures

Evidence

Two mistakes caused almost all of it. Of the 694 failed first queries: 551 wrote FROM account AS a. Oracle doesn't allow AS before a table alias. 100 used a column named DATE or NUMBER without quotes. Both are reserved words.

Source

First-try accuracy went from 35.0% to 64.5%

Source