Sol
codex_cli · text综合得分 / 100 · 越高越好RUN / #0011完成但有错误
模型:Sol、Gemini。比较模式:access_path;差异字段:adapter_kind、cli_version。创建于 2026年8月29日 16:25。
非全量成功 · 本场包含 13 个失败案例失败已经按固定规则计入综合得分,具体影响可在逐题表和案例证据中复核。
codex_cli · text综合得分 / 100 · 越高越好gemini_cli · text综合得分 / 100 · 越高越好分别列出准确率、每正确等价题 Token、估算费用和生成耗时。费用采用运行时冻结的价格快照。
| 指标 | Sol | Gemini |
|---|---|---|
准确率越高越好 | 89.79 | 0.00 |
Token / 正确等价题越低越好 | 19,773 | — |
费用 / 正确等价题USD · 估算 | 不可估算 | 不可估算 |
模型生成耗时 P95越低越好 | — | — |
累计 Token已记录题数 | 213,05711/12 题 | —0/12 题 |
| 能力维度 | Sol | Gemini |
|---|---|---|
| 基础查询 | 100.00 | 0.00 |
| 复杂管道 | 96.25 | 0.00 |
| 子查询 | 100.00 | 0.00 |
| 窗口函数 | 71.25 | 0.00 |
| 聚合分析 | 100.00 | 0.00 |
| 连接语义 | 100.00 | 0.00 |
展开案例可查看模型摘要、SQL、错误和原始案例 JSON。
| 案例 | Sol | Gemini |
|---|---|---|
基础筛选与排序basic_filter_sort | 100.00 | 0.00 |
多表连接品类收入multi_join_category_revenue | 100.00 | 0.00 |
保留零订单客户left_join_zero_orders | 100.00 | 0.00 |
相关子查询分群均值correlated_segment_average | 100.00 | 0.00 |
从未完成订单客户not_exists_customers | 100.00 | 0.00 |
每品类收入前三商品top3_products_per_category | 100.00 | 0.00 |
月收入与累计收入monthly_running_revenue | 100.00 | 0.00 |
月收入环比增长monthly_mom_growth | 0.00 | 0.00 |
高于平均累计消费客户above_average_customer_spend | 100.00 | 0.00 |
渠道支付状态金额payment_status_by_channel | 100.00 | 0.00 |
品类退货率category_return_rate | 92.50 | 0.00 |
每单最新成功支付latest_successful_payment | 85.00 | 0.00 |
basic_filter_sort查询 2026-01-01 起的已完成订单及客户名称,按订单总额降序、订单 ID 升序排列。
SELECT
o.order_id,
c.customer_name,
o.order_date,
o.total_amount
FROM fact_orders AS o
JOIN dim_customers AS c
ON o.customer_id = c.customer_id
WHERE
o.status = 'completed' AND o.order_date >= CAST('2026-01-01' AS DATE)
ORDER BY
o.total_amount DESC,
o.order_id ASCcompletedGEN—msEXEC252.32908399993903msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msmulti_join_category_revenue按商品品类汇总已完成订单的去重订单数和订单行净销售额,并按净销售额降序、品类升序排列。
SELECT
p.category,
COUNT(DISTINCT o.order_id) AS order_count,
SUM(oi.quantity * oi.unit_price - oi.discount_amount) AS net_revenue
FROM fact_orders AS o
JOIN fact_order_items AS oi
ON oi.order_id = o.order_id
JOIN dim_products AS p
ON p.product_id = oi.product_id
WHERE
o.status = 'completed'
GROUP BY
p.category
ORDER BY
net_revenue DESC,
p.category ASCcompletedGEN—msEXEC420.0295829978131msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msleft_join_zero_orders列出所有客户及其已完成订单数,通过 LEFT JOIN 保留零订单客户,并按完成订单数降序、客户 ID 升序排列。
SELECT
c.customer_id,
c.customer_name,
COUNT(DISTINCT o.order_id) AS completed_order_count
FROM dim_customers AS c
LEFT JOIN fact_orders AS o
ON c.customer_id = o.customer_id AND o.status = 'completed'
GROUP BY
c.customer_id,
c.customer_name
ORDER BY
completed_order_count DESC,
c.customer_id ASCcompletedGEN—msEXEC252.58920900159865msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—mscorrelated_segment_average返回金额高于其客户分群已完成订单平均金额的已完成订单,并按订单金额降序、订单 ID 升序排列。
SELECT
o.order_id,
o.customer_id,
c.segment,
o.total_amount,
(
SELECT
AVG(o2.total_amount)
FROM fact_orders AS o2
JOIN dim_customers AS c2
ON c2.customer_id = o2.customer_id
WHERE
o2.status = 'completed' AND c2.segment = c.segment
) AS segment_avg_amount
FROM fact_orders AS o
JOIN dim_customers AS c
ON c.customer_id = o.customer_id
WHERE
o.status = 'completed'
AND o.total_amount > (
SELECT
AVG(o3.total_amount)
FROM fact_orders AS o3
JOIN dim_customers AS c3
ON c3.customer_id = o3.customer_id
WHERE
o3.status = 'completed' AND c3.segment = c.segment
)
ORDER BY
o.total_amount DESC,
o.order_id ASCcompletedGEN—msEXEC236.56695800309535msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msnot_exists_customers返回从未有已完成订单的客户,并按 customer_id 升序排列。
SELECT
c.customer_id,
c.customer_name
FROM dim_customers AS c
WHERE
NOT EXISTS(
SELECT
1
FROM fact_orders AS o
WHERE
o.customer_id = c.customer_id AND o.status = 'completed'
)
ORDER BY
c.customer_id ASCcompletedGEN—msEXEC220.08262500094133msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—mstop3_products_per_category汇总完成订单中各商品的净销售额,并使用 ROW_NUMBER 选出每个品类净销售额前三的商品;同额时按 product_id 升序排名。
WITH product_revenue AS (
SELECT
p.category,
p.product_id,
p.product_name,
SUM(oi.quantity * oi.unit_price - oi.discount_amount) AS net_revenue
FROM fact_order_items AS oi
JOIN fact_orders AS o
ON oi.order_id = o.order_id
JOIN dim_products AS p
ON oi.product_id = p.product_id
WHERE
o.status = 'completed'
GROUP BY
p.category,
p.product_id,
p.product_name
), ranked_products AS (
SELECT
category,
product_id,
product_name,
net_revenue,
ROW_NUMBER() OVER (PARTITION BY category ORDER BY net_revenue DESC, product_id ASC) AS rank_no
FROM product_revenue
)
SELECT
category,
product_id,
product_name,
net_revenue,
rank_no
FROM ranked_products
WHERE
rank_no <= 3
ORDER BY
category ASC,
rank_no ASCcompletedGEN—msEXEC246.45929200050887msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msmonthly_running_revenue按月汇总 2025 年已完成订单的净销售收入,并使用按月份排序的 SUM 窗口计算累计收入。
WITH monthly AS (
SELECT
STRFTIME(o.order_date, '%Y-%m') AS month,
SUM(oi.quantity * oi.unit_price - oi.discount_amount) AS monthly_revenue
FROM fact_orders AS o
JOIN fact_order_items AS oi
ON oi.order_id = o.order_id
WHERE
o.status = 'completed'
AND o.order_date >= CAST('2025-01-01' AS DATE)
AND o.order_date < CAST('2026-01-01' AS DATE)
GROUP BY
1
)
SELECT
month,
monthly_revenue,
SUM(monthly_revenue) OVER (ORDER BY month ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS cumulative_revenue
FROM monthly
ORDER BY
month ASCcompletedGEN—msEXEC328.4664580023673msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msmonthly_mom_growthFROM 不允许表函数
failedGEN—msEXEC—msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—msabove_average_customer_spend汇总每位有已完成订单客户的累计消费,以这些客户的平均累计消费为基准,返回高于平均值的客户。
SELECT
customer_id,
customer_name,
total_spend
FROM (
SELECT
customer_id,
customer_name,
total_spend,
AVG(total_spend) OVER () AS avg_total_spend
FROM (
SELECT
c.customer_id,
c.customer_name,
SUM(o.total_amount) AS total_spend
FROM fact_orders AS o
JOIN dim_customers AS c
ON o.customer_id = c.customer_id
WHERE
o.status = 'completed'
GROUP BY
c.customer_id,
c.customer_name
) AS customer_spend
) AS spend_with_average
WHERE
total_spend > avg_total_spend
ORDER BY
total_spend DESC,
customer_id ASCcompletedGEN—msEXEC247.28929099728703msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—mspayment_status_by_channel按渠道类型汇总成功支付、退款状态和失败支付金额,并按渠道类型升序排列。
SELECT
c.channel_type,
SUM(CASE WHEN p.status = 'paid' THEN p.amount ELSE 0 END) AS paid_amount,
SUM(CASE WHEN p.status = 'refunded' THEN p.amount ELSE 0 END) AS refunded_amount,
SUM(CASE WHEN p.status = 'failed' THEN p.amount ELSE 0 END) AS failed_amount
FROM fact_payments AS p
JOIN fact_orders AS o
ON p.order_id = o.order_id
JOIN dim_channels AS c
ON o.channel_id = c.channel_id
GROUP BY
c.channel_type
ORDER BY
c.channel_type ASCcompletedGEN—msEXEC231.46224999800324msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—mscategory_return_rate分别按品类聚合完成订单的售出数量与退货数量,再计算四舍五入至 4 位的退货率,并按退货率降序、品类升序排列。
WITH sold AS (
SELECT
p.category,
SUM(oi.quantity) AS sold_qty
FROM fact_order_items AS oi
JOIN fact_orders AS o
ON o.order_id = oi.order_id
JOIN dim_products AS p
ON p.product_id = oi.product_id
WHERE
o.status = 'completed'
GROUP BY
p.category
), returned AS (
SELECT
p.category,
SUM(r.return_qty) AS returned_qty
FROM fact_returns AS r
JOIN fact_order_items AS oi
ON oi.order_id = r.order_id AND oi.line_no = r.line_no
JOIN fact_orders AS o
ON o.order_id = oi.order_id
JOIN dim_products AS p
ON p.product_id = oi.product_id
WHERE
o.status = 'completed'
GROUP BY
p.category
), category_rates AS (
SELECT
s.category,
s.sold_qty,
COALESCE(r.returned_qty, 0) AS returned_qty,
ROUND(CAST(COALESCE(r.returned_qty, 0) AS DECIMAL(18, 3)) / NULLIF(s.sold_qty, 0), 4) AS return_rate
FROM sold AS s
LEFT JOIN returned AS r
ON r.category = s.category
)
SELECT
category,
sold_qty,
returned_qty,
return_rate
FROM category_rates
ORDER BY
return_rate DESC,
category ASCcompletedGEN—msEXEC235.67491699941456msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—mslatest_successful_payment筛选成功支付,并使用 ROW_NUMBER 为每个订单按支付时间和 payment_id 降序排名,返回最新一笔。
SELECT
order_id,
payment_id,
paid_at,
amount
FROM (
SELECT
order_id,
payment_id,
paid_at,
amount,
ROW_NUMBER() OVER (PARTITION BY order_id ORDER BY paid_at DESC, payment_id DESC) AS rn
FROM fact_payments
WHERE
status = 'paid'
) AS ranked_payments
WHERE
rn = 1
ORDER BY
order_id ASCcompletedGEN—msEXEC199.8760000024049msGemini 退出码 41: Please set an Auth method in your $PROJECT_ROOT/var/cli-homes/gemini/3/.gemini/settings.json or specify one of the following environment variables before running: GEMINI_API_KEY, GOOGLE_GENAI_USE_VERTEXAI, GOOGLE_GENAI_USE_GCA
failedGEN—msEXEC—ms字段来自运行创建时冻结的快照。
0.1.01121.5.5query-plan-v11.0.030.17.00a4a18b4374f510f5eff18b06272c30c3375e1f082ae405adc8ead7dd9c8155623fad9bb883f167a6c0f4cfbc8b78190708e3cd4243ca075ffbf9479fb2935a0run-report-v11