marin-community/open-thoughts-4-128-math-glm5-annotated-32768-tokens

# open-thoughts-4-128-math-glm5-annotated-32768-tokens

Math reasoning responses generated by **GLM-5** (zai-org/GLM-5) via the Together AI serverless API.

## Overview

- **Total rows:** 1,024
- **Unique prompts:** 128 (each with 8 response annotations)
- **Source prompts:** [marin-community/open-thoughts-4-128-math-qwen3-32b-annotated-32768-tokens-n8-reformatted](https://huggingface.co/datasets/marin-community/open-thoughts-4-128-math-qwen3-32b-annotated-32768-tokens-n8-reformatted)
- **Generation model:** [zai-org/GLM-5](https://huggingface.co/zai-org/GLM-5)
- **Max tokens:** 32,768
- **Temperature:** 0.8
- **Tokenizer used for stats:** Qwen/Qwen2.5-3B

## Statistics

| Metric | Value |
|--------|-------|
| Avg tokens per response | 22,950 |
| Median tokens per response | 24,277 |
| Responses with `<think>` tag | 100.0% |
| Complete responses (has `</think>` + `\boxed{...}`) | 676/1024 (66.0%) |
| Truncated responses | 348/1024 (34.0%) |
| Empty responses | 0 |

## Columns

| Column | Description |
|--------|-------------|
| `row_id` | Sequential identifier (0-1023) |
| `instruction_seed` | The math problem prompt |
| `glm5_generated_text` | GLM-5 generated response (with `<think>...</think>` reasoning trace) |
| `ms_id` | Math seed ID -- groups all 8 responses for the same prompt |
| `_source` | Source dataset identifier |
| `gpt41_mini_response` | GPT-4.1 mini reference response |
| `length` | Response length |

## Response Format

Each response in the `glm5_generated_text` column follows this format:

```
<think>
[model's reasoning trace]
</think>
[final answer, typically containing \boxed{...}]
```

Responses that are truncated (hit the 32,768 token limit) may be missing the closing `</think>` tag and/or the `\boxed{...}` answer.

## Construction

Generated by sending each of the 128 math prompts to GLM-5 8 times (n=8) via the Together AI serverless endpoint, with `max_tokens=32768` and `temperature=0.8`. The model's reasoning trace (from the `message.reasoning` API field) is wrapped in `<think>...</think>` tags.

# open-thoughts-4-128-math-glm5-annotated-32768-tokens

本数据集为由**GLM-5**(zai-org/GLM-5)通过Together AI无服务器API生成的数学推理回复。

## 概述
- **总数据条目数**：1024
- **唯一提示词集**：128组（每组对应8条回复标注）
- **源提示词数据集**：[marin-community/open-thoughts-4-128-math-qwen3-32b-annotated-32768-tokens-n8-reformatted](https://huggingface.co/datasets/marin-community/open-thoughts-4-128-math-qwen3-32b-annotated-32768-tokens-n8-reformatted)
- **生成所用模型**：[zai-org/GLM-5](https://huggingface.co/zai-org/GLM-5)
- **最大Token数**：32768
- **温度系数**：0.8
- **统计所用分词器**：Qwen/Qwen2.5-3B

## 统计指标
| 指标 | 数值 |
|--------|-------|
| 单回复平均Token数 | 22,950 |
| 单回复Token数中位数 | 24,277 |
| 包含`<think>`标签的回复 | 100.0% |
| 完整回复（同时包含`</think>`与`oxed{...}`） | 676/1024（66.0%） |
| 截断回复 | 348/1024（34.0%） |
| 空回复 | 0 |

## 字段说明
| 列名 | 说明 |
|--------|-------------|
| `row_id` | 连续型标识符，取值范围为0至1023 |
| `instruction_seed` | 数学问题提示词 |
| `glm5_generated_text` | GLM-5生成的回复文本（包含`<think>...</think>`包裹的模型推理轨迹） |
| `ms_id` | 数学提示词ID，用于将同一原始提示词对应的8条回复归为一组 |
| `_source` | 源数据集标识符 |
| `gpt41_mini_response` | GPT-4.1 mini 参考回复 |
| `length` | 回复长度 |

## 回复格式
`glm5_generated_text`列中的每条回复均遵循以下格式：

<think>
[模型推理轨迹内容]
</think>
[最终答案，通常包含`oxed{...}`语法]

因达到32768 Token上限而被截断的回复，可能缺失闭合的`</think>`标签和/或`oxed{...}`格式的最终答案。

## 数据集构建方式
本数据集通过Together AI无服务器端点，将128条数学提示词各送入GLM-5生成8次回复（n=8），生成参数设置为`max_tokens=32768`与`temperature=0.8`。将模型返回的推理轨迹（取自API的`message.reasoning`字段）用`<think>...</think>`标签进行包裹。