Drive First Slip from your own code
The one metered task, mark, is available over HTTP. It takes a math problem and the working, one step per line, together with the page's own check of every line, and returns a mark on every line (tick, slip, follow or note), a verdict (full_marks, one_slip, rework or unfinished), for each slip what went wrong, why and a nudge, the corrected first slipped line, done-well notes and one practice problem.
The division of labour first: the page owns the checking; the model owns the judgement and the words; the page re-checks the reply. Reading the lines and checking each against the one before it come from slipkit.js, which runs in node as well as in the browser: SlipKit.buildInput(form) gives you the exact input the page sends, and SlipKit.check(reply, built) re-checks a reply - the verdict against the rule, the marks against the page's own check, the corrected line and the practice answer solved again.
Get a token on the token page (step 2 below also shows how to mint a guest token in code).
Base URL and the envelope
Every endpoint lives under https://api.skillsafe.ai/v1/app-api, and every response uses one envelope:
{ "ok": true, "data": { ... } }
{ "ok": false, "error": { "code": "...", "message": "...", "status": 402, "details": { ... } } }
The token is minted for this app (the guest call takes {"slug":"first-slip"}), so no slug header is needed afterwards. Send it as Authorization: Bearer …. The run body is the input object, sent bare.
| Status | Code | Meaning |
|---|---|---|
| 400 | validation_error | The body is not a JSON object, or a required field (task, kind, steps, figures) is missing. |
| 401 | unauthorized | No token, or a stale one. Mint a guest token or sign in again. |
| 402 | insufficient_credits | The balance is under min_credits. Price with /estimate first. |
| 403 | forbidden | A guest token tried to run: marking is metered and needs a personal token. |
| 404 | not_found | Unknown job id. |
| 429 | rate_limited | Back off and retry. |
| 5xx | server_error | Transient. Retry with the same Idempotency-Key so a retry never double-bills. |
The task field, the marks and the verdict rule
Every run sends task: mark (the only task; a missing or unknown one is treated as mark). Each line arrives with the page's check: ok (follows from the line before), slip (does not), start (first line, nothing to compare), unchecked (the page could not read it) or note (words). The marks follow, in order: a note line is marked note; a slip line is marked slip; an ok line is follow after an earlier slip, else tick; start and unchecked lines are judged by the model. The verdict, checked in this order - the first that applies wins:
- rework - 2 or more lines marked
slip. - one_slip - exactly 1.
- unfinished - none, and
answer_reachedisno. - full_marks - everything else.
In solve mode two equations match when they have the same solutions (found numerically between -10000 and 10000); in simplify mode two expressions match when they agree at ten values of the letter. The declared input schema carries scalars only, so the array- and object-valued fields (steps, figures) are JSON-encoded strings.
Input fields
| Field | Type | Notes |
|---|---|---|
task | string | mark. Required. |
kind, kind_label | string | solve or simplify, and its plain label. kind is required. |
level, level_label | string | primary, middle, high or college, and its plain label. |
problem | string | The problem as typed, up to 300 characters. May be empty. |
steps | string (JSON) | [{id, text, check, detail}] - ids L1.., up to 30 lines of up to 120 characters; detail is the page's reason. Required. |
figures | string (JSON) | {lines, math_lines, checked, slips, first_slip, unchecked, answer_reached, answer_line, answer_text, answer_fits_problem, problem_solutions, letter}, every value a string. Required. |
notes | string | Free text from the learner, up to 300 characters. |
clip_note, retry_note | string | What the page cut, when it cut something; and only on a reformat retry, what was wrong. |
The reply
The job's output.output is a string holding one JSON object: task, verdict, title, summary, marks (one {ref, mark, comment} per line, in order), slips (one {ref, what, why, nudge} per line marked slip), fixed_line (the first slipped line corrected, or ""), practice ({problem, answer}) and well_done (0-3 strings). Parse with SlipKit.normalize(SlipKit.parseReply(text)).
Worked examples
Replies produced against the app's prompt for the four sample pieces of working (made up; the full replies ship in example-result.js). Together they cover every verdict.
a bracket equation where every step holds - full_marks
Input:
{
"task": "mark",
"kind": "solve",
"kind_label": "solve an equation",
"level": "middle",
"level_label": "middle school",
"problem": "Solve 3(x - 2) + 4 = 19",
"steps": "[{\"id\":\"L1\",\"text\":\"3x - 6 + 4 = 19\",\"check\":\"ok\",\"detail\":\"same solutions as the problem: x = 7\"},{\"id\":\"L2\",\"text\":\"3x - 2 = 19\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 7\"},{\"id\":\"L3\",\"text\":\"3x = 21\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 7\"},{\"id\":\"L4\",\"text\":\"x = 7\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 7\"}]",
"figures": "{\"lines\":\"4\",\"math_lines\":\"4\",\"checked\":\"4\",\"slips\":\"0\",\"first_slip\":\"\",\"unchecked\":\"0\",\"answer_reached\":\"yes\",\"answer_line\":\"L4\",\"answer_text\":\"x = 7\",\"answer_fits_problem\":\"yes\",\"problem_solutions\":\"x = 7\",\"letter\":\"x\"}",
"notes": "",
"clip_note": ""
}
Reply:
{
"task": "mark",
"verdict": "full_marks",
"title": "Full marks - every step holds",
"summary": "Full marks - the working holds all the way from the problem to x = 7. Try the practice problem to practice the same skill.",
"marks": [
{
"ref": "L1",
"mark": "tick",
"comment": "Expands the bracket correctly: 3 times (x - 2) gives 3x - 6."
},
{
"ref": "L2",
"mark": "tick",
"comment": "Combines -6 and 4 to get -2 on the left side."
},
{
"ref": "L3",
"mark": "tick",
"comment": "Adds 2 to both sides: 19 + 2 = 21."
},
{
"ref": "L4",
"mark": "tick",
"comment": "Divides both sides by 3 to reach x = 7."
}
],
"slips": [],
"fixed_line": "",
"practice": {
"problem": "Solve 4(x - 1) + 3 = 23",
"answer": "x = 6"
},
"well_done": [
"Line 1 expands 3 times the bracket to 3x - 6.",
"Line 3 adds 2 to both sides to reach 3x = 21.",
"Line 4 divides by 3 to find x = 7."
]
}
moving terms across with one sign slip, carried through - one_slip
Input:
{
"task": "mark",
"kind": "solve",
"kind_label": "solve an equation",
"level": "middle",
"level_label": "middle school",
"problem": "Solve 5x - 3 = 2x + 9",
"steps": "[{\"id\":\"L1\",\"text\":\"5x - 2x = 9 - 3\",\"check\":\"slip\",\"detail\":\"solutions change: the problem has x = 4, this line has x = 2\"},{\"id\":\"L2\",\"text\":\"3x = 6\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 2\"},{\"id\":\"L3\",\"text\":\"x = 2\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 2\"}]",
"figures": "{\"lines\":\"3\",\"math_lines\":\"3\",\"checked\":\"3\",\"slips\":\"1\",\"first_slip\":\"L1\",\"unchecked\":\"0\",\"answer_reached\":\"yes\",\"answer_line\":\"L3\",\"answer_text\":\"x = 2\",\"answer_fits_problem\":\"no\",\"problem_solutions\":\"x = 4\",\"letter\":\"x\"}",
"notes": "I always get mixed up moving numbers across the equals sign.",
"clip_note": ""
}
Reply:
{
"task": "mark",
"verdict": "one_slip",
"title": "One sign slip when moving the 3.",
"summary": "This has one slip: line 1 did not flip the sign of the 3 when moving it across the equals sign. Fix line 1, then carry the correction through the rest of the working.",
"marks": [
{
"ref": "L1",
"mark": "slip",
"comment": "Did not flip the sign of the 3 across the equals sign."
},
{
"ref": "L2",
"mark": "follow",
"comment": "Correctly combines 5x - 2x and 9 - 3 into 3x = 6, following the line before."
},
{
"ref": "L3",
"mark": "follow",
"comment": "Correctly solves 3x = 6 to reach x = 2, following the line before."
}
],
"slips": [
{
"ref": "L1",
"what": "The 3 did not flip sign when it moved across the equals sign, so the line shows 9 - 3.",
"why": "A term's sign must flip when it crosses the equals sign; this term kept its original sign instead.",
"nudge": "Look at the sign of the 3 when it crosses the equals sign."
}
],
"fixed_line": "5x - 2x = 9 + 3",
"practice": {
"problem": "Solve 4x - 5 = x + 13",
"answer": "x = 6"
},
"well_done": [
"Line 2 correctly simplifies the line before to 3x = 6.",
"Line 3 correctly solves 3x = 6 to reach x = 2."
]
}
expanding a square with two separate slips - rework
Input:
{
"task": "mark",
"kind": "simplify",
"kind_label": "simplify, expand or work out",
"level": "high",
"level_label": "high school",
"problem": "Expand and simplify (x + 3)^2 - 2(x - 1)",
"steps": "[{\"id\":\"L1\",\"text\":\"= x^2 + 9 - 2(x - 1)\",\"check\":\"slip\",\"detail\":\"not equal to the problem: at x = 2 this gives 11 but the problem gives 23\"},{\"id\":\"L2\",\"text\":\"= x^2 + 9 - 2x - 2\",\"check\":\"slip\",\"detail\":\"not equal to the line before: at x = 2 this gives 7 but the line before gives 11\"},{\"id\":\"L3\",\"text\":\"= x^2 - 2x + 7\",\"check\":\"ok\",\"detail\":\"equal to the line before\"}]",
"figures": "{\"lines\":\"3\",\"math_lines\":\"3\",\"checked\":\"3\",\"slips\":\"2\",\"first_slip\":\"L1\",\"unchecked\":\"0\",\"answer_reached\":\"yes\",\"answer_line\":\"L3\",\"answer_text\":\"= x^2 - 2x + 7\",\"answer_fits_problem\":\"no\",\"problem_solutions\":\"\",\"letter\":\"x\"}",
"notes": "",
"clip_note": ""
}
Reply:
{
"task": "mark",
"verdict": "rework",
"title": "Two slips before the correct-looking line",
"summary": "This needs reworking: two lines don't follow, starting at line 1. Fix line 1, then carry the correction through to finish the problem.",
"marks": [
{
"ref": "L1",
"mark": "slip",
"comment": "Dropped the middle term when squaring (x + 3)."
},
{
"ref": "L2",
"mark": "slip",
"comment": "Wrong sign when distributing -2 across (x - 1)."
},
{
"ref": "L3",
"mark": "follow",
"comment": "Correctly simplifies the terms carried from line 2."
}
],
"slips": [
{
"ref": "L1",
"what": "The middle term from squaring (x + 3) is missing from this line.",
"why": "Squaring (x + 3) gives x^2 plus a middle term plus 3^2; the middle term is missing here.",
"nudge": "When you multiply (x + 3) by (x + 3), how many terms do you get before combining them?"
},
{
"ref": "L2",
"what": "Distributing -2 over (x - 1) put the wrong sign on the second term of that bracket.",
"why": "Multiplying -2 by -1 should give a positive result, since a negative number times a negative number is positive.",
"nudge": "What is -2 times -1?"
}
],
"fixed_line": "= x^2 + 6x + 9 - 2(x - 1)",
"practice": {
"problem": "Expand and simplify (x + 4)^2 - 3(x - 2)",
"answer": "x^2 + 5x + 22"
},
"well_done": [
"Line 3 correctly combines the terms carried from line 2."
]
}
a quadratic factored but never solved - unfinished
Input:
{
"task": "mark",
"kind": "solve",
"kind_label": "solve an equation",
"level": "high",
"level_label": "high school",
"problem": "Solve x^2 - 5x + 6 = 0",
"steps": "[{\"id\":\"L1\",\"text\":\"(x - 2)(x - 3) = 0\",\"check\":\"ok\",\"detail\":\"same solutions as the problem: x = 2 or x = 3\"},{\"id\":\"L2\",\"text\":\"Now I am not sure what to do next\",\"check\":\"note\",\"detail\":\"words - read as a note\"}]",
"figures": "{\"lines\":\"2\",\"math_lines\":\"1\",\"checked\":\"1\",\"slips\":\"0\",\"first_slip\":\"\",\"unchecked\":\"0\",\"answer_reached\":\"no\",\"answer_line\":\"\",\"answer_text\":\"\",\"answer_fits_problem\":\"unknown\",\"problem_solutions\":\"x = 2 or x = 3\",\"letter\":\"x\"}",
"notes": "Got stuck after factoring.",
"clip_note": ""
}
Reply:
{
"task": "mark",
"verdict": "unfinished",
"title": "Good factoring, but not finished yet",
"summary": "The working holds all the way through line 1, but is not finished. Finish the last step to find x from (x - 2)(x - 3) = 0.",
"marks": [
{
"ref": "L1",
"mark": "tick",
"comment": "Correctly factored into (x - 2)(x - 3)."
},
{
"ref": "L2",
"mark": "note",
"comment": ""
}
],
"slips": [],
"fixed_line": "",
"practice": {
"problem": "Solve x^2 - 7x + 12 = 0",
"answer": "x = 3 or x = 4"
},
"well_done": [
"Line 1 factors the quadratic correctly as (x - 2)(x - 3)."
]
}
Build the input yourself
Load the script in node (global.window = global; require("./slipkit.js")), then:
const K = SlipKit;
const form = K.form({ problem: "Solve 2(x + 3) = 14", kind: "solve", level: "middle",
working: "2x + 6 = 14\n2x = 8\nx = 4" });
const r = K.read(form); // r.steps: each line with its check; r.fig: the figures
const built = K.buildInput(form);
const wire = K.toWire(built.input); // POST this to /estimate and /run
// then: const reply = K.normalize(K.parseReply(job.output.output));
// K.check(reply, built).notes // the page's re-check of the reply
// K.csv(built, reply) // the lines, one row each, with the marks
Step 1 — a tiny client helper
One function that sends JSON and unwraps the envelope. Paste a personal token from /tokens.html, or leave it empty and mint a guest token in step 2.
BASE="https://api.skillsafe.ai/v1/app-api"
TOKEN="paste-your-token-here" # from https://first-slip.skillsafe.ai/tokens.html
api() { # api METHOD PATH [JSON-BODY]
curl -s -X "$1" "$BASE$2" -H "Content-Type: application/json" \
${TOKEN:+-H "Authorization: Bearer $TOKEN"} ${3:+--data "$3"}
}
import json, urllib.request
BASE = "https://api.skillsafe.ai/v1/app-api"
TOKEN = "paste-your-token-here" # from https://first-slip.skillsafe.ai/tokens.html
def api(method, path, body=None, headers=None):
req = urllib.request.Request(BASE + path, method=method,
data=None if body is None else json.dumps(body).encode(),
headers={"Content-Type": "application/json", **({"Authorization": "Bearer " + TOKEN} if TOKEN else {}), **(headers or {})})
with urllib.request.urlopen(req) as r:
env = json.load(r)
if env.get("error"):
raise RuntimeError(env["error"])
return env["data"]
// first-slip.mjs -- Node 18+ (global fetch)
const BASE = "https://api.skillsafe.ai/v1/app-api";
let TOKEN = "paste-your-token-here"; // from https://first-slip.skillsafe.ai/tokens.html
async function api(method, path, body, headers = {}) {
const r = await fetch(BASE + path, { method, headers: { "Content-Type": "application/json",
...(TOKEN ? { Authorization: "Bearer " + TOKEN } : {}), ...headers },
body: body === undefined ? undefined : JSON.stringify(body) });
const env = await r.json();
if (env.error) throw new Error(env.error.code + ": " + env.error.message);
return env.data;
}
package main
import ("bytes"; "encoding/json"; "fmt"; "net/http")
const base = "https://api.skillsafe.ai/v1/app-api"
var token = "paste-your-token-here" // from https://first-slip.skillsafe.ai/tokens.html
func api(method, path string, body any, headers map[string]string) (map[string]any, error) {
var buf bytes.Buffer
if body != nil { json.NewEncoder(&buf).Encode(body) }
req, _ := http.NewRequest(method, base+path, &buf)
req.Header.Set("Content-Type", "application/json")
if token != "" { req.Header.Set("Authorization", "Bearer "+token) }
for k, v := range headers { req.Header.Set(k, v) }
res, err := http.DefaultClient.Do(req)
if err != nil { return nil, err }
defer res.Body.Close()
var env struct { Data map[string]any; Error map[string]any }
json.NewDecoder(res.Body).Decode(&env)
if env.Error != nil { return nil, fmt.Errorf("%v", env.Error) }
return env.Data, nil
}
// FirstSlip.java -- Java 17+, with com.fasterxml.jackson.core:jackson-databind
import com.fasterxml.jackson.databind.*;
import java.net.URI; import java.net.http.*; import java.util.*;
public class FirstSlip {
static final String BASE = "https://api.skillsafe.ai/v1/app-api";
static String token = "paste-your-token-here"; // from https://first-slip.skillsafe.ai/tokens.html
static final ObjectMapper M = new ObjectMapper();
static final HttpClient C = HttpClient.newHttpClient();
static JsonNode api(String method, String path, Object body, Map<String, String> headers) throws Exception {
var b = HttpRequest.newBuilder(URI.create(BASE + path)).header("Content-Type", "application/json");
if (!token.isEmpty()) b.header("Authorization", "Bearer " + token);
if (headers != null) headers.forEach(b::header);
b.method(method, body == null ? HttpRequest.BodyPublishers.noBody() : HttpRequest.BodyPublishers.ofString(M.writeValueAsString(body)));
JsonNode env = M.readTree(C.send(b.build(), HttpResponse.BodyHandlers.ofString()).body());
if (env.hasNonNull("error")) throw new RuntimeException(env.get("error").toString());
return env.get("data");
}
}
require "json"
require "net/http"
BASE = "https://api.skillsafe.ai/v1/app-api"
TOKEN = "paste-your-token-here" # from https://first-slip.skillsafe.ai/tokens.html
def api(method, path, body = nil, headers = {})
uri = URI(BASE + path)
req = Net::HTTPGenericRequest.new(method, !body.nil?, true, uri.request_uri,
{ "Content-Type" => "application/json" }.merge(TOKEN.empty? ? {} : { "Authorization" => "Bearer #{TOKEN}" }).merge(headers))
req.body = JSON.generate(body) unless body.nil?
env = JSON.parse(Net::HTTP.start(uri.host, uri.port, use_ssl: true) { |h| h.request(req) }.body)
raise env["error"].to_s if env["error"]
env["data"]
end
<?php
const BASE = "https://api.skillsafe.ai/v1/app-api";
$TOKEN = "paste-your-token-here"; // from https://first-slip.skillsafe.ai/tokens.html
function api(string $method, string $path, $body = null, array $headers = []) {
global $TOKEN;
$h = ["Content-Type: application/json"];
if ($TOKEN) $h[] = "Authorization: Bearer $TOKEN";
foreach ($headers as $k => $v) $h[] = "$k: $v";
$ch = curl_init(BASE . $path);
curl_setopt_array($ch, [CURLOPT_CUSTOMREQUEST => $method, CURLOPT_HTTPHEADER => $h, CURLOPT_RETURNTRANSFER => true]);
if ($body !== null) curl_setopt($ch, CURLOPT_POSTFIELDS, json_encode($body));
$env = json_decode(curl_exec($ch), true);
if (!empty($env["error"])) throw new Exception(json_encode($env["error"]));
return $env["data"];
}
// Program.cs -- .NET 6+ console app
using System.Net.Http.Json; using System.Text.Json; using System.Text.Json.Nodes;
static class Api {
public const string Base = "https://api.skillsafe.ai/v1/app-api";
public static string Token = "paste-your-token-here"; // from https://first-slip.skillsafe.ai/tokens.html
static readonly HttpClient C = new();
public static async Task<JsonNode?> Call(string method, string path, object? body = null, Dictionary<string, string>? headers = null) {
var req = new HttpRequestMessage(new HttpMethod(method), Base + path);
if (Token != "") req.Headers.Add("Authorization", "Bearer " + Token);
if (headers != null) foreach (var h in headers) req.Headers.Add(h.Key, h.Value);
if (body != null) req.Content = JsonContent.Create(body);
var env = JsonNode.Parse(await (await C.SendAsync(req)).Content.ReadAsStringAsync())!;
if (env["error"] is JsonNode e && e.GetValueKind() != JsonValueKind.Null) throw new Exception(e.ToJsonString());
return env["data"];
}
}
Step 2 — a token
A guest token is enough for /me and /estimate. A run is metered, so it needs a personal token: sign in on /tokens.html and copy it from there.
# a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
TOKEN=$(curl -s -X POST "$BASE/guest" -H "Content-Type: application/json" -d '{"slug":"first-slip"}' | jq -r '.data.token')
# a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
TOKEN = ""
TOKEN = api("POST", "/guest", {"slug": "first-slip"})["token"]
// a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
TOKEN = "";
TOKEN = (await api("POST", "/guest", { slug: "first-slip" })).token;
// inside main: a guest token (enough for /me and /estimate); a run needs your personal token
token = ""
g, err := api("POST", "/guest", map[string]string{"slug": "first-slip"}, nil)
if err != nil { panic(err) }
token = g["token"].(string)
// inside main: a guest token (enough for /me and /estimate); a run needs your personal token
token = "";
token = api("POST", "/guest", Map.of("slug", "first-slip"), null).get("token").asText();
# a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
TOKEN.replace("")
TOKEN.replace(api("POST", "/guest", { slug: "first-slip" })["token"])
// a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
$TOKEN = "";
$TOKEN = api("POST", "/guest", ["slug" => "first-slip"])["token"];
// a guest token (enough for /me and /estimate); a run needs your personal token from /tokens.html
Api.Token = "";
Api.Token = (await Api.Call("POST", "/guest", new { slug = "first-slip" }))!["token"]!.GetValue<string>();
Step 3 — GET /me
Who the token is (subject_type: user or guest) and the credit balance.
api GET /me | jq '.data | {subject_type, credits}'
me = api("GET", "/me")
print(me["subject_type"], me.get("credits"))
const me = await api("GET", "/me");
console.log(me.subject_type, me.credits);
me, _ := api("GET", "/me", nil, nil)
fmt.Println(me["subject_type"], me["credits"])
JsonNode me = api("GET", "/me", null, null);
System.out.println(me.get("subject_type") + " " + me.get("credits"));
me = api("GET", "/me")
puts [me["subject_type"], me["credits"]].inspect
$me = api("GET", "/me");
echo $me["subject_type"], " ", $me["credits"] ?? "", "\n";
var me = await Api.Call("GET", "/me");
Console.WriteLine($"{me!["subject_type"]} {me["credits"]}");
Step 4 — POST /estimate
Free. The body is the run input itself, the bare object (never wrapped in {"input": ...}). hold_credits is a reservation, not the price; min_credits is what the balance must cover; model_alias reads gpt-terra.
# input.json: the run input object - {"task": "mark", "kind": "solve", "level": "middle", "problem": "Solve 5x - 3 = 2x + 9", "steps": "[{\"id\":\"L1\",\"text\":\"5x - 2x = 9 - 3\",\"check\":\"slip\",\"detail\":\"solutions change: the problem has x = 4, this line has x = 2\"},{\"id\":\"L2\",\"text\":\"3x = 6\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 2\"}, ...]", "figures": "{...}", "notes": "I always get mixed up moving numbers across the equals sign."}
api POST /estimate "$(cat input.json)" | jq '.data | {hold_credits, min_credits, model, model_alias, markup_bps, warnings}'
inp = json.load(open("input.json")) # {"task": "mark", "kind": "solve", "level": "middle", "problem": "Solve 5x - 3 = 2x + 9", "steps": "[{\"id\":\"L1\",\"text\":\"5x - 2x = 9 - 3\",\"check\":\"slip\",\"detail\":\"solutions change: the problem has x = 4, this line has x = 2\"},{\"id\":\"L2\",\"text\":\"3x = 6\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 2\"}, ...]", "figures": "{...}", "notes": "I always get mixed up moving numbers across the equals sign."}
est = api("POST", "/estimate", inp)
print(est["hold_credits"], est["min_credits"], est["model"], est.get("warnings"))
import { readFileSync } from "node:fs";
const input = JSON.parse(readFileSync("input.json", "utf8")); // {task: "mark", kind, level, problem, steps, figures, notes, ... (see the field table)}
const est = await api("POST", "/estimate", input);
console.log(est.hold_credits, est.min_credits, est.model, est.warnings);
raw, _ := os.ReadFile("input.json") // add "os" to the imports
var input map[string]any
json.Unmarshal(raw, &input)
est, _ := api("POST", "/estimate", input, nil)
fmt.Println(est["hold_credits"], est["min_credits"], est["model"])
Map<String, Object> input = M.readValue(new java.io.File("input.json"), Map.class);
JsonNode est = api("POST", "/estimate", input, null);
System.out.println(est.get("hold_credits") + " " + est.get("min_credits") + " " + est.get("model"));
input = JSON.parse(File.read("input.json"))
est = api("POST", "/estimate", input)
puts [est["hold_credits"], est["min_credits"], est["model"]].inspect
$input = json_decode(file_get_contents("input.json"), true);
$est = api("POST", "/estimate", $input);
echo $est["hold_credits"], " ", $est["min_credits"], " ", $est["model"], "\n";
var input = JsonNode.Parse(File.ReadAllText("input.json"))!;
var est = await Api.Call("POST", "/estimate", input);
Console.WriteLine($"{est!["hold_credits"]} {est["min_credits"]} {est["model"]}");
Step 5 — POST /run, then poll the job
Send an Idempotency-Key built from the lane and the input: a retry with the same key never bills twice. The page uses first-slip:<task>:<inputHash>:a<attempt> (the one task is mark), and its one reformat retry (with retry_note added) is attempt 2, a new key and a second run. The job's output.output is the reply text; truncated: true means the balance cut it short.
KEY="first-slip:mark:$(shasum -a 256 input.json | cut -c1-16):a1"
JOB=$(curl -s -X POST "$BASE/run" -H "Content-Type: application/json" -H "Authorization: Bearer $TOKEN" \
-H "Idempotency-Key: $KEY" --data @input.json | jq -r '.data.job_id')
while :; do
J=$(api GET "/jobs/$JOB"); S=$(echo "$J" | jq -r '.data.status')
case "$S" in succeeded|failed|cancelled) break;; esac; sleep 2
done
echo "$J" | jq -r '.data.output.output' > reply.json # one JSON object, the reply contract
echo "$J" | jq '.data | {charged_credits, truncated}'
import hashlib, time
key = "first-slip:" + inp["task"] + ":" + hashlib.sha256(json.dumps(inp).encode()).hexdigest()[:16] + ":a1"
job = api("POST", "/run", inp, {"Idempotency-Key": key})
while True:
j = api("GET", "/jobs/" + job["job_id"])
if j["status"] in ("succeeded", "failed", "cancelled"):
break
time.sleep(2)
reply = json.loads(j["output"]["output"]) # the reply as one JSON object
print(j["charged_credits"], j.get("truncated"), reply.get("verdict"))
import { createHash } from "node:crypto";
const key = `first-slip:${input.task}:${createHash("sha256").update(JSON.stringify(input)).digest("hex").slice(0, 16)}:a1`;
const job = await api("POST", "/run", input, { "Idempotency-Key": key });
let j;
do { await new Promise((r) => setTimeout(r, 2000)); j = await api("GET", "/jobs/" + job.job_id); }
while (!["succeeded", "failed", "cancelled"].includes(j.status));
const reply = JSON.parse(j.output.output);
console.log(j.charged_credits, j.truncated, reply.verdict);
sum := sha256.Sum256(raw) // add "crypto/sha256", "encoding/hex", "time" to the imports
key := "first-slip:" + input["task"].(string) + ":" + hex.EncodeToString(sum[:8]) + ":a1"
job, _ := api("POST", "/run", input, map[string]string{"Idempotency-Key": key})
var j map[string]any
for {
time.Sleep(2 * time.Second)
j, _ = api("GET", "/jobs/"+job["job_id"].(string), nil, nil)
if s := j["status"]; s == "succeeded" || s == "failed" || s == "cancelled" { break }
}
fmt.Println(j["charged_credits"], j["truncated"], j["output"].(map[string]any)["output"])
var digest = java.security.MessageDigest.getInstance("SHA-256").digest(M.writeValueAsBytes(input));
String key = "first-slip:" + input.get("task") + ":" + HexFormat.of().formatHex(digest, 0, 8) + ":a1";
JsonNode job = api("POST", "/run", input, Map.of("Idempotency-Key", key)), j;
do { Thread.sleep(2000); j = api("GET", "/jobs/" + job.get("job_id").asText(), null, null); }
while (!Set.of("succeeded", "failed", "cancelled").contains(j.get("status").asText()));
JsonNode reply = M.readTree(j.get("output").get("output").asText());
System.out.println(j.get("charged_credits") + " " + reply);
require "digest"
key = "first-slip:#{input["task"]}:#{Digest::SHA256.hexdigest(JSON.generate(input))[0, 16]}:a1"
job = api("POST", "/run", input, { "Idempotency-Key" => key })
j = nil
loop do
sleep 2
j = api("GET", "/jobs/#{job["job_id"]}")
break if %w[succeeded failed cancelled].include?(j["status"])
end
reply = JSON.parse(j["output"]["output"])
puts [j["charged_credits"], j["truncated"], reply["title"]].inspect
$key = "first-slip:" . $input["task"] . ":" . substr(hash("sha256", json_encode($input)), 0, 16) . ":a1";
$job = api("POST", "/run", $input, ["Idempotency-Key" => $key]);
do { sleep(2); $j = api("GET", "/jobs/" . $job["job_id"]); }
while (!in_array($j["status"], ["succeeded", "failed", "cancelled"]));
$reply = json_decode($j["output"]["output"], true);
echo $j["charged_credits"], " ", $reply["title"], "\n";
var digest = System.Security.Cryptography.SHA256.HashData(System.Text.Encoding.UTF8.GetBytes(input.ToJsonString()));
var key = $"first-slip:{input["task"]}:{Convert.ToHexString(digest, 0, 8).ToLowerInvariant()}:a1";
var job = await Api.Call("POST", "/run", input, new() { ["Idempotency-Key"] = key });
JsonNode j;
do { await Task.Delay(2000); j = (await Api.Call("GET", "/jobs/" + job!["job_id"]))!; }
while (!new[] { "succeeded", "failed", "cancelled" }.Contains(j["status"]!.GetValue<string>()));
var reply = JsonNode.Parse(j["output"]!["output"]!.GetValue<string>());
Console.WriteLine($"{j["charged_credits"]} {reply}");
Step 6 — POST /run-stream
The same run as Server-Sent Events, with the same input.json. Browsers receive progress ticks rather than text deltas; the final done event carries the reply.
# Server-Sent Events: tick/delta events while the job runs, then a final event with the job
curl -N -s -X POST "$BASE/run-stream" -H "Content-Type: application/json" -H "Authorization: Bearer $TOKEN" \
-H "Idempotency-Key: first-slip:mark:$(shasum -a 256 input.json | cut -c1-16):a1" --data @input.json
rev = json.load(open("input.json")) # the same run input as input.json: {"task": "mark", "kind": "solve", "level": "middle", "problem": "Solve 5x - 3 = 2x + 9", "steps": "[{\"id\":\"L1\",\"text\":\"5x - 2x = 9 - 3\",\"check\":\"slip\",\"detail\":\"solutions change: the problem has x = 4, this line has x = 2\"},{\"id\":\"L2\",\"text\":\"3x = 6\",\"check\":\"ok\",\"detail\":\"same solutions as the line before: x = 2\"}, ...]", "figures": "{...}", "notes": "I always get mixed up moving numbers across the equals sign."}
req = urllib.request.Request(BASE + "/run-stream", method="POST", data=json.dumps(rev).encode(),
headers={"Content-Type": "application/json", "Authorization": "Bearer " + TOKEN,
"Idempotency-Key": "first-slip:mark:" + hashlib.sha256(json.dumps(rev).encode()).hexdigest()[:16] + ":a1"})
with urllib.request.urlopen(req) as r:
for line in r:
line = line.decode().strip()
if line.startswith("data:"):
print(line[5:].strip()[:200])
const rev = JSON.parse(readFileSync("input.json", "utf8"));
const r = await fetch(BASE + "/run-stream", { method: "POST", body: JSON.stringify(rev), headers: {
"Content-Type": "application/json", Authorization: "Bearer " + TOKEN,
"Idempotency-Key": `first-slip:mark:${createHash("sha256").update(JSON.stringify(rev)).digest("hex").slice(0, 16)}:a1` } });
const dec = new TextDecoder();
for await (const chunk of r.body) for (const line of dec.decode(chunk).split("\n"))
if (line.startsWith("data:")) console.log(line.slice(5).trim().slice(0, 200));
rraw, _ := os.ReadFile("input.json") // add "bufio", "strings" to the imports
rs := sha256.Sum256(rraw)
req, _ := http.NewRequest("POST", base+"/run-stream", bytes.NewReader(rraw))
req.Header.Set("Content-Type", "application/json")
req.Header.Set("Authorization", "Bearer "+token)
req.Header.Set("Idempotency-Key", "first-slip:mark:"+hex.EncodeToString(rs[:8])+":a1")
res, _ := http.DefaultClient.Do(req)
sc := bufio.NewScanner(res.Body)
for sc.Scan() { if l := sc.Text(); strings.HasPrefix(l, "data:") { fmt.Println(l[5:]) } }
String rev = java.nio.file.Files.readString(java.nio.file.Path.of("input.json"));
var rd = java.security.MessageDigest.getInstance("SHA-256").digest(rev.getBytes());
var sreq = HttpRequest.newBuilder(URI.create(BASE + "/run-stream")).header("Content-Type", "application/json")
.header("Authorization", "Bearer " + token).header("Idempotency-Key", "first-slip:mark:" + HexFormat.of().formatHex(rd, 0, 8) + ":a1")
.POST(HttpRequest.BodyPublishers.ofString(rev)).build();
C.send(sreq, HttpResponse.BodyHandlers.ofLines()).body().filter(l -> l.startsWith("data:")).forEach(System.out::println);
rev = File.read("input.json")
uri = URI(BASE + "/run-stream")
req = Net::HTTP::Post.new(uri, "Content-Type" => "application/json", "Authorization" => "Bearer #{TOKEN}",
"Idempotency-Key" => "first-slip:mark:#{Digest::SHA256.hexdigest(rev)[0, 16]}:a1")
req.body = rev
Net::HTTP.start(uri.host, uri.port, use_ssl: true) do |h|
h.request(req) { |res| res.read_body { |chunk| chunk.each_line { |l| puts l if l.start_with?("data:") } } }
end
$rev = file_get_contents("input.json");
$ch = curl_init(BASE . "/run-stream");
curl_setopt_array($ch, [CURLOPT_POST => true, CURLOPT_POSTFIELDS => $rev, CURLOPT_HTTPHEADER => [
"Content-Type: application/json", "Authorization: Bearer $TOKEN",
"Idempotency-Key: first-slip:mark:" . substr(hash("sha256", $rev), 0, 16) . ":a1"],
CURLOPT_WRITEFUNCTION => function ($ch, $chunk) { foreach (explode("\n", $chunk) as $l) if (str_starts_with($l, "data:")) echo $l, "\n"; return strlen($chunk); }]);
curl_exec($ch);
var rev = File.ReadAllText("input.json");
var rd = System.Security.Cryptography.SHA256.HashData(System.Text.Encoding.UTF8.GetBytes(rev));
var sreq = new HttpRequestMessage(HttpMethod.Post, Api.Base + "/run-stream") { Content = new StringContent(rev, System.Text.Encoding.UTF8, "application/json") };
sreq.Headers.Add("Authorization", "Bearer " + Api.Token);
sreq.Headers.Add("Idempotency-Key", $"first-slip:mark:{Convert.ToHexString(rd, 0, 8).ToLowerInvariant()}:a1");
using var http = new HttpClient();
using var res = await http.SendAsync(sreq, HttpCompletionOption.ResponseHeadersRead);
using var rdr = new StreamReader(await res.Content.ReadAsStreamAsync());
for (string? l; (l = await rdr.ReadLineAsync()) != null;) if (l.StartsWith("data:")) Console.WriteLine(l);