Skip to content

License: AGPL v3 PyPI Python Website

dragiter - Deterministic Context Iterator

A focused command-line tool for structured, reproducible LLM workflows.

Source: GitLab · Releases · Issues · Website

dragiter treats large language models the way a well-mannered Unix utility treats everything else: as a stage in a pipeline. You supply material, a prompt template and (optionally) a loop file; it assembles deterministic requests and writes the results where you tell it to. No chat interface, no hidden state, no surprises.

Why it exists

Assembling context for an LLM by hand is a peculiar form of digital drudgery. dragiter replaces that ritual with something closer to proper engineering:

  • Structured context assembly - glob patterns and regular expressions carve documents into the exact chunks the model should see.
  • Prompt templates as code - system instructions, material formatting and synthesis logic live in plain TOML files that can be version-controlled, reviewed and shared.
  • Batch iteration without custom scripts - a simple text file or JSONL loop drives repeated runs with different parameters.
  • Provider independence - any OpenAI-compatible endpoint (local Ollama, xAI Grok, Google, LiteLLM proxies, …) works by changing three settings: base_url, model_name and api_key.

If you prefer deterministic behaviour, explicit file routing and the ability to put an entire AI workflow under version control, this tool is for you.

Installation

pip install dragiter

Requires Python ≥ 3.11.

Compatibility

-b applies to resource sections without base_directory again (fixed in 2026.10.18). From 2026.8.31 until 2026.9.29, -b was ignored for a resource section that has no base_directory of its own: its globs were resolved in the working directory, whatever -b said. That was a fault; -b is documented as the base for all relative paths, and 2026.7.26 and earlier behaved that way. Now such a section is resolved in -b when that is set, and in the working directory otherwise. You are affected if you pass -b and have sections without base_directory: for instance, a run started in a project folder with -b pointing elsewhere used to pick up the *.md files of the project folder (such as its README.md), and now picks up those of -b. To keep the old result, give the section an absolute base_directory (-b does not move that), or leave -b out. Runs without -b are not affected.

2026.9.26 changes output routing. -o and -O are now mutually exclusive (previously both could be set together); the validator rejects the combination outright. The scratch copies kept while a run is in progress no longer live under .dragiter-partial/ - that directory is gone. Each run now stages its completions in a hidden, sink-specific workspace instead: .tmp_staging_dir_<PID>/ inside -O's directory, .tmp_staging_file_<PID>/ beside -o's file, or .tmp_staging_stdout_<PID>/ inside the user's temp directory for stdout-only runs. Simulate output also changed shape: with neither -o nor -O set, stdout now prints the same content -o writes to a file (run board plus every session's board and complete request), not the run board alone - see the Quick Start section below.

2026.9.9 is a breaking release for resource files. The singular TOML key regex_pattern is no longer accepted. A section that still sets it aborts collection and names the section. Use regex_patterns as a list of strings:

regex_patterns = ['^##\s+', '^###\s+']

Quick Start

Keep resources (what the model should know) separate from prompts (what you want it to do).

1. Extract the examples

dragiter-gen-examples .
cd examples/01_md_sample

2. Always simulate first

dragiter -s -p 01_prompt_md.toml -r 01_resource_md.toml -l 01_loop_md.txt

No network calls, no tokens spent. With neither -o nor -O, stdout prints the aggregate run board (sessions, pack, window, routing) followed by every session's board and complete outgoing request - the same content -o would write to a file. Sections are joined with the configured output_delimiter; within one section the board and the request stay separated by ***. Add -O out (or -o file.md) to write that content to files instead; stdout then stays quiet. Shell redirection of stdout is not treated as a file sink.

3. Run against a local Ollama instance

dragiter -v -c config-ollama.toml -p 01_prompt_md.toml -r 01_resource_md.toml -l 01_loop_md.txt

-v writes the live run board on stderr, not onto the result sink. It is advisable with local models; they can take their time and the silence is otherwise rather disconcerting.

Documentation

Documentation follows the Diátaxis framework and is deliberately split:

dragiter-gen-docs .
  • docs/manual.md - Tutorial, How-to guides and Explanations
  • docs/reference.md - Complete technical reference (flags, schemas, placeholders, defaults, activity log)
  • docs/info.txt - Concise man-page summary (dragiter --info)
  • docs/faq.md - Frequently asked questions and troubleshooting
  • docs/glossary.md - Definitions of terms used across the documentation
  • docs/window-starting-values.md - Starting values for chars_per_token, max_context_tokens and max_output_tokens per provider

Configuration in brief

Settings are resolved in this strict order (highest priority first):

  1. Command-line arguments
  2. TOML configuration file (-c, DRAGITER_CONFIG_FILE, or ~/.config/dragiter/config.toml)
  3. Environment variables (DRAGITER_*)
  4. Built-in defaults

A value set by a higher-priority source cannot be overridden by a lower one. This includes the options that set up a run (-d, -v, -L, -b, -a, -s); only the location of the configuration file (-c) cannot be set inside it. An error in the configuration file is reported on stderr before anything else happens; so is a missing file named by -c or DRAGITER_CONFIG_FILE, and a $VAR reference to a variable that does not exist. --help and --version do not read the configuration file.

Notable capabilities (all present in the code)

  • Staged regex_patterns: pattern 0 always cuts; later patterns refine only pieces above pack_limit_chars
  • Optional packing (pack_limit_chars on the section, or --pack-limit-chars) and a chunk cap (--max-chunks, default 200)
  • Include/exclude filters and per-section chunk_substitutions
  • Sequential or batched processing of material chunks
  • Context-window estimation when chars_per_token, max_context_tokens and max_output_tokens are all set; otherwise boards show n/a / --. A live run that would exceed the window is refused before the first request; a simulate run completes and shows window no
  • JSONL loops that expose every object key as a template placeholder
  • Stdin is read only when -t / --task is set or the prompt contains {STDIN}
  • Activity tracing to JSONL for auditing
  • Retry logic with configurable delay and maximum attempts (transient 5xx and connection drops; 504 / gateway timeout / runner crash are terminal)
  • Optional mutual TLS (client certificate + key)
  • Results on stdout only when neither -o nor -O is set; simulate output there matches -o's shape exactly (run board plus every session's board and request); file routing replaces that sink
  • -o and -O are mutually exclusive
  • Output modes: exclusive create (x), overwrite (w), append (a)
  • Verbose stderr run board; every run stages its completions in a hidden workspace until commit - .tmp_staging_dir_<PID>/ inside -O's directory, .tmp_staging_file_<PID>/ beside -o's file, or .tmp_staging_stdout_<PID>/ inside the user's temp directory for stdout-only

Tool Chaining (the Unix way)

Because dragiter does one job cleanly it composes with the rest of the terminal. Standard input is fully supported:

# Stdin into a prompt that contains {STDIN}; -o replaces the stdout sink
curl -s https://example-competitor.com/pricing \
  | dragiter -p summarize_pricing.toml -r web_resources.toml -o pricing_report.txt

# Omit -o/-O to echo the result (or the simulate board) on stdout
dragiter -s -p summarize_pricing.toml -r web_resources.toml > board.md

The same pattern works with database exports, log files or any other tool that can produce a stream.

Acknowledgements

This project would still be an elegant collection of unfinished ideas without the tireless pair-programming assistance of Grok and Gemini. Their code reviews and occasional refusal to let dubious design pass were invaluable.

Special thanks to Claude Code (Anthropic) for pair-programming, specification, testing and documentation work that would otherwise have taken weeks.

Equal thanks are due to the broader Python community, whose libraries and documentation remain the foundation of tools like this one.

Happy automating.