Lots of UX improvements that make annotation faster:
- Navigation bar with status badges + skip-to-unannotated
- Grid-based form layouts
- Resizable display panels
- Conditional display logic (show/hide fields based on responses)
- PDF/Word/code rendering in-browser
New support for loading data from anywhere:
URLs, Google Drive, Dropbox, S3, HuggingFace datasets, Google Sheets, databases
Plus: 55 validated survey instruments (SUS, NASA-TLX, UMUX, OCEAN, AttrakDiff...) ready to drop into your post-study workflow. Learn more about your annotators!
New pluggable export system with 8 formats:
COCO JSON (with RLE masks), YOLO, Pascal VOC, CoNLL-2003, CoNLL-U, Mask PNG, EAF (ELAN), TextGrid (Praat)
Smarter annotation workflows:
- MACE annotator competence estimation: model reliability, weight aggregation
- LLM-based option highlighting: subtle AI cues without biasing
- Embedding-based diversity ordering: reduce fatigue from repetitive items
- Video object tracking with keyframe interpolation
New annotation types in v2.2:
- N-ary event annotation (triggers + arguments)
- Entity linking (Wikidata, UMLS, custom KBs)
- Pairwise comparison (A/B + slider)
- Triage (rapid accept/reject/skip)
- Coreference chains
- Conversation trees
- Discontinuous spans
All configurable via YAML.
Potato v2.2.0 is out! The biggest release yet: 9 new annotation schemas, pluggable export system, MACE integration, 55 survey instruments, and much more.
github.com/davidjurgens...
Potato 2.1 is here! Our open-source annotation platform now includes
- multi-field span annotation (e.g., labeling premise/hypothesis separate)
- span linking for relation extraction, and
- AI-assisted visual annotation with YOLO + VLLMs—bounding boxes, labels, rationales, and many more!
We're looking forward to adding new features and keeping Potato supported for years to come, so please feel free to send feature requests on the github too github.com/davidjurgens...
A whole dedicated website! www.potatoannotator.com
- Task design wizard!
- Extensive showcase of 80+ annotation tasks from real papers
- So much documentation
You can easily add your tasks to our showcase with a pull request here github.com/davidjurgens...
Many, many quality of life improvements
- New support for Amazon Mechanical Turk!
- Passwordless servers for trusted environments
- Dynamic data loading—new data can be added to a running server (h/t @mariaa.bsky.social for the request)
- Easier debugging
- So much new documentation
Improved and customized UI
- The whole Potato UI has been overhauled to support mobile annotation better
- New task-specific UI customization lets you easily adjust your task's specific layout without hacking the tool
It's now super easy to polish your design the way you want on Potato
Flexible annotation/survey flow
- Annotators can go through mandatory training
- Support for multiple pre/post-annotation surveys
- Chain together different annotation tasks one-after-another
- Expertise-base instance routing
We're working on more dynamic flows and item routing too!
Built in support for quality control
- Attention checks (catch distracted annotators)
- Gold standard tracking
- Live inter-annotator agreement metrics
- Training phase with feedback
We have a whole new admin dashboard to keep track of annotation process in real time
Potato has finally moved beyond just text! New in 2.0:
- Audio annotation with segment labeling and waveform visualization
- Video annotation with frame-by-frame labeling
- Image region labeling
One platform for text, audio, video, and images—or multimodal!
AI-Assisted Annotation
Potato 2.0 works with multiple LLM providers (OpenAI, Anthropic, Gemini) and local LLMs (vLLM, Ollama) to help annotators work faster:
- Intelligent hints without giving answers
- Keyword highlighting
- Label suggestions
Your annotators get guidance. You keep control.
Super proud that today we're releasing Potato 2.0 - the biggest update yet to our open-source annotation platform www.potatoannotator.com 🥔
Major UI/UX improvements. Support for image, audio & video annotation. AI-powered assistance/hints/labeling. And still free 🤩
Here's some of what's new:
