Lexers, tokenizers, parsers, compilers, renderers, stringifiers... What's the difference, and how do they work?
-
Updated
Apr 26, 2017
#
token-stream
Here are 6 public repositories matching this topic...
A versatile token stream for handwritten parsers.
-
Updated
Aug 3, 2023 - Python
OpenAI VoiceStream: Real-time text-to-speech library for processing text and token streams using the OpenAI API. Supports multiple voices and thread-safe audio generation.
audio python api machine-learning text-to-speech real-time ai multithreading audio-player speech-synthesis openai audio-processing voice-assistant streaming-audio token-stream openai-api token-streaming text-to-speech-converter gpt-4o real-timespeech-synthesis
-
Updated
Jun 1, 2024 - Python
A low-latency, C++-based simulation engine that ingests token streams from an LLM in real-time, maps semantic token meaning to trade signals, and triggers micro-adjustments to a trading algorithm on a fractional-time (sub-second) scale.
-
Updated
Mar 9, 2026 - C++
Streaming text replacement for AI token streams — handles partial matches across chunk boundaries
-
Updated
Feb 28, 2026
-
Updated
Mar 13, 2026 - Python
Improve this page
Add a description, image, and links to the token-stream topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the token-stream topic, visit your repo's landing page and select "manage topics."