Skip to contents

Authors and Citation

Authors

  • David Zimmermann-Kollenda. Author, maintainer.

  • Roger Zurawicki. Author.
    tiktoken-rs Rust library

  • Authors of the dependent Rust crates. Author.
    see AUTHORS file

Citation

Source: DESCRIPTION

Zimmermann-Kollenda D, Roger Zurawicki, Authors of the dependent Rust crates (2026). rtiktoken: A Byte-Pair-Encoding (BPE) Tokenizer for OpenAI's Large Language Models. R package version 0.11.0, https://davzim.github.io/rtiktoken/. 

@Manual{,
  title = {rtiktoken: A Byte-Pair-Encoding (BPE) Tokenizer for OpenAI's Large Language Models},
  author = {David Zimmermann-Kollenda and {Roger Zurawicki} and {Authors of the dependent Rust crates}},
  year = {2026},
  note = {R package version 0.11.0},
  url = {https://davzim.github.io/rtiktoken/},
}

Additional details

Authors of vendored cargo crates
 - aho-corasick 1.1.4: Andrew Gallant
 - anyhow 1.0.102: David Tolnay
 - base64 0.22.1: Marshall Pierce
 - bit-set 0.8.0: Alexis Beingessner
 - bit-vec 0.8.0: Alexis Beingessner
 - bstr 1.12.1: Andrew Gallant
 - extendr-api 0.8.1: andy-thomason, Thomas Down, Mossa Merhi Reimert, Josiah Parry, Claus O. Wilke, Hiroaki Yutani, Ilia A. Kosenkov, Michael Milton
 - extendr-ffi 0.8.1: andy-thomason, Thomas Down, Mossa Merhi Reimert, Josiah Parry, Claus O. Wilke, Hiroaki Yutani, Ilia A. Kosenkov, Michael Milton
 - extendr-macros 0.8.1: andy-thomason, Thomas Down, Mossa Merhi Reimert, Josiah Parry, Claus O. Wilke, Hiroaki Yutani, Ilia A. Kosenkov, Michael Milton
 - fancy-regex 0.17.0: Raph Levien, Robin Stocker, Keith Hall
 - lazy_static 1.5.0: Marvin Löbel
 - memchr 2.8.0: Andrew Gallant, bluss
 - once_cell 1.21.4: Aleksey Kladov
 - paste 1.0.15: David Tolnay
 - proc-macro2 1.0.106: David Tolnay, Alex Crichton
 - quote 1.0.45: David Tolnay
 - regex 1.12.3: The Rust Project Developers, Andrew Gallant
 - regex-automata 0.4.14: The Rust Project Developers, Andrew Gallant
 - regex-syntax 0.8.10: The Rust Project Developers, Andrew Gallant
 - rustc-hash 1.1.0: The Rust Project Developers
 - serde 1.0.228: Erick Tryzelaar, David Tolnay
 - serde_core 1.0.228: Erick Tryzelaar, David Tolnay
 - serde_derive 1.0.228: Erick Tryzelaar, David Tolnay
 - syn 2.0.117: David Tolnay
 - tiktoken-rs 0.11.0: Roger Zurawicki
 - unicode-ident 1.0.24: David Tolnay

(This file was auto-generated from 'cargo metadata' on 2026-04-10)