There's currently no standard because there's no one objective best way of handl... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		minimaxir on Dec 13, 2023 \| parent \| context \| favorite \| on: Bash one-liners for LLMs There's currently no standard because there's no one objective best way of handling prompt syntax. There's some libraries which use the OpenAI API syntax as a higher-level abstraction, but for the lower-level precompiled binaries used in in this post that's too much.

Tostino on Dec 13, 2023 [–]

Yes there is...HF chat templates is something that is being standardized on, slowly.

It's just a jinja template embedded in the tokenizer that the model creator can include.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact