nytopop
/

3b_or_base

text-generation

text-generation-inference

Model card Files Files and versions

noteworthy changes

tokenizer omits <|audio|> to prevent finetunes resizing the embeddings unneccessarily
config.json uses the correct EOS to end generation on end of audio
generation_config.json uses the correct EOS to end generation on end of audio + has a reasonable default temperature
chat_template.jinja maps user messages to transcripts and assistant messages to audio for simple conversational context management

Downloads last month: -

Safetensors

Model size

3B params

Tensor type

BF16

·

Model tree for nytopop/3b_or_base

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

canopylabs/orpheus-3b-0.1-pretrained

Finetuned

(88)

this model

Quantizations