Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
AlignmentResearch
/
pineapple-annah_rm
like
0
Follow
FAR AI
67
PEFT
Safetensors
arxiv:
1910.09700
Model card
Files
Files and versions
xet
Community
Use this model
Instructions to use AlignmentResearch/pineapple-annah_rm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Libraries
PEFT
How to use AlignmentResearch/pineapple-annah_rm with PEFT:
Task type is invalid.
Notebooks
Google Colab
Kaggle
main
pineapple-annah_rm
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
annahbanannah
Upload trained reward model
7fec6a2
verified
10 months ago
reference
Upload trained reward model
10 months ago
reward
Upload trained reward model
10 months ago
.gitattributes
Safe
1.57 kB
Upload trained reward model
10 months ago
README.md
Safe
5.09 kB
Upload trained reward model
10 months ago
added_tokens.json
Safe
707 Bytes
Upload trained reward model
10 months ago
chat_template.jinja
Safe
4.17 kB
Upload trained reward model
10 months ago
merges.txt
Safe
1.67 MB
Upload trained reward model
10 months ago
special_tokens_map.json
Safe
613 Bytes
Upload trained reward model
10 months ago
tokenizer.json
Safe
11.4 MB
xet
Upload trained reward model
10 months ago
tokenizer_config.json
Safe
5.4 kB
Upload trained reward model
10 months ago
training_args.bin
pickle
Detected Pickle imports (11)
"transformers.trainer_utils.FSDPOption"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.training_args.OptimizerNames"
,
"trl.trainer.reward_config.RewardConfig"
,
"transformers.trainer_utils.HubStrategy"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"torch.device"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.state.PartialState"
,
"transformers.trainer_utils.SaveStrategy"
How to fix it?
5.56 kB
xet
Upload trained reward model
10 months ago
vocab.json
Safe
2.78 MB
Upload trained reward model
10 months ago