CoPE is a drop-in enhancement of RoPE that delivers consistent gains within the training context and during long-context extrapoaltion.
Haoran Li PRO
haoranli-ml
·
AI & ML interests
ML, RL, Foundation Models
Recent Activity
updated a model about 21 hours ago
haoranli-ml/Gemma-7B-RoPE-Base-theta_200k_sft published a model about 21 hours ago
haoranli-ml/Gemma-7B-RoPE-Base-theta_200k_sft updated a model 1 day ago
haoranli-ml/Gemma-7B-HardClip-Base-theta_200k_sftOrganizations
models 58
haoranli-ml/Gemma-7B-RoPE-Base-theta_200k_sft
9B • Updated • 13
haoranli-ml/Gemma-7B-HardClip-Base-theta_200k_sft
9B • Updated • 14
haoranli-ml/Gemma-7B-CoPE-Base-theta_200k_sft
9B • Updated
haoranli-ml/Gemma-7B-RoPE-Base-theta_200k_1kiter
9B • Updated • 7
haoranli-ml/Gemma-7B-RoPE-Base-theta_200k
9B • Updated • 44
haoranli-ml/Gemma-7B-HardClip-Base-theta_200k_1kiter
9B • Updated • 9
haoranli-ml/Gemma-7B-HardClip-Base-theta_200k
9B • Updated • 78
haoranli-ml/Gemme-7B-CoPE-Base-theta_200k_iter1k
9B • Updated • 14
haoranli-ml/Gemme-7B-CoPE-Base-theta_200k
9B • Updated • 130
haoranli-ml/Gemma-2B-RoPE-Instruct_wrongPretrain_and_sft_data
Text Generation • 3B • Updated • 2
datasets 149
haoranli-ml/prolong-ultrachat-gemma
Updated • 133
haoranli-ml/prolong-data-64K-gemma
Updated • 1.26k
haoranli-ml/genvf-data-generator-100prefix-v1
Viewer • Updated • 110 • 24
haoranli-ml/genvf-filtered-proof-graded_score7_only_with_summaries-full
Viewer • Updated • 1.11k • 27
haoranli-ml/genvf-tcs-full-prl-train-prompt_v2
Viewer • Updated • 2.78k • 24
haoranli-ml/genvf-tcs-full-prl-train
Viewer • Updated • 2.78k • 25
haoranli-ml/genvf-tcs-full
Viewer • Updated • 1.42k • 32
haoranli-ml/tcs-stage1-suffixes-cross
Viewer • Updated • 2.32k • 40
haoranli-ml/genvf-tcs-prefix
Viewer • Updated • 2.32k • 30
haoranli-ml/genvf-tcs
Viewer • Updated • 435 • 62