nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
1B • Updated • 697
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
4B • Updated • 669
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_gptq_tinyllama-e2e
1B • Updated • 687
nm-testing/Qwen2.5-0.5B-W8A8_tensor_weight_static_per_tensor_act-e2e
0.6B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_tensor_weight_static_per_tensor_act-e2e
1B • Updated • 696
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-e2e
1B • Updated • 488
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e
1B • Updated • 732
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_tensor-e2e
1B • Updated • 252
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_channel-e2e
1B • Updated • 327
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-e2e
1B • Updated • 1.08k
nm-testing/Qwen2.5-0.5B-FP8_DYNAMIC-e2e
0.6B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e
1B • Updated • 254
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16-e2e
0.7B • Updated • 277
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-e2e
0.7B • Updated • 733
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Static-Asym-e2e
1B • Updated • 643
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Asym-e2e
1B • Updated • 636
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-e2e
1B • Updated • 791
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16_channel-e2e
1B • Updated • 653
nm-testing/TinyLlama-1.1B-Chat-v1.0-w4a16-asym-awq-e2e
1B • Updated • 610
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-e2e
1B • Updated • 2.91k
nm-testing/Qwen2.5-0.5B-W4A16_channel-e2e
0.6B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_channel-e2e
1B • Updated • 665
nm-testing/Qwen2.5-0.5B-actorder-weight-e2e
0.6B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight-e2e
1B • Updated • 639
nm-testing/Qwen2.5-0.5B-actorder-group-e2e
0.6B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e
1B • Updated • 666
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e
0.3B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e
0.3B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e
0.7B • Updated • 42
nm-testing/Qwen2.5-0.5B-sparse2of4_fp8_dynamic-e2e
0.5B • Updated