multilingual-e5-small-mlx
This model was converted to MLX format from intfloat/multilingual-e5-small.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx
git clone https://github.com/ml-explore/mlx-examples.git
cd mlx-examples/llms/hf_llm
python generate.py --model mlx-community/multilingual-e5-small-mlx --prompt "My name is"
- Downloads last month
- 2,964
Hardware compatibility
Log In to add your hardware
Quantized
Spaces using mlx-community/multilingual-e5-small-mlx 11
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported73.791
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported37.000
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported67.955
- accuracy on MTEB AmazonCounterfactualClassification (de)test set self-reported71.649
- ap on MTEB AmazonCounterfactualClassification (de)test set self-reported82.119
- f1 on MTEB AmazonCounterfactualClassification (de)test set self-reported69.880
- accuracy on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported75.810
- ap on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported24.469
- f1 on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported63.001
- accuracy on MTEB AmazonCounterfactualClassification (ja)test set self-reported64.186
- ap on MTEB AmazonCounterfactualClassification (ja)test set self-reported15.497
- f1 on MTEB AmazonCounterfactualClassification (ja)test set self-reported52.072
- accuracy on MTEB AmazonPolarityClassificationtest set self-reported88.699
- ap on MTEB AmazonPolarityClassificationtest set self-reported85.270
- f1 on MTEB AmazonPolarityClassificationtest set self-reported88.656
- accuracy on MTEB AmazonReviewsClassification (en)test set self-reported44.698