How to use Erfan2001/multilingual_tokenized with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Erfan2001/multilingual_tokenized")
# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Erfan2001/multilingual_tokenized") model = AutoModelForSequenceClassification.from_pretrained("Erfan2001/multilingual_tokenized")
SFconvertbot