Running
11
ModernBERT Zero-Shot NLI
ðŸ§
ModernBERT for reasoning and zero-shot classification
promptsource. All implemented preprocessings are in tasks.py or tasks.md. A preprocessing is a function that accepts a dataset and returns the standardized dataset. Preprocessing code is concise and human-readable.\n
models
10
datasets
174
GitHub: https://github.com/sileod/tasksource
\nInstallation and usage:
\npip install tasksource
from tasksource import list_tasks, load_task\ndf = list_tasks()\n\nfor id in df[df.task_type==\"MultipleChoice\"].id:\n dataset = load_task(id)\n # all yielded datasets can be used interchangeably\nSee supported 600+ tasks in tasks.md (+200 MultipleChoice tasks, +200 Classification tasks) and feel free to request a new task. Datasets are downloaded to $HF_DATASETS_CACHE (as any huggingface dataset), so be sure to have >100GB of space there.
Pretrained model:
\nText encoder pretrained on tasksource reached state-of-the-art results: 🤗/deberta-v3-base-tasksource-nli
\nContact and citation
\nI can help you integrate tasksource in your experiments. damien.sileo@inria.fr
More details on this article:
\n@inproceedings{sileo-2024-tasksource-large,\n title = \"tasksource: A Large Collection of {NLP} tasks with a Structured Dataset Preprocessing Framework\",\n author = \"Sileo, Damien\",\n booktitle = \"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)\",\n month = may,\n year = \"2024\",\n address = \"Torino, Italia\",\n publisher = \"ELRA and ICCL\",\n url = \"https://aclanthology.org/2024.lrec-main.1361\",\n pages = \"15655--15684\",\n}\nAI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
tasksource: 600+ dataset harmonization preprocessings with structured annotations for frictionless extreme multi-task learning and evaluation
Huggingface Datasets is a great library, but it lacks standardization, and datasets require preprocessing work to be used interchangeably.
tasksource automates this and facilitates reproducible multi-task learning scaling.
Each dataset is standardized to either MultipleChoice, Classification, or TokenClassification dataset with identical fields. We do not support generation tasks as they are addressed by promptsource. All implemented preprocessings are in tasks.py or tasks.md. A preprocessing is a function that accepts a dataset and returns the standardized dataset. Preprocessing code is concise and human-readable.
GitHub: https://github.com/sileod/tasksource
Installation and usage:
pip install tasksource
from tasksource import list_tasks, load_task
df = list_tasks()
for id in df[df.task_type=="MultipleChoice"].id:
dataset = load_task(id)
# all yielded datasets can be used interchangeably
See supported 600+ tasks in tasks.md (+200 MultipleChoice tasks, +200 Classification tasks) and feel free to request a new task. Datasets are downloaded to $HF_DATASETS_CACHE (as any huggingface dataset), so be sure to have >100GB of space there.
Pretrained model:
Text encoder pretrained on tasksource reached state-of-the-art results: 🤗/deberta-v3-base-tasksource-nli
Contact and citation
I can help you integrate tasksource in your experiments. damien.sileo@inria.fr
More details on this article:
@inproceedings{sileo-2024-tasksource-large,
title = "tasksource: A Large Collection of {NLP} tasks with a Structured Dataset Preprocessing Framework",
author = "Sileo, Damien",
booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
month = may,
year = "2024",
address = "Torino, Italia",
publisher = "ELRA and ICCL",
url = "https://aclanthology.org/2024.lrec-main.1361",
pages = "15655--15684",
}
models
10
tasksource/ettin-17m-embed
Sentence Similarity
•
16.8M
•
Updated
•
78
•
•
3
tasksource/ettin-32m-embed
Sentence Similarity
•
31.9M
•
Updated
•
2
•
2
tasksource/ModernBERT-base-nli
Zero-Shot Classification
•
0.1B
•
Updated
•
3.68k
•
•
25
tasksource/ModernBERT-large-nli
Zero-Shot Classification
•
0.4B
•
Updated
•
16.3k
•
•
10
tasksource/ModernBERT-large-adapters
Updated
•
2
•
1
tasksource/ModernBERT-base-embed
Sentence Similarity
•
0.1B
•
Updated
•
48
•
16
tasksource/ModernBERT-base-adapters
Updated
•
1
tasksource/deberta-base-long-nli
Zero-Shot Classification
•
0.2B
•
Updated
•
1.28k
•
•
26
tasksource/deberta-small-long-nli
Zero-Shot Classification
•
0.1B
•
Updated
•
15.4k
•
•
48
tasksource/deberta-base-long-adapters
Updated
•
1
datasets
174
tasksource/SYNTH
Viewer
•
Updated
•
12.1M
•
348
tasksource/FOL-nli
Viewer
•
Updated
•
103k
•
117
•
3
tasksource/zorro
Viewer
•
Updated
•
46k
•
11
tasksource/platinum-bench
Viewer
•
Updated
•
2.73k
•
3
tasksource/dolci-instruct
Viewer
•
Updated
•
1.82M
•
79
tasksource/flan
Viewer
•
Updated
•
200k
•
13
tasksource/dolci-dpo
Viewer
•
Updated
•
260k
•
11
tasksource/zero-shot-label-nli
Viewer
•
Updated
•
2.24M
•
100
•
10
tasksource/bigbench
Viewer
•
Updated
•
841k
•
3.47k
•
67
tasksource/mmlu
Viewer
•
Updated
•
15.9k
•
4.49k
•
35