Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Catwalk: A Unified Language Model Evaluation Framework for Many Datasets (2023)
CoLLiE: Collaborative Training of Large Language Models in an Efficient Way (2023)
Augmenty: A Python Library for Structured Text Augmentation (2023)
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning (2023)
TextMachina: Seamless Generation of Machine-Generated Text Datasets (2024)

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

\n","updatedAt":"2024-01-27T01:21:47.547Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7407514452934265},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[{"reaction":"👍","users":["minhsphuc12"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2401.14019","authors":[{"_id":"65b31aa18627e4cca319973e","user":{"_id":"5fc0292de45c5468456e022b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5fc0292de45c5468456e022b/MEuHFEf6LtTbcptc0heoM.png","isPro":false,"fullname":"Elron Bandel","user":"Elron","type":"user"},"name":"Elron Bandel","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:52:55.318Z","hidden":false},{"_id":"65b31aa18627e4cca319973f","user":{"_id":"61e01a92a24b774dac1f32d7","avatarUrl":"/avatars/307aac0c6cfe1879f6a5e5e1d6c10413.svg","isPro":false,"fullname":"Yotam Perlitz","user":"per","type":"user"},"name":"Yotam Perlitz","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:53:07.694Z","hidden":false},{"_id":"65b31aa18627e4cca3199740","user":{"_id":"62fcd609c1588e1d4c6526ea","avatarUrl":"/avatars/11eb8818ed43e14584e3d42930308fc8.svg","isPro":false,"fullname":"Elad Venezian","user":"eladven","type":"user"},"name":"Elad Venezian","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:53:14.387Z","hidden":false},{"_id":"65b31aa18627e4cca3199741","name":"Roni Friedman-Melamed","hidden":false},{"_id":"65b31aa18627e4cca3199742","user":{"_id":"632ae2606cb20ba0ae8007d8","avatarUrl":"/avatars/023eb4536e9bfcebbcc42eaea7167596.svg","isPro":false,"fullname":"Ofir Arviv","user":"OfirArviv","type":"user"},"name":"Ofir Arviv","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:53:39.090Z","hidden":false},{"_id":"65b31aa18627e4cca3199743","user":{"_id":"65b60c17729ea1912ef74718","avatarUrl":"/avatars/49880599a977a45ce03bc5112edf8a1a.svg","isPro":false,"fullname":"matan orbach","user":"matanor","type":"user"},"name":"Matan Orbach","status":"claimed_verified","statusLastChangedAt":"2024-01-29T08:26:16.417Z","hidden":false},{"_id":"65b31aa18627e4cca3199744","user":{"_id":"652e3800f7431c19a99c91e9","avatarUrl":"/avatars/df1c1d66e52b06af4dbe5791c4819782.svg","isPro":false,"fullname":"Shachar Don-Yehiya","user":"shachar-don","type":"user"},"name":"Shachar Don-Yehyia","status":"claimed_verified","statusLastChangedAt":"2024-01-26T10:16:09.060Z","hidden":false},{"_id":"65b31aa18627e4cca3199745","user":{"_id":"654a153ef39b362cffa91eac","avatarUrl":"/avatars/6e8940c6c8e13e78a31cecf140b185ab.svg","isPro":false,"fullname":"Dafna Sheinwald","user":"dafnashein","type":"user"},"name":"Dafna Sheinwald","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:53:57.470Z","hidden":false},{"_id":"65b31aa18627e4cca3199746","user":{"_id":"6415ebd2107962562e9a0712","avatarUrl":"/avatars/dfd2e6d42c6110bb64b6a73c96eeb3f3.svg","isPro":false,"fullname":"Ariel Gera","user":"arielgera","type":"user"},"name":"Ariel Gera","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:54:04.079Z","hidden":false},{"_id":"65b31aa18627e4cca3199747","user":{"_id":"61bf40824b4300d0fb0acf59","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1644224872623-61bf40824b4300d0fb0acf59.jpeg","isPro":false,"fullname":"Leshem Choshen","user":"borgr","type":"user"},"name":"Leshem Choshen","status":"admin_assigned","statusLastChangedAt":"2024-01-26T09:54:09.866Z","hidden":false},{"_id":"65b31aa18627e4cca3199748","name":"Michal Shmueli-Scheuer","hidden":false},{"_id":"65b31aa18627e4cca3199749","name":"Yoav Katz","hidden":false}],"publishedAt":"2024-01-25T08:57:33.000Z","submittedOnDailyAt":"2024-01-26T00:06:18.522Z","title":"Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation\n for Generative AI","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"In the dynamic landscape of generative NLP, traditional text processing\npipelines limit research flexibility and reproducibility, as they are tailored\nto specific dataset, task, and model combinations. The escalating complexity,\ninvolving system prompts, model-specific formats, instructions, and more, calls\nfor a shift to a structured, modular, and customizable solution. Addressing\nthis need, we present Unitxt, an innovative library for customizable textual\ndata preparation and evaluation tailored to generative language models. Unitxt\nnatively integrates with common libraries like HuggingFace and LM-eval-harness\nand deconstructs processing flows into modular components, enabling easy\ncustomization and sharing between practitioners. These components encompass\nmodel-specific formats, task prompts, and many other comprehensive dataset\nprocessing definitions. The Unitxt-Catalog centralizes these components,\nfostering collaboration and exploration in modern textual data workflows.\nBeyond being a tool, Unitxt is a community-driven platform, empowering users to\nbuild, share, and advance their pipelines collaboratively. Join the Unitxt\ncommunity at https://github.com/IBM/unitxt!","upvotes":23,"discussionId":"65b31aa28627e4cca3199782","githubRepo":"https://github.com/ibm/unitxt","githubRepoAddedBy":"auto","ai_summary":"Unitxt is a modular and customizable library for preparing and evaluating textual data for generative language models, promoting collaboration and flexibility in the field.","ai_keywords":["generative NLP","HuggingFace","LM-eval-harness","model-specific formats","task prompts","dataset processing","Unitxt-Catalog"],"githubStars":212},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"635964636a61954080850e1d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/635964636a61954080850e1d/0bfExuDTrHTtm8c-40cDM.png","isPro":false,"fullname":"William Lamkin","user":"phanes","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"6323dc9833a1e1cf9df62500","avatarUrl":"/avatars/043bf8c361d17c3466ecf7a5e0d039c3.svg","isPro":false,"fullname":"tianbao li","user":"bobby20180331","type":"user"},{"_id":"632c10964a4991e7114fb9f6","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/632c10964a4991e7114fb9f6/zXk45_ZZgRbeaP4NwZmM-.jpeg","isPro":false,"fullname":"Ares","user":"CairoWang","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"652e3800f7431c19a99c91e9","avatarUrl":"/avatars/df1c1d66e52b06af4dbe5791c4819782.svg","isPro":false,"fullname":"Shachar Don-Yehiya","user":"shachar-don","type":"user"},{"_id":"644e1b1d9b4e87c31bab0a14","avatarUrl":"/avatars/88bb4c4a67dc8958069e9014f5e73a0b.svg","isPro":false,"fullname":"Michael Barry","user":"MichaelBarryUK","type":"user"},{"_id":"6303e34ed14428368d192f45","avatarUrl":"/avatars/f02b5b457f818e87b3ab8c1341b12062.svg","isPro":true,"fullname":"Clayface","user":"ClayFace","type":"user"},{"_id":"60fb1eed088b0554c7d7d83c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60fb1eed088b0554c7d7d83c/ct9OqqW4rNNDl19R7grA7.png","isPro":false,"fullname":"nanowell","user":"nanowell","type":"user"},{"_id":"6555125a4f361968f0e3aad7","avatarUrl":"/avatars/e7692d82804338f21ecdc6e731f5c5ea.svg","isPro":false,"fullname":"marinaretikof","user":"marinaretik","type":"user"},{"_id":"63470b9f3ea42ee2cb4f3279","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/Xv8-IxM4GYM91IUOkRnCG.png","isPro":false,"fullname":"NG","user":"SirRa1zel","type":"user"},{"_id":"60e0645812bf2e2774a884a7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1625319078702-60e0645812bf2e2774a884a7.jpeg","isPro":false,"fullname":"Hisham S. Shihab","user":"hishamshihab","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":0}">

Papers

arxiv:2401.14019

Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation for Generative AI

Published on Jan 25, 2024

· Submitted by

AK on Jan 26, 2024

Upvote

Authors:

Elron Bandel ,

Yotam Perlitz ,

Elad Venezian ,

Ofir Arviv ,

Matan Orbach ,

Shachar Don-Yehyia ,

Dafna Sheinwald ,

Ariel Gera ,

Leshem Choshen ,

Abstract

Unitxt is a modular and customizable library for preparing and evaluating textual data for generative language models, promoting collaboration and flexibility in the field.

AI-generated summary

In the dynamic landscape of generative NLP, traditional text processing pipelines limit research flexibility and reproducibility, as they are tailored to specific dataset, task, and model combinations. The escalating complexity, involving system prompts, model-specific formats, instructions, and more, calls for a shift to a structured, modular, and customizable solution. Addressing this need, we present Unitxt, an innovative library for customizable textual data preparation and evaluation tailored to generative language models. Unitxt natively integrates with common libraries like HuggingFace and LM-eval-harness and deconstructs processing flows into modular components, enabling easy customization and sharing between practitioners. These components encompass model-specific formats, task prompts, and many other comprehensive dataset processing definitions. The Unitxt-Catalog centralizes these components, fostering collaboration and exploration in modern textual data workflows. Beyond being a tool, Unitxt is a community-driven platform, empowering users to build, share, and advance their pipelines collaboratively. Join the Unitxt community at https://github.com/IBM/unitxt!