Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2024-04-13T01:15:17.401Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":318,"isUserFollowing":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7563977837562561},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[{"reaction":"👍","users":["agi-css"],"count":1}],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2404.07503","authors":[{"_id":"66189d4397f7e11bd9aa9078","user":{"_id":"5e91f1554957053f606489ff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg","isPro":false,"fullname":"Ruibo Liu","user":"agi-css","type":"user"},"name":"Ruibo Liu","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:14:06.003Z","hidden":false},{"_id":"66189d4397f7e11bd9aa9079","user":{"_id":"60db3b451f1eec955a46d065","avatarUrl":"/avatars/10bd161ba6b56717feba9fbf539db4ea.svg","isPro":false,"fullname":"Jerry Wei","user":"jerrywei","type":"user"},"name":"Jerry Wei","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:14:23.616Z","hidden":false},{"_id":"66189d4397f7e11bd9aa907a","user":{"_id":"5f881856ee5616341bc51e67","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5f881856ee5616341bc51e67/9UCZCuhBTpJC9tGPyGmMb.jpeg","isPro":false,"fullname":"Fangyu Liu","user":"fl399","type":"user"},"name":"Fangyu Liu","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:14:46.219Z","hidden":false},{"_id":"66189d4397f7e11bd9aa907b","user":{"_id":"6144c0aa8a3e54bb3ecef8ea","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1631895645405-noauth.jpeg","isPro":false,"fullname":"Chenglei Si","user":"CLS","type":"user"},"name":"Chenglei Si","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:15:13.056Z","hidden":false},{"_id":"66189d4397f7e11bd9aa907c","user":{"_id":"61362307df63bbd1c2459c4c","avatarUrl":"/avatars/28d3ba4b0fa00acb1eed623ab3620789.svg","isPro":true,"fullname":"Yanzhe Zhang","user":"zyanzhe","type":"user"},"name":"Yanzhe Zhang","status":"claimed_verified","statusLastChangedAt":"2024-04-22T06:54:33.133Z","hidden":false},{"_id":"66189d4397f7e11bd9aa907d","user":{"_id":"64b7864417570fdff9b952d6","avatarUrl":"/avatars/bdd71419bd27f4d5ec4ec99f4cb22aea.svg","isPro":false,"fullname":"Jinmeng Rao","user":"JinmengRao","type":"user"},"name":"Jinmeng Rao","status":"claimed_verified","statusLastChangedAt":"2024-05-20T07:39:09.750Z","hidden":false},{"_id":"66189d4397f7e11bd9aa907e","name":"Steven Zheng","hidden":false},{"_id":"66189d4397f7e11bd9aa907f","name":"Daiyi Peng","hidden":false},{"_id":"66189d4397f7e11bd9aa9080","name":"Diyi Yang","hidden":false},{"_id":"66189d4397f7e11bd9aa9081","user":{"_id":"65d4d62d493aeaf0bb295f1b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/vXMxaoWwFziul8TqIhQw8.jpeg","isPro":false,"fullname":"Denny Zhou","user":"dennyzhou","type":"user"},"name":"Denny Zhou","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:16:38.955Z","hidden":false},{"_id":"66189d4397f7e11bd9aa9082","user":{"_id":"64c04c0b5e03515457ed72a3","avatarUrl":"/avatars/dcbfca63b32a8d5c575232316c01dbe7.svg","isPro":false,"fullname":"Andrew Dai","user":"PenguinPush","type":"user"},"name":"Andrew M. Dai","status":"admin_assigned","statusLastChangedAt":"2024-04-18T12:17:06.429Z","hidden":false}],"publishedAt":"2024-04-11T06:34:17.000Z","submittedOnDailyAt":"2024-04-12T01:02:36.986Z","title":"Best Practices and Lessons Learned on Synthetic Data for Language Models","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"The success of AI models relies on the availability of large, diverse, and\nhigh-quality datasets, which can be challenging to obtain due to data scarcity,\nprivacy concerns, and high costs. Synthetic data has emerged as a promising\nsolution by generating artificial data that mimics real-world patterns. This\npaper provides an overview of synthetic data research, discussing its\napplications, challenges, and future directions. We present empirical evidence\nfrom prior art to demonstrate its effectiveness and highlight the importance of\nensuring its factuality, fidelity, and unbiasedness. We emphasize the need for\nresponsible use of synthetic data to build more powerful, inclusive, and\ntrustworthy language models.","upvotes":31,"discussionId":"66189d4497f7e11bd9aa90f2"},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"6329ab0bde18e8b2d96157ff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6329ab0bde18e8b2d96157ff/alQVvAaeb0zh54b4XGVIK.png","isPro":false,"fullname":"Evan","user":"evdcush","type":"user"},{"_id":"63a7422854f1d0225b075bfc","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63a7422854f1d0225b075bfc/XGYAcDPZG5ZEsNBWG6guw.jpeg","isPro":true,"fullname":"lhl","user":"leonardlin","type":"user"},{"_id":"637f0eb22438d7485b8ef5d7","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/637f0eb22438d7485b8ef5d7/70h7dekqj7LuBobOXckmJ.jpeg","isPro":false,"fullname":"Ming Li","user":"limingcv","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"5e91f1554957053f606489ff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg","isPro":false,"fullname":"Ruibo Liu","user":"agi-css","type":"user"},{"_id":"63869d1e81fe8c678a3a9422","avatarUrl":"/avatars/3bb8728057fa2ba0e24f5ceb1600068d.svg","isPro":true,"fullname":"Zach Mustafa","user":"Zmu","type":"user"},{"_id":"655ac762cb17ec19ef82719b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/655ac762cb17ec19ef82719b/1kDncYrGLYS_2SR8cNdAL.png","isPro":false,"fullname":"Welcome to matlok","user":"matlok","type":"user"},{"_id":"6254f8e5d21e4cc386b881ad","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1649899774659-6254f8e5d21e4cc386b881ad.jpeg","isPro":false,"fullname":"Somshubra Majumdar","user":"smajumdar94","type":"user"},{"_id":"62a781d9dbb9e288665ce943","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/62a781d9dbb9e288665ce943/IfWhxSi-Xbmzf_BeNb6cq.png","isPro":false,"fullname":"Saied Alshahrani","user":"SaiedAlshahrani","type":"user"},{"_id":"60c8d264224e250fb0178f77","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60c8d264224e250fb0178f77/i8fbkBVcoFeJRmkQ9kYAE.png","isPro":false,"fullname":"Adam Lee","user":"Abecid","type":"user"},{"_id":"648eb1eb59c4e5c87dc116e0","avatarUrl":"/avatars/c636cea39c2c0937f01398c94ead5dad.svg","isPro":false,"fullname":"fdsqefsgergd","user":"T-representer","type":"user"},{"_id":"5f0504c25d08220171a0ad6c","avatarUrl":"/avatars/e9ed1eafd796364701039c3e76e9865f.svg","isPro":false,"fullname":"vingovan","user":"vingovan","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":0}">

Papers

arxiv:2404.07503

Best Practices and Lessons Learned on Synthetic Data for Language Models

Published on Apr 11, 2024

· Submitted by

AK on Apr 12, 2024

Upvote

Authors:

Ruibo Liu ,

Jerry Wei ,

Fangyu Liu ,

Chenglei Si ,

Yanzhe Zhang ,

Jinmeng Rao ,

Denny Zhou ,

Andrew M. Dai

Abstract

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution by generating artificial data that mimics real-world patterns. This paper provides an overview of synthetic data research, discussing its applications, challenges, and future directions. We present empirical evidence from prior art to demonstrate its effectiveness and highlight the importance of ensuring its factuality, fidelity, and unbiasedness. We emphasize the need for responsible use of synthetic data to build more powerful, inclusive, and trustworthy language models.

View arXiv page View PDF Add to collection