Recent Questions - Artificial Intelligence Stack Exchange 09月29日
GPT-3微调挑战与GPT-Neo解决方案
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

本文探讨如何微调GPT-3,并介绍了如何修改数据集以适应GPT-Neo微调。

I'm new to AI and machine learning.

To fine-tune GPT-3, I understand that we need a set of training examples that each consist of a single input ("prompt") and its associated output ("completion").

I have prepared a dataset with "prompt" and "completion". And I expect that a fine-tuned model would return the corresponding completion after receiving a prompt in my dataset. But due to some reason, I cannot fine-tune GPT-3 at the moment.

So I plan to fine-tune GPT-Neo (or GPT-J or GPT-NeoX). From this video and this video, it seems that they only accept a dataset containing only "prompt".

Does anyone know how I could modify my dataset with "prompt" and "completion" such that it could be used to fine-tune GPT-Neo?

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

GPT-3 微调 数据集 GPT-Neo 机器学习
相关文章