Singularity

This is an automated archive.

The original was posted on /r/singularity by /u/EcstaticVenom on 2024-01-23 20:45:12+00:00.

What models would you create if creating a fine-tune was easy?

If you could generate a high quality dataset of any kind, what dataset would you generate to finetune your model?

I’m trying to understand if we have a lack of data problem and hence there aren’t any domain/topic/character specific fine-tunes or if it’s more of a “we have good enough generic models and those fine-tunes aren’t necessary/too specific” thing.

Would love thoughts and opinions. Also as foundation models continue to get better, will our need of fine tuning disappear?