Fine Tuning

Scale.ai creates fine tuning documents to use

Models

Model Score

• ELO scoring (same as chess)

Scaling

• Scaling directly influences capability of a model
• Why companies spend a lot of money training more data

Interpretability

Understanding what each parts of the LLM stack do.

• we are currently limited in what is actually going on in each step.

Hallucination

Compression leads to “dreaming” of answer

• document generation to feed in as new data is not helpful

Large quantity/Low quality

Current Developments (as of 2024)

System 2 = long running LLM thinking capability

• e.g.AlphaGo
  • started by imitating best players
  • then achieved self-improvements