SparkAI logoSparkAI

Chinese videos › C1

【一席】吴翼:我们在训练AI的时候,目标都是简单的、明确的,但是人类的真实目标总是含糊的,不确定的。

Wu Yi, a former OpenAI researcher now at Tsinghua, explains AI's problems from the inside. He covers adversarial examples, bias and over-confidence, and why models learn correlation rather than causation and so hallucinate. He shows how reinforcement learning can teach a model to say 'I don't know', and explains the alignment problem.

C129:23一席YiXiFor Chinese speakersChinese captions by the creator

Some English technical terms; mentions a racist image-labelling error and makes a dark joke about a robot and the family cat.

Key words

ChineseEnglish
对抗样本 (duìkàng yàngběn) adversarial example
偏见 (piānjiàn) bias, prejudice
过度自信 (guòdù zìxìn) over-confidence
相关性 (xiāngguānxìng) correlation
因果性 (yīnguǒxìng) causality
幻觉 (huànjué) hallucination
强化学习 (qiánghuà xuéxí) reinforcement learning
奖励 (jiǎnglì) reward
对齐 (duìqí) alignment
价值观 (jiàzhíguān) values

Did you understand?

  1. GPT-4玩石头剪刀布时为什么特别喜欢出石头?

  2. 用强化学习训练时,怎样让大模型学会说“不知道”?

  3. 机器人保姆的故事说明了什么问题?

Why it's C1

More C1 videos