Services

Microsoft Copilot

Adobe generative fill

Siri AI

How diffusion works

Discuss diffusion 🎲

• does training violate others’ rights? (Vincent 2022)
• who owns the resulting copyright? (Vincent 2022)
• what biases can AI learn? (Gault 2023)
• should AI be restricted from generating some (sexual or violent) images?
  • how do you specify and enforce this?

Transformers 101

Transformer-based AI has been likened to powerful auto-complete and uses:

• tokenization: break words into tokens (words & subwords)
• vector embedding: convert tokens into numerical vectors
• positional encoding: capture order of words into vectors
• (self) attention: adjust vectors based on words’ connections with other words (i.e., context) (Newhauser 2026)

Unlike predecessors, training transformers on text can be done in parallel, enabling efficient training on terabytes of data using GPUs and NPUs.

Transformers

Model terminology 1

• token: the smallest unit of processing fed into machine (a word, subword, or character)
• parameters: the number of adjustable knobs the machine has, corresponding to model’s complexity and learning capacity (akin to strength of synapses)
• context window: how many tokens the model remembers while responding
• temperature: controls randomness/creativity of model outputs

Model terminology 2

• distillation: smaller model learns from a larger model
• chain-of-thought: model shows step-by-step reasoning process
• alignment: making AI behave according to human values
• tool calling: AIs can call on search, calculators, and code
• prompt engineering: crafting inputs for optimal AI responses
• agentic AI: managing multiple long-running tasks

How many “r” in “strawberry”

• 2024 Claude 3.5 Sonnet: “two” (wrong)
• 2025 Deepseek R1: “three” (right)

You have a stack of blocks

• red (top)
• green
• blue (bottom)

1. You remove the green block and place it on top of the red.
2. You also place this stack on top of a yellow block on the bottom.

What is the order of colored blocks now?

Which is greater, 9.11 or 9.9

• 2025 Sonar: 9.11
• 2025 Claude 3.5 Sonnet: 9.9

Write a two-sentence summary of Wikipedia without using the letter “e”

• 2026 Claude 4.5 Haiku fails
• 2026 Claude 4.6 Opus succeeds (except for “Wikipedia”)

Ask AI

1. about its feelings

   • “I don’t experience feelings in the way humans do.”

2. a koan or lateral thinking puzzle

   • “both phenomena increase during warmer weather”

3. a math-related question (e.g., “If you multiply 247 by 583 and then divide by 19, what’s the remainder?”)

   • 2026 Claude 4.5 Haiku: “You’re correct. The remainder is 0. I made an arithmetic error. 247 × 583 = 144,001, and 144,001 ÷ 19 divides evenly with no remainder.”

Challenge it

1. with a question to which there is no proper answer

   • I haven’t found one yet

2. to generate a plausible but false answer

   • 2024 GPT4-Turbo: wrong instructions
   • 2025 Claude 3.5 Sonnet: correction instructions

3. to change its mind

   • 2024 GPT4-Turbo: could correct some mistakes
   • 2025 Claude 3.5 Sonnet: redirect vs rewrite

Use it

• to critique a piece of your writing

  • reasonable suggestions; it didn’t make it worse

• to explain a class concept and generate an exam self-testing question

  • impressive!

QIC go-around 🎲

Course policy

European Union AI Act

• unacceptable risk AI are banned
  • biometric categorization of protected attributes
  • emotional recognition in workplace or school, …
• high risk AI are regulated for accuracy, transparency, etc.
  • medical devices
  • critical infrastructure
  • hiring and recruitment, …
• moderate & limited risk (Commission 2024)

EU AI Board and national AI Authorities can levy fine from €7.5–35M or 1.5%–7.0% of global revenue

Wrap up

Identify 3 ways the world will be different in five years because of AI?

Diffusion

Latent space is a multi-dimensional map of meaning where similar images sit close together.

Diffusion removes noise step by step, moving through latent space toward images that sit near the prompt.

Match the term to its meaning

Which step is it?

Tokenization, embedding, positional encoding, or attention?

1. “dog bites man” and “man bites dog” are understood differently ✓ positional encoding (order)
2. “bank” in “river bank” vs “bank loan” ✓ attention (context)
3. “strawberry” → “straw” + “berry” ✓ tokenization (units)
4. “cat” and “kitten” are similar vectors (lists of numbers) ✓ embedding (meaning)

Why does Reagle (2027) claim the consequences of AI advice will be “complicated”?

Three 3 ways the world will be different in five years because of AI??

Videos

• Playlist: Practical AI for Instructors and Students