Let's Talk ChatGPT
CE271 Guest Lecture
AI Progress
What really is ChatGPT?
- ChatGPT is a natural language processing tool driven by generative AI technology that allows you to have human-like conversations and much more with the chatbot.
- The language model can answer questions and assist you with tasks, such as composing emails, essays, and writing/editing code.
Welcome message...by ChatGPT
Welcome to CE271! 👷♀️🌎I’m ChatGPT — your AI co-pilot for all things civil and environmental.
I don’t do concrete pours, but I do explain why your bridge isn’t standing.
Let’s build something great (and structurally sound) together!
Let the learning — and occasionally questioning your life choices — begin!
How does it work?
What is the guessing game?
- Shannon's Game: guess the next letter
- S______
- Sp_____
- Spa____
- Spar___
- Sparta__
- Spartan_
- Spartans
What do you need to know to win the guessing game?
Michigan State University is located in _____, Michigan.
Answer: trivia
What do you need to know to win the guessing game?
I put _____ fork down on the table.
Answer: syntax
What do you need to know to win the guessing game?
The woman walked across the street, checking for traffic over ___ shoulder.
Answer: coreference
What do you need to know to win the guessing game?
I went to the ocean to see the fish, turtles, seals, and _____.
Answer: lexical semantics/topic
What do you need to know to win the guessing game?
Overall, the value I got from the two hours watching it was the sum total of the popcorn and the drink. The movie was ___.
Answer: sentiment
What do you need to know to win the guessing game?
Iroh went into the kitchen to make some tea. Standing next to Iroh, Zuko pondered his destiny. Zuko left the ______.
Answer: some reasoning - this is harder
What do you need to know to win the guessing game?
I was thinking about the sequence that goes 1, 1, 2, 3, 5, 8, 13, 21, ____
Answer: some basic arithmetic; they don't learn the Fibonnaci sequence
ChatGPT Overview
Step 1: Large Language Model
- Trained on copious amounts of textual data: gleaned from internet text, wikipedia, books, articles, websites, and other publicly available textual information.
- So, it is learning from historically available data.
- The training data is extensive and covers a wide array of topics and writing styles to make the model versatile in its responses.
Initial Language Model: GPT Overview
Initial Language Model: GPT Training Process
Initial Language Model: GPT Language Generation
How much data are ChatBots trained with?
How much compute are ChatBots trained with?
Step 2: Aligning ChatGPT with Human Values
- To ensure responses are safe, acceptable, and unbiased, we use Human Feedback
- Human AI trainers generate conversations and also rank multiple response of the model for quality and appropriateness.
Training ChatGPT with Human Feedback
Training ChatGPT Reward Model
Chatbot Development
How useful is current ChatGPT?
Ghost of the Internet
- If you ask the internet for the answer to a question on the best forum available and get an answer, it might be in the ballpark of as useful and as correct as that which GPT4 provides notably, in seconds.
- There are pluses and minuses:
- Super human for tasks like text summarization and style.
- Solid performance for commonly discussed content.
- Sketchy for less commonly discussed content.
- Probably should not fully trust its math, reasoning and logic.
- Driving a car is out of the question, since it cannot be described.
The dark art of "prompt engineering"
The dark art of "prompt engineering"
Example: Stereotype in LLM-Generated Reference Letter
LLMs manifest the stereotype of men being agentic (e.g., natural leader) and women being communal (e.g., well-liked member).
Example: Gender Stereotype in LLMs
Bias and Stereotype in Generative AI
Stereotype in Female Professions
Skin color stereotype for occupation
AI Exacerbates Societal Bias
Feb. 09, 2018
- Boulamwini and Gebru, "Gender Shades:Intersectional Accuracy Disparities in Commercial Gender Classification," FAT 2018
July 04, 2023
October 10, 2023
What to watch out for?
- Misinformation and inaccuracies
- Today's chat bots cannot consider the truth of the text they generate.
- Bias and unintentional harm. Inappropriate content
- Today's chat bots absorb the worldview and biases of their human creators.
- Divulging proprietary information
- Lack of proper citations. Source of information.
- Utilizing copyrighted material.
Inspiration or Plagiarism?
How to access Chatbots?
Q & A
