logo

Mystery AI Hype Theater 3k, Episode 7 - There Are Now 15 Competing Evaluation Metrics (feat. Jeremy Kahn)

time3 yr agoview218 views

Emily and Alex are joined this week by Dr. Jeremy G. Kahn to discuss evaluation metrics and some new AI hell.

Jeremy G. Kahn has a PhD in computational linguistics, with a focus on information-theoretic and empirical engineering approaches to dealing with natural language (in text and speech). He’s gregarious, polyglot, a semi-auto-didact, and occasionally prolix. He also likes comic books, coffee, progressive politics, information theory, lateral thinking, science fiction, science fact, linear thinking, bicycles, beer, meditation, love, play, and inquiry. He lives in Seattle with his wife Dorothy and son Elliott.

Listen to this episode in podcast form: https://www.buzzsprout.com/2126417/episodes/13283050

References: XKCD: Standards https://xkcd.com/927/

WikidataCon https://www.wikidata.org/wiki/Wikidata:WikidataCon_2021

Gish Gallop: https://en.wikipedia.org/wiki/Gish_gallop

The Bender Rule: https://thegradient.pub/the-benderrule-on-naming-the-languages-we-study-and-why-it-matters/

DJ Khaled - You Played Yourself: https://knowyourmeme.com/memes/congratulations-you-played-yourself

Jeff Kao's interrogation of public comment periods: https://hackernoon.com/more-than-a-million-pro-repeal-net-neutrality-comments-were-likely-faked-e9f0e3ed36a6

Emily's blog post response to NYT piece: https://medium.com/@emilymenonbender/on-nyt-magazine-on-ai-resist-the-urge-to-be-impressed-3d92fd9a0edd

Follow Jeremy: https://dair-community.social/@trochee/

You can check out future streams at https://twitch.tv/KateSilver538.

Follow Emily at https://twitter.com/EmilyMBender and https://dair-community.social/@EmilyMBender Follow Alex at https://twitter.com/alexhanna and https://dair-community.social/@alex

Loading comments...