Edge Devices and LLMs: What's Ahead for AI

OnTrack: The PCB Design Podcast

In this episode of the Altium OnTrack podcast, host Tech Consultant Zach Peterson explores the fascinating world of Edge AI and how Large Language Models (LLMs) fit into the picture with Jan Jongboom, co-founder of Edge Impulse. The two discuss the evolution from GPT-2 to GPT-4, the importance of edge computing, and the hardware requirements for running AI on edge devices. Discover how reducing the size of LLMs enables efficient deployment on edge devices, gain insights into the practical applications of AI in various industries, and learn about EDGE IMPULSE.

More resources:

• Getting started w/ Edge Impulse on Renesas platforms
• Connect with Jan on LinkedIn
• Learn more about Edge Impulse
• Check out a recent video from Edge Impulse: Using GPT-4o to train a 2,000,000x smaller model (that runs directly on device)
• Exclusive 15 Days Free Altium Designer Access