Web AI libraries and models crossed over 1 billion downloads in the last 2 years alone. If you're not yet using machine learning on the client side, now is the time to see what's possible and the benefits it can bring your business over cloud based solutions - such as lower costs, privacy for your end users, and low latency responses suitable for real-time applications.

Learn what's new with the state of Web AI at Google and discover new generative AI models you can run client-side in the browser entirely offline along with key updates from Chrome, TensorFlow.js, MediaPipe, Core ML, Visual Blocks, and beyond.

A must see talk for anyone working in the web space (or is using JavaScript) so you can bring your AI powered ideas to life faster than ever before.

Powerful generative AI features are quickly becoming a baseline in modern development. Potential blockers include privacy concerns, the need for a stable connection, and the costs associated with using or hosting models. However, we can now leverage generative AI directly in the browser on the user's device using emerging Web APIs like WebNN, combined with higher-level frameworks, for a better developer experience. In my session, I’ll discuss the current state of in-browser ML and AI features, compare the main players, and show you how to start building an offline-ready, future-proof, standards-based web application.

AI progress is running away on the server-side, where the GPUs live, but the web platform is never that far behind. In this talk we're going to explore the incredible applications you can build in the browser today and in the near future.

You'll see how to build an offline-capable, speech to speech language translation app, a babelfish, using nothing but the web platform. Through this app we'll explore the different ways we can run AI models in the browser today and what may be built into the browser in the future. From low-level standards to high-level experiments, you'll learn how to work with AI on the web.

Bio: 

Phil is a developer relations engineer for Langflow at IBM and Google Developer Expert living in Melbourne, Australia. He loves working with JavaScript, TypeScript or Ruby to build web applications and tools to help developers. He once helped build a website that captured the world's favourite sandwich fillings. He has too many GitHub repositories.

Away from the keyboard, Phil listens to ska punk, hangs out with his miniature dachshund (also called Ruby), and is on a mission to discover the world's best beers.

Phil tweets at @philnash and you can find him elsewhere online at https://philna.sh.

Performant Architecture for a Fast Gen AI User Experience

More and more developers are being asked to build Generative AI experiences into their web applications everywhere. However, the user's experience with Generative AI can sometimes be slow and frustrating. It’s been years since we would gladly wait over 10 seconds for a response to anything online. As AI processing gets faster, there are new limiting factors that could be negatively affecting your AI user experience.

In this talk, we will cover different ways to minimise laggy experiences in web applications when interacting with third-party Generative AI tools. We’ll be using a practical demonstration to show how you can reduce latency as we build one of my favourite sci fi gadgets, the babel fish.