Apple did what NVIDIA wouldn't - Mac Studio Clustering with Exo

Check out Boot.dev at https://boot.dev/?promo=JAKKUH and use code JAKKUH to get 25% off your first plan! Support me on Patreon! https://jakkuh.com/patreon Apple offered to loan me four top of the line Mac Studio’s with their M3 Ultra chip and a combined 1500GB of Unified Memory to try out Exo 1.0 - the latest advancement in AI software that allows you to split the computation of the BIGGEST large language models out there across multiple systems for a massive speed bump - effectively building an AI super cluster in your home… and one that doesn’t draw much power. Check out Exo on Github: https://jakkuh.com/exo How to enable RDMA on Thunderbolt 5 equipped Macs: https://ml-explore.github.io/mlx/build/html/usage/distributed.html#getting-started-with-jaccl ► Products Featured in this Video! ◄ Buy a Mac Studio M3 Ultra: https://jakkuh.com/iILqr Buy Thunderbolt 5 Cables: https://jakkuh.com/8ddmG Buy a UniFi Pro XG 8 PoE Network Switch: https://jakkuh.com/pro-xg-8 Buy a UniFi Gateway: https://jakkuh.com/unifi-gateways Buy a USB-C Charger: https://jakkuh.com/8S2Yu Buy a MacBook Pro: https://jakkuh.com/2FjTr Purchases made through some store links may provide some compensation to the creator. Framework Desktop 3D Print Optimized Tiles: https://jakkuh.com/KWahn ► GET EXCLUSIVE CONTENT ON MY PATREON: https://jakkuh.com/patreon ► COMPANIES THAT SUPPORT US: https://jakkuh.com/partners ► MY GAMING PC: https://jakkuh.com/gaming-setup ► MY HOMELAB GEAR: https://jakkuh.com/homelab ► MY CAMERA GEAR: https://jakkuh.com/camera-setup My Socials: Instagram: https://instagram.com/jakkuh_t Twitter/X: https://x.com/jakkuh_t