Building skAi, The Ultimate Goal Oriented Smart Home Concierge AI Powered by Multi-Modal LLM Agent

As a follow up, we embarked on a week-long experiment living with the AI as a nanny, learning assistant, baby feeding notifier, and home entertainer.

Agustinus Nalwan
29 min readMay 7, 2024
skAi — Smart Koncierge Artificial Intelligence

Problems

As time sprints ahead, we find ourselves barely keeping pace. Between managing our careers, shuttling our curious five-year-old son Dexie to and from various classes, and satisfying his endless barrage of questions, our days are packed to the brim. We must also vigilantly monitor his screen habits, ensuring he doesn’t spend too long on TV or sit too close to it. Adding to our bustling household with grandparents, each bringing their own dynamics but thankfully not adding to household friction. My mother-in-law excels as our resident chef, while my father in-laws chip in with school runs for Dexie. However, organisation is not everyone’s forte, which leaves my wife, Yumi, and me in the role of the family’s de facto project managers. We find ourselves constantly coordinating everyday tasks, from packing Dexie’s lunch to starting meals on time — missteps in which can disrupt his sleep or make him late for school. Amidst these responsibilities, we must also ensure Dexie keeps up with his piano…

--

--