arXiv:2606. 18636v1 Announce Type: cross Abstract: Recent advancements in Large Language Models (LLMs) have empowered home assistants with natural language interaction capabilities.
By Yingyu Shan, Zeming Liu, Silin Li, Boao Qian, Jiashu Yao, Yuhang Guo, Haifeng Wang
arXiv:2607. 18034v1 Announce Type: new Abstract: Smart home assistants interpret a wide range of user commands, from explicit device control to underspecified and preference dependent requests.
By Eu Jin Lim, Zhaoxing Li, Sebastian Stein
arXiv:2606. 01912v1 Announce Type: new Abstract: Smart homes are evolving toward complex state-dependent living environments, requiring Large Language Models (LLMs) to reason over user intent, preferences, and multi-device interactions.
By Kuan Li, Shuo Zhang, Huacan Wang, Fangzhou Yu, Zecheng Sheng, Yi Gu, Weipeng Ming, Lei Xue, Chen Liu, Sen Hu, Ronghao Chen, Siyue Lin, Yuqing Hou, Xiaofeng Mou, Yi Xu
arXiv:2606. 01099v1 Announce Type: cross Abstract: Command understanding systems in smart home ecosystems can automate device control and substantially improve user experience.
By Haowei Han, Kexin Hu, Weiwei Cai, Debiao Zhang, Bin Qin, Yuxiang Wang, Jiawei Jiang, Xiao Yan, Bo Du
arXiv:2606. 01230v1 Announce Type: new Abstract: Large language model agents are moving beyond text-only interaction toward physical-world control, with smart homes as a representative domain.
By Yi Gu, Huacan Wang, Shuo Zhang, Yuqing Hou, Lei Xue, Weipeng Ming, Chen Liu, Fangzhou Yu, Kuan Li, Ronghao Chen, Sen Hu, Xiaofeng Mou, Yi Xu
arXiv:2602. 15707v2 Announce Type: replace-cross Abstract: Real-time conversational assistants for procedural manual tasks often depend on video input, which can be computationally expensive and compromise user privacy.
By Rehana Mahfuz, Yinyi Guo, Erik Visser, Phanidhar Chinchili
arXiv:2608. 02254v2 Announce Type: replace Abstract: \texttt{Homebot} is a locally deployable AI agent for conversational household assistance and automation.
By Shengyuan Ye, Yixin Zhang, Han Liang, Liekang Zeng, Jiangsu Du, Mu Yuan
The paper introduces FISER, a framework that explicitly infers human goals and intentions before planning actions for AI agents to follow natural language instructions in collaborative embodied tasks. It employs Transformer-based models and is evaluated on the HandMeThat benchmark, outperforming end-to-end approaches and strong baselines such as Chain of Thought prompting. FISER achieves state‑of‑the‑art performance on this embodied social reasoning task.
By Yanming Wan, Yue Wu, Yiping Wang, Jiayuan Mao, Natasha Jaques
arXiv:2606. 18847v1 Announce Type: new Abstract: To assist humans over extended periods in real homes, embodied agents must remember user routines, world states, and past interactions.
By Yehang Zhang, Jianchong Su, Haojian Huang, Yifan Chang, Tianhao Zhou, Xinli Xu, Yingjie Xu, Yinchuan Li, Zexi Li, Ying-Cong Chen
The paper introduces an LLM chaining architecture for General Purpose Service Robots that splits instruction classification and action generation into two stages, cutting prompt length by about 45% and boosting planning consistency. Evaluation on 100 synthetic GPSR commands across three language models shows consistent improvements over single-prompt methods, with up to +37 percentage points gain on local models. Real‑robot trials on the Toyota HSR confirm that while planning success improves, execution-layer failures remain the main obstacle to full task completion.
By Lucas Da Mota Bruno, Jiahao Sim, Yoshinobu Hagiwara
arXiv:2607. 21180v1 Announce Type: new Abstract: Recent advances have introduced speech-to-speech (S2S) conversational assistants capable of producing natural-sounding interactions, including non-verbal cues like tonality and mood.
By Gregor Endler, Sebastian Kraus, Lukas Stappen
arXiv:2608. 10692v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed as mobile assistants, where a key challenge is leveraging personal information scattered across multiple applications (apps) to complete user instructions.
By Junjie Ye, Zhuohui Sheng, Shaofan Liu, Yulun Zhu, Wenjie Fu, Dingwei Zhu, Ming Zhang, Yujiong Shen, Weichao Wang, Xin Zhao, Shihan Dou, Tao Gui, Qi Zhang, Xuanjing Huang, Pluto Zhou