We're still a long ways from this type of robotic technology, but scientists are getting closer. (Image by VesnaArt on Shutterstock)
In A Nutshell
- Chinese researchers have developed a prototype robot that can identify and gently pick up objects like toys, bottles, and stuffed animals in lab tests.
- The robot responds to voice commands, maps indoor spaces, and uses soft inflatable fingers to grasp items, but only lighter objects up to 250 grams have been tested for pickup.
- In quiet environments, speech recognition accuracy ranged from 83.8% to 85%, but dropped to just over 75% with background noise.
- While promising, the robot remains in the prototype phase and hasn’t been tested in real homes, which present far more unpredictable conditions.
SUZHOU, China — Parents drowning in scattered toys, abandoned water bottles, and mysteriously migrating household items might eventually find relief. Researchers in China have built a household robot that can spot objects on floors and gently collect them with soft, inflatable fingers, though only in controlled laboratory settings so far.
The machine responds to voice commands, maps indoor spaces, and can handle everything from delicate items weighing just 10 grams to common household objects weighing over half a pound. During lab tests, it successfully picked up oranges, bottles, teddy bears, and trash bags without crushing or damaging them.
“The robot’s automation capabilities enable it to independently perform various tasks, including object retrieval and interactive entertainment,” researchers from Xi’an Jiaotong-Liverpool University wrote in their study, published in Robot Learn.
How the Robotic Helper Actually Works
The robot moves on three wheels and uses 2D LiDAR, the same laser-scanning technology found in self-driving cars, adapted for indoor navigation. Its standout feature involves a lifting platform that extends nearly 18 inches up and down, allowing the mechanical arm to reach objects on floors, coffee tables, and sofas.
Rather than using rigid metal claws that could hurt children or pets, the robot employs what researchers call a “pneumatic flexible gripper.” This system uses three soft, inflatable fingers controlled by air pressure. When the robot needs to grab something, an air valve opens to inflate the fingers, causing them to gently curl around the object.
The robot’s vision system consists of a depth-sensing camera positioned about nine inches from the ground. This gives it a wide view to spot objects while staying clear of the mechanical arm’s movements. Advanced artificial intelligence processes these images to identify different household items and calculate the best path to reach them.
“The robot can move seamlessly through rooms, avoid obstacles, and reach designated locations on its own,” says co-author Yangzesheng Lu. “This feature is crucial for tasks like picking up toys scattered around the house or fetching items from different rooms.”
Lab Testing Shows Both Promise and Clear Limitations
Researchers tested the robot with eight common household objects: an orange, bowl, bottle, teddy bear, book, umbrella, handbag, and potted plant. The objects ranged from a lightweight 10-gram trash bag to a 2.3-pound potted plant. However, grasping tests focused on lighter items, with the heaviest object successfully picked up being a 250-gram bottle.
Recognition accuracy varied significantly depending on the item and distance. Teddy bears achieved the highest recognition rates across all test distances, while books proved most challenging because they appear different when placed flat versus standing upright. Generally, the robot performed better as it moved closer to objects during actual pickup attempts.
Speech recognition tests involved five people aged 16 to 55, with each participant repeating commands 30 times under different conditions. In quiet environments, the robot’s recognition accuracy ranged from 83.8% to 85%, while performance dropped to just over 75% when background noise was introduced.
Distance measurements proved remarkably accurate, typically within 5 millimeters to 2 centimeters of actual object locations. This precision allowed the mechanical arm to successfully position the gripper for most pickup attempts.
Real Homes Will Present Much Bigger Challenges
All testing occurred in sterile laboratory conditions, not the chaotic reality of family homes. Real houses bring complications that controlled environments cannot replicate: pets darting around, toys wedged under furniture, varying lighting throughout the day, and the general unpredictability of family life.
“Our robot is currently in the prototype stage,” the researchers acknowledged. “Experiments have been conducted primarily in controlled environments, such as laboratories, to ensure accurate evaluation and performance testing.”
The robot faces physical limitations too. It can only navigate through doorways wider than 20 inches. Battery life, maintenance costs, and durability remain unaddressed, though the complex array of sensors and mechanical components would likely require regular upkeep and carry a premium price tag.
Speech recognition performance in noisy environments poses another hurdle. Homes filled with television sounds, conversations, or children playing could severely limit the robot’s ability to understand commands when families need help most.
When Might Robot Helpers Reach Your Home?
Despite current limitations, the research marks meaningful progress toward practical household robots. Most existing home robots focus on single tasks like vacuuming or lawn mowing. A general-purpose machine capable of object collection and sorting represents a notable advance.
Researchers plan to integrate large language models similar to ChatGPT into the speech system, potentially allowing more natural conversations and complex instructions beyond simple commands like “pick up the toy.”
“We are excited about the potential applications of this robot in everyday life,” says co-author Dr. Qinglei Bu. “Future work will focus on enhancing the robot’s object detection accuracy and integrating large language models to improve its semantic understanding capabilities.”
Families hoping for immediate relief from household cleanup duties face a lengthy wait. The journey from controlled laboratory demonstrations to products ready for real homes typically spans several years of additional development, safety testing, and cost reduction. For now, teaching children to clean up after themselves remains the most reliable household automation available.
Paper Summary
Methodology
Researchers designed a household robot with six main components: a depth camera, digital display, robotic arm, flexible pneumatic gripper, lifting platform, and three-wheeled mobile base. The robot uses YOLOv11 artificial intelligence algorithms to identify objects through a depth camera, 2D LiDAR for navigation and mapping, and a speech recognition system for voice commands. Testing involved eight household objects of varying sizes and weights, with object detection evaluated at distances of 0.6, 0.8, and 1 meter. Speech recognition was tested with five participants aged 16-55 who repeated commands 30 times each under quiet and noisy conditions.
Results
The robot successfully detected and grasped objects ranging from 10 grams to over 1,000 grams, with measurement accuracy within 5 millimeters to 2 centimeters. YOLOv11 outperformed the previous YOLOv8 algorithm across most test scenarios. Speech recognition achieved 83.8% accuracy in quiet environments and 75% in noisy conditions. The teddy bear showed the highest object recognition accuracy, while books proved most challenging due to varying orientations. Recognition accuracy generally decreased with distance but improved as the robot approached objects during collection attempts.
Limitations
All testing occurred in controlled laboratory environments rather than real homes, representing a major limitation for practical applications. The robot is still in prototype stage with acknowledged gaps before mass production viability. Speech recognition performance drops notably in noisy environments, potentially limiting usefulness in typical household settings. The system can only handle objects within specific size and weight ranges and requires doorways wider than 20 inches for navigation. Long-term durability, battery life, maintenance requirements, and cost considerations were not addressed in the study.
Funding and Disclosures
This work was supported by the Teaching Development Fund of XJTLU under grants TDF20/21-R22-144 and TDF22/23-R25-198, the XJTLU Research Development Fund under grant RDF-22-01-081, and the XJTLU Research Enhancement Fund under grant REF-21-02-001. The authors declared no conflicts of interest.
Publication Information
This research was published in Robot Learn, received February 25, 2025, accepted July 8, 2025, and published July 21, 2025. The paper is titled “Design of a household robot with autonomous navigation for object detection and sorting,” by Bingjie Xu, Yangzesheng Lu, Jingxiang Wang, Qinglei Bu, Mark Leach, and Jie Sun from Suzhou Industrial Park Institute of Vocational Technology and Xi’an Jiaotong-Liverpool University in China. DOI: https://doi.org/10.55092/rl20250005.








David Wallace from Dunder Mifflin sold this patent to the US Defense Dept. Once again CHina has stolen American IP