🤖 𝗦𝗮𝘀𝗵𝗶𝗺𝗶-𝗕𝗼𝘁 𝗶𝘀 𝗽𝘂𝗯𝗹𝗶𝘀𝗵𝗲𝗱 𝗶𝗻 Nature Portfolio 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗮𝗻𝗱 𝗶𝗻 𝗡𝗮𝘁𝘂𝗿𝗲 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗛𝗶𝗴𝗵𝗹𝗶𝗴𝗵𝘁𝘀
I am very happy to share that our paper “𝗦𝗮𝘀𝗵𝗶𝗺𝗶-𝗕𝗼𝘁: 𝗔𝘂𝘁𝗼𝗻𝗼𝗺𝗼𝘂𝘀 𝗧𝗿𝗶-𝗺𝗮𝗻𝘂𝗮𝗹 𝗔𝗱𝘃𝗮𝗻𝗰𝗲𝗱 𝗠𝗮𝗻𝗶𝗽𝘂𝗹𝗮𝘁𝗶𝗼𝗻 𝗮𝗻𝗱𝗖𝘂𝘁𝘁𝗶𝗻𝗴 𝗼𝗳 𝗗𝗲𝗳𝗼𝗿𝗺𝗮𝗯𝗹𝗲 𝗢𝗯𝗷𝗲𝗰𝘁𝘀” has been published in Nature Portfolio Journal Robotics, and featured in Nature Research Highlights.
𝗦𝗮𝘀𝗵𝗶𝗺𝗶-𝗕𝗼𝘁 shows why scaling robotic manipulation to challenging real-world materials remains so hard - and why physical intelligence, combining visuo-tactile perception, learning, control, and contact-rich interaction, is essential. Salmon is an ideal exemplar of this challenge: visually familiar and appealing to people, but a nightmare object for robots - sticky and slippery at the same time, difficult to hold, easily deformed during manipulation, and governed by interaction dynamics that is nonlinear, uncertain, and difficult to model.
𝗪𝗵𝘆 𝘀𝗮𝘀𝗵𝗶𝗺𝗶?
We chose sashimi preparation as a demonstrator because it combines scientific difficulty with broad public appeal: it is easy to understand, visually compelling, and extremely hard for robots to perform. Salmon also connects naturally to the blue economy and to the potential of robotics in a domain of particular importance to Norway.
🔬 𝗪𝗵𝗮𝘁 𝗶𝘀 𝗻𝗲𝘄?
Three robots collaborate to straighten the loin, manipulate the knife, perform slicing motions while stabilizing the object, and pick up thin slices from the cutting board or even the knife blade. The system combines deep reinforcement learning, in-hand tool shape manipulation deployed zero-shot, in-hand tool cutting, and visual and tactile feedback.
𝗔 𝗷𝗼𝗶𝗻𝘁 𝗲𝗳𝗳𝗼𝗿𝘁
This work is the result of close collaboration across the SINTEF Ocean-led projects GentleMAN (IKTPLUSS) and BIFROST (FRIPRO), financed by Norges forskningsråd, bringing together partners from SINTEF Ocean, Norwegian University of Science and Technology (NTNU), NMBU - Norwegian University of Life Sciences, Massachusetts Institute of Technology, Inria, and QUT (Queensland University of Technology).
For me personally, it has also been a great privilege to collaborate with and learn from Francois Chaumette, Edward Adelson, and Peter Corke, whose work has shaped important parts of modern robotics.
The amazing team behind Sashimi-Bot: Sverre Herland, Amit Parag,Elling Ruud Øye, Fangyi Zhang, Fouad MAKIYEH, PhD, Aleksander Lillienskiold, Abhaya Singh, Edward Adelson, Francois Chaumette, Alexandre Krupa, Peter Corke, Ekrem Misimi
Nature Research Highlight: 👇
https://lnkd.in/esYqHUuW
👉 Open-access paper and videos are available in the first comment.
#Robotics #AIRobotics #PhysicalIntelligence #RoboticManipulation #DeformableObjects #TactileSensing #ReinforcementLearning Franka Robotics Centre Inria de l'Université de Rennes, SINTEF, Rainbow Team, QUT Centre for Robotics