{"id":353,"date":"2017-08-24T07:40:00","date_gmt":"2017-08-24T07:40:00","guid":{"rendered":"http:\/\/merlin.deib.polimi.it\/?p=353"},"modified":"2023-04-20T16:54:42","modified_gmt":"2023-04-20T14:54:42","slug":"test-post","status":"publish","type":"post","link":"https:\/\/merlin.deib.polimi.it\/?p=353","title":{"rendered":"Industry 4.0: towards an intelligent collaboration with robots"},"content":{"rendered":"\n<p>How many times, at the grocery shop, while waiting for our turn to be served we naturally asked ourselves: should I just queue and wait or should I swing by another aisle in the meanwhile?&nbsp;Well\u2026 just a simple question that however entails quite a few reasoning: how fast are the attendants in serving other people? how much time do I have without loosing my turn?<\/p>\n\n\n\n<p>Now, let\u2019s virtually move this paradigm to the\u00a0<strong>factory of the future<\/strong>. Our guest star is now a\u00a0<strong>collaborative robot<\/strong>\u00a0that has to decide when the human fellow co-worker will require its assistance.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>This is what we are currently doing in our lab&nbsp;at&nbsp;<a rel=\"noreferrer noopener\" href=\"http:\/\/www.polimi.it\/\" target=\"_blank\">Politecnico di Milano<\/a>&nbsp;to allow the robot to answer the following questions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>which activity is the human operator more likely to perform next?<\/li>\n\n\n\n<li>what is the time when an activity requiring my assistance is&nbsp;expected to be initiated by the human?<\/li>\n<\/ul>\n\n\n\n<p>But let\u2019s proceed step by step\u2026<\/p>\n\n\n\n<p>The first ingredient that we need is an efficient way to&nbsp;<strong>categorise human\u2019s actions<\/strong>. For this goal, we used some Bayesian statistics and some computer vision. The result is shown in this video: the robot completes the operation initiated by the human.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"ABB YuMi collaborative assembly through prediction of human action\" width=\"525\" height=\"295\" src=\"https:\/\/www.youtube.com\/embed\/P1p1-hejjaQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Now we have correctly characterised what the human is doing, but what\u2019s next? Well, based on some&nbsp;<strong>machine learning<\/strong>&nbsp;algorithms, and specifically based on&nbsp;<strong>pattern recognition<\/strong>, we were also able to predict the next sequence of actions and their duration. The result is shown in the next video: the robot is autonomously responsible for a quality control task, while the operator is involved in some assembly operations. As soon as the human completes his task, the collaborative phase can start and the robot is ready to help. The promptness of the robot is achieved thanks to the observation of previous executions and allows the robot itself to be ready when required by the human.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Collaborative assembly with ABB YuMi robot\" width=\"525\" height=\"295\" src=\"https:\/\/www.youtube.com\/embed\/yHK2vXf0mrk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>The algorithm has been compared to a purely reactive approach, during which the robot always starts its own task unless the human has already initiated the collaborative phase. The proactive behavior outperforms the purely reactive one by&nbsp;<strong>reducing the cycle time<\/strong>&nbsp;and its variability, hence achieving the perfect production leveling (or&nbsp;<a href=\"https:\/\/en.wikipedia.org\/wiki\/Production_leveling\" target=\"_blank\" rel=\"noreferrer noopener\">heijunka<\/a>,&nbsp;\u5e73\u6e96\u5316, in Japanese).<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/zanchettin83.files.wordpress.com\/2017\/11\/f18be706-dda7-4601-9097-5763688bc9ce.jpeg?w=391&amp;h=315\" alt=\"F18BE706-DDA7-4601-9097-5763688BC9CE\" class=\"wp-image-216\"\/><\/figure>\n<\/div>\n\n\n<p>References:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>A.M. Zanchettin, P. Rocco \u2013&nbsp;<em>\u201cProbabilistic inference of human arm reaching target for effective human-robot collaboration\u201d<\/em>, IROS 2017, Vancouver (Canada), September 24th \u2013 28th, 2017.<\/li>\n\n\n\n<li>A.M. Zanchettin, A. Casalino, L. Piroddi, P. Rocco \u2013&nbsp;<em>\u201cPrediction of human activity patterns for human-robot collaborative assembly tasks\u201d<\/em>, IEEE Transactions on Industrial Informatics.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>How many times, at the grocery shop, while waiting for our turn to be served we naturally asked ourselves: should I just queue and wait or should I swing by another aisle in the meanwhile?&nbsp;Well\u2026 just a simple question that however entails quite a few reasoning: how fast are the attendants in serving other people? &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/merlin.deib.polimi.it\/?p=353\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Industry 4.0: towards an intelligent collaboration with robots&#8221;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,5],"tags":[6,4],"class_list":["post-353","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-collaborative-robotics","tag-artificialintelligence","tag-collaborativerobotics"],"_links":{"self":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/353","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=353"}],"version-history":[{"count":4,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/353\/revisions"}],"predecessor-version":[{"id":518,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/353\/revisions\/518"}],"wp:attachment":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=353"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=353"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=353"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}