{"id":377,"date":"2021-09-20T14:28:41","date_gmt":"2021-09-20T14:28:41","guid":{"rendered":"http:\/\/merlin.deib.polimi.it\/?p=377"},"modified":"2023-04-20T16:53:04","modified_gmt":"2023-04-20T14:53:04","slug":"cobots-key-allies-to-increase-productivity-and-mitigate-stress","status":"publish","type":"post","link":"https:\/\/merlin.deib.polimi.it\/?p=377","title":{"rendered":"Cobots: key allies to increase productivity and mitigate stress"},"content":{"rendered":"\n<p>How many times do we feel exhausted after an intense workday? Maybe we did our best at work and then we feel like our own physical and mental resources just disappeared\u2026 or we feel like we weren\u2019t able to operate at maximum efficiency, inevitably collapsing into a heap of perceived failure.<\/p>\n\n\n\n<p>In today\u2019s society the modern work paradigm often seems to ask us to do more in less time, and do it well. However, this \u201cfast-and-well\u201d work culture intrinsically incorporates the elements that, in the long run, can lead us to be less productive, or undermine our psycho-physiological safety. This might not only entail serious productivity loss but also lead workers to burnout, overstress and absenteeism.<\/p>\n\n\n\n<!--more-->\n\n\n\n<p>So, where can we buy the ticket for a workday filled with less stress and more throughput? Is it just utopia the idea of <strong>simultaneously improving both workers\u2019 well-being<\/strong> (reducing stress in the workplace) <strong>and job performance<\/strong>? Although this may seem unrealistic, it\u2019s not. Today the collaborative robot (a.k.a. <strong>cobot<\/strong>) can be a key ally to help the industrial shop-floor worker achieve both these objectives!<\/p>\n\n\n\n<p>How? The key answer is enclosed in the worlds of <strong>game theory<\/strong>, <strong>strategic decision making <\/strong>and<strong> reinforcement learning<\/strong>. But let\u2019s proceed one step at a time. According to the psycho-physiological theory, <strong>the relationship between stress and performance is described by an inverted U-shaped curve<\/strong>, as illustrated hereafter. This means that, while too little stress results in boredom and demotivation (calm) and seems not to boost our productivity, moderate stress levels are beneficial in terms of performance (eustress), but only up to a certain point. After that, the increase of stress has a negative impact on both our safety and performance (distress), leading to mental exhaustion and poor productive capabilities.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"834\" height=\"534\" src=\"http:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_1.png\" alt=\"\" class=\"wp-image-380\" srcset=\"https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_1.png 834w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_1-300x192.png 300w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_1-768x492.png 768w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Too little stress demotivates, too much destroys, but the right amount gets the job done.<\/figcaption><\/figure>\n\n\n\n<p>So, stress and performance are strongly interrelated and staying on top of the curve (where just the right amount of stress allows us to achieve the peak performance) is a delicate balancing act and \u2013of course\u2013 a matter of trade-offs and equilibria!<\/p>\n\n\n\n<p>Wouldn\u2019t it be great if the cobot could help us reach this optimal stress-performance point? Here\u2019s how to do that.<\/p>\n\n\n\n<p>At <a href=\"http:\/\/www.polimi.it\" data-type=\"URL\" data-id=\"www.polimi.it\" target=\"_blank\" rel=\"noreferrer noopener\">Politecnico di Milano<\/a>, we enabled <strong>the cobot<\/strong> to autonomously <strong>adjust its behaviour<\/strong> during the interaction with the human co-worker <strong>to simultaneously increase<\/strong> his\/her <strong>performance<\/strong> <strong>and mitigate<\/strong> <strong>work-related stress<\/strong>.<\/p>\n\n\n\n<p>The very first ingredient to let the cobot realize this strategy is to monitor in real-time the stress and the performance of the human worker.&nbsp; Then, to express the trade-off between the human stress minimization and performance maximization, we borrow some elements of game theory.<\/p>\n\n\n\n<p>Indeed, <strong>game theory<\/strong> is the science that studies the optimal decision-making of competing and independent agents (a.k.a. <strong>players<\/strong>) in strategic frameworks. &nbsp;The core of game theory is the so-called <strong>\u2018game\u2019<\/strong>, which is used as a model of the interaction between rational players. Each player is then a strategic decision-maker within the situation exemplified by the game. Given the circumstances that can arise within the game, each player decides which action to take among a predefined set. The combination of simultaneous game actions played by the agents is called <strong>\u2018game outcome\u2019<\/strong>. This represents a possible state that the players can reach during their interaction. For each game outcome, each agent receives a payout (a.k.a. <strong>\u2018payoff\u2019<\/strong> or <strong>\u2018utility\u2019<\/strong>), i.e. a numeric value quantifying the player\u2019s level of satisfaction with respect to that outcome.<\/p>\n\n\n\n<p>In human-robot collaborative frameworks, typically, a human operator and a cobot cooperate to accomplish a certain task. Clearly, the way they behave during cooperation influences the human attitudinal state in terms of stress and performance. Unfortunately, this influence cannot be predicted a priori.<\/p>\n\n\n\n<p>So, game theory provides the theoretical framework to model how the actual human-robot interaction is affecting the stress and performance of the human worker. To realize the model of this trade-off, we reinterpret the interaction between human and robot as a game between two self-interested agents: H and R. These are used to express the two competing aspects of whatever working framework:&nbsp; be productive on one side, and keep stress low on the other side. As displayed in the following figure, we assume the goal of player R is to maximize productivity and the one of player H is to minimize stress. Then, we exploit the game actions to express the possible behaviours adopted by the human and the robot during the interaction. Indeed, we assume that each player can <strong>adapt<\/strong> to the other one (i.e. playing action D) when it is aligning to the goal of the other player or do <strong>not adapt<\/strong> (i.e. playing action ND), in the opposite case.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"395\" src=\"http:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_2-1024x395.png\" alt=\"\" class=\"wp-image-381\" srcset=\"https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_2-1024x395.png 1024w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_2-300x116.png 300w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_2-768x296.png 768w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_2.png 1037w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Game theoretic representation of the \u201cproduce more, stress less\u201d paradigm in human-robot collaborative settings.<\/figcaption><\/figure>\n\n\n\n<p>So, this game-theoretic model allows us to evaluate the admissible stress-performance compromises (outcomes) that the human-robot interaction can produce. Besides, it also let us identify the particular game outcome (Nash equilibrium) that represents the local equilibrium state of the game and a \u201cno regrets\u201d situation for the agents. This is due to the fact that, by definition, the Nash Equilibrium is a game outcome that, once reached, means that no player can increase its payoff by changing actions unilaterally. Thus, in the considered case, the Nash Equilibrium give us the chance to identify the local stress-performance equilibrium compromise.<\/p>\n\n\n\n<p>But how to make the cobot apply the right behaviour to optimize this trade-off?<\/p>\n\n\n\n<p>This time the answer is <strong>reinforcement learning<\/strong>. Basically, we penalize or reward the robot behaviour proportionally to its positive or negative influence on the human attitudinal state in terms of stress and performance. The game model serves to evaluate this effect. In our Lab we applied this approach and validated it in a real human-robot collaborative assembly task, as shown in the following video.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Human-robot collaboration: optimizing stress and productivity based on game theory\" width=\"525\" height=\"295\" src=\"https:\/\/www.youtube.com\/embed\/erfqeeur30g?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>During the experimental campaign, we compared the effects of three different techniques in terms of human stress and productivity:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>the full strategy just described (CPS), where the cobot autonomously adjusted the production rhythm (a.k.a. pace of interaction) to jointly optimize both human stress and performance;<\/li>\n\n\n\n<li>a strategy (NC) where the robot simply followed the production rhythm decided by the human, without optimizing productivity or stress;<\/li>\n\n\n\n<li>a strategy (CP) where the robot varied the pace of interaction to solely stimulate the human productivity, regardless of his\/her stress.<\/li>\n<\/ul>\n\n\n\n<p>The results, illustrated hereafter, revealed that only the proposed strategy (CPS) was effective in simultaneously achieving the highest productivity level and a significant stress mitigation. Besides, they also showed that a suitable variation of the pace of interaction, applied by the cobot, is the key to realize the desired optimization.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"428\" src=\"http:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_3-1024x428.png\" alt=\"\" class=\"wp-image-382\" srcset=\"https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_3-1024x428.png 1024w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_3-300x125.png 300w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_3-768x321.png 768w, https:\/\/merlin.deib.polimi.it\/wp-content\/uploads\/2021\/09\/IMG_3.png 1179w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<p>References:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>G. Weiss &#8211; <em>Multiagent systems (ed.)<\/em>, The MIT Press, Cambridge, Massachusetts, 2013.<\/li>\n\n\n\n<li>C. Messeri, G. Masotti, A. M. Zanchettin, P. Rocco &#8211; <em>\u201cHuman-Robot Collaboration: Optimizing Stress and Productivity Based on Game Theory\u201d, <\/em>IEEE Robotics and Automation Letters, vol. 6, no. 4, pp. 8061-8068, Oct. 2021.<\/li>\n<\/ol>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>How many times do we feel exhausted after an intense workday? Maybe we did our best at work and then we feel like our own physical and mental resources just disappeared\u2026 or we feel like we weren\u2019t able to operate at maximum efficiency, inevitably collapsing into a heap of perceived failure. In today\u2019s society the &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/merlin.deib.polimi.it\/?p=377\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Cobots: key allies to increase productivity and mitigate stress&#8221;<\/span><\/a><\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,5],"tags":[6,4,9,13],"class_list":["post-377","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-collaborative-robotics","tag-artificialintelligence","tag-collaborativerobotics","tag-ergonomics","tag-gametheory"],"_links":{"self":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/377","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=377"}],"version-history":[{"count":7,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/377\/revisions"}],"predecessor-version":[{"id":513,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/377\/revisions\/513"}],"wp:attachment":[{"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=377"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=377"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/merlin.deib.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=377"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}