{"id":293265,"date":"2024-12-19T11:39:49","date_gmt":"2024-12-19T10:39:49","guid":{"rendered":"https:\/\/sftarticles.wpenginepowered.com\/es\/?p=345975"},"modified":"2025-07-01T15:36:48","modified_gmt":"2025-07-01T22:36:48","slug":"google-requires-its-collaborators-to-rate-geminis-responses-without-adequate-preparation","status":"publish","type":"post","link":"https:\/\/cms-articles.softonic.io\/en\/google-requires-its-collaborators-to-rate-geminis-responses-without-adequate-preparation\/","title":{"rendered":"Google requires its collaborators to rate Gemini&#039;s responses without adequate preparation"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Behind the magic of <strong>generative artificial intelligence<\/strong>, there is a whole technical team of programmers responsible for making everything work as it should. A part of this team, the prompt engineers, are responsible for evaluating the responses given by the AI and their accuracy. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This work scheme is usually the same in all major tech companies, such as <strong>OpenAI<\/strong> or <strong>Google<\/strong>. However, the latter has made some <strong>quite questionable changes<\/strong> in its way of working. Changes that, in the worst case, could affect the <strong>reliability of Gemini.<\/strong><\/p>\n\n\n<div class=\"sc-card-program\">\r\n  <div class=\"sc-card-program__body\">\r\n    <div class=\"sc-card-program__row clearfix\">\r\n      <div class=\"sc-card-program__col-logo\">\r\n        <img decoding=\"async\" class=\"sc-card-program__img\" alt=\"Gemini\" src=\"https:\/\/images.sftcdn.net\/images\/t_app-icon-m\/p\/dcc4d6af-b3e7-48ec-96e2-c65903f60bca\/852050808\/gemini-google-logo\" width=\"100px\" height=\"100px\">\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-title\">\r\n        <span class=\"sc-card-program__title\">Gemini<\/span>\r\n        <a class=\"sc-card-program__button sc-card-program-internal\" href=\"https:\/\/gemini-google.en.softonic.com\/android\" target=\"_self\" rel=\"noopener noreferrer\">DOWNLOAD<\/a>\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-rating\">\r\n        <svg class=\"rating-score__content\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" version=\"1.1\" x=\"0\" y=\"0\" viewbox=\"0 0 50 50\" enable-background=\"new 0 0 50 50\" xml:space=\"preserve\"><path class=\"rating-score__background rating-score--good\" fill=\"none\" stroke-width=\"6\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><path class=\"rating-score__value rating-score__value--0\" fill=\"none\" stroke-width=\"6\" stroke-dashoffset=\"0\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><text class=\"rating-score__number\" content=\"\" text-anchor=\"middle\" transform=\"matrix(1 0 0 1 25 31.0837)\" data-auto=\"app-user-score\"><\/text><\/svg>\r\n      <\/div>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <span class=\"sc-card-program__description\"><\/span>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <img decoding=\"async\" class=\"sc-card-program__bigpic\" src=\"\" onerror=\"this.style.display='none'\">\r\n    <\/div>\r\n    <a class=\"sc-card-program__link track-link sc-card-program-internal\" href=\"https:\/\/gemini-google.en.softonic.com\/android\" target=\"_self\" rel=\"noopener noreferrer\"><\/a>\r\n  <\/div>\r\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\">In order to improve and refine Gemini, Google relies on the services of <strong>GlobalLogic<\/strong>, a subcontracting company owned by <strong>Hitachi<\/strong>. According to <a href=\"https:\/\/techcrunch.com\/2024\/12\/18\/exclusive-googles-gemini-is-forcing-contractors-to-rate-ai-responses-outside-their-expertise\/\" target=\"_blank\" rel=\"noopener nofollow\" title=\"TechCrunch\">TechCrunch<\/a>, Google has reportedly required GlobalLogic employees to evaluate Gemini&#8217;s responses even in <strong>areas outside their expertise<\/strong>. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As expected, this decision has generated <strong>controversy<\/strong> about the lack of accuracy and reliability that such evaluations would have. Some people think that this move could be perceived as <strong>irresponsible<\/strong> and generate <strong>distrust<\/strong> from the public towards Gemini. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/2\/2024\/11\/gemini-thumb-google.jpg\" alt=\"\" class=\"wp-image-344636\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">It should be noted that, before this change, workers could refuse to rate certain questions and answers if they were beyond their knowledge. Now, <strong>this will no longer be the case.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the documents reviewed by TechCrunch, it was made clear that if the worker did not have the experience to assess certain indicators, <strong>the task should be discarded<\/strong>. In the new guidelines, it is specified that <strong>no question should be omitted<\/strong> and that only &#8220;the parts of the question that they do understand&#8221; should be evaluated. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At the moment, <strong>there are only two exceptions<\/strong>: you cannot respond if there is a complete lack of information or if there is offensive content that requires special permissions. <\/p>\n\n\n<div class=\"sc-card-program\">\r\n  <div class=\"sc-card-program__body\">\r\n    <div class=\"sc-card-program__row clearfix\">\r\n      <div class=\"sc-card-program__col-logo\">\r\n        <img decoding=\"async\" class=\"sc-card-program__img\" alt=\"Gemini\" src=\"https:\/\/images.sftcdn.net\/images\/t_app-icon-m\/p\/dcc4d6af-b3e7-48ec-96e2-c65903f60bca\/852050808\/gemini-google-logo\" width=\"100px\" height=\"100px\">\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-title\">\r\n        <span class=\"sc-card-program__title\">Gemini<\/span>\r\n        <a class=\"sc-card-program__button sc-card-program-internal\" href=\"https:\/\/gemini-google.en.softonic.com\/android\" target=\"_self\" rel=\"noopener noreferrer\">DOWNLOAD<\/a>\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-rating\">\r\n        <svg class=\"rating-score__content\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" version=\"1.1\" x=\"0\" y=\"0\" viewbox=\"0 0 50 50\" enable-background=\"new 0 0 50 50\" xml:space=\"preserve\"><path class=\"rating-score__background rating-score--good\" fill=\"none\" stroke-width=\"6\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><path class=\"rating-score__value rating-score__value--0\" fill=\"none\" stroke-width=\"6\" stroke-dashoffset=\"0\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><text class=\"rating-score__number\" content=\"\" text-anchor=\"middle\" transform=\"matrix(1 0 0 1 25 31.0837)\" data-auto=\"app-user-score\"><\/text><\/svg>\r\n      <\/div>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <span class=\"sc-card-program__description\"><\/span>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <img decoding=\"async\" class=\"sc-card-program__bigpic\" src=\"\" onerror=\"this.style.display='none'\">\r\n    <\/div>\r\n    <a class=\"sc-card-program__link track-link sc-card-program-internal\" href=\"https:\/\/gemini-google.en.softonic.com\/android\" target=\"_self\" rel=\"noopener noreferrer\"><\/a>\r\n  <\/div>\r\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Behind the magic of generative artificial intelligence lies a whole technical team of programmers responsible for making everything work as it should. Part of this team, the prompt engineers, are tasked with evaluating the responses given by the AI and their accuracy. This work scheme is usually the same in all major tech companies, such as OpenAI or Google. However, the latter has made some quite questionable changes in its way of working. Changes that, in the worst-case scenario, could affect the reliability of Gemini. With [&hellip;]<\/p>\n","protected":false},"author":9211,"featured_media":293272,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","wpcf-pageviews":44},"categories":[1015],"tags":[6264,6524],"usertag":[],"vertical":[],"content-category":[6771],"class_list":["post-293265","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-gemini","tag-google-gemini","content-category-ai"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/293265","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/users\/9211"}],"replies":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/comments?post=293265"}],"version-history":[{"count":1,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/293265\/revisions"}],"predecessor-version":[{"id":310395,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/293265\/revisions\/310395"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media\/293272"}],"wp:attachment":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media?parent=293265"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/categories?post=293265"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/tags?post=293265"},{"taxonomy":"usertag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/usertag?post=293265"},{"taxonomy":"vertical","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/vertical?post=293265"},{"taxonomy":"content-category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/content-category?post=293265"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}