{"id":242992,"date":"2023-08-04T10:34:34","date_gmt":"2023-08-04T14:34:34","guid":{"rendered":"https:\/\/sftarticles.wpenginepowered.com\/es\/?p=301393"},"modified":"2025-07-01T18:32:31","modified_gmt":"2025-07-02T01:32:31","slug":"chatgpt-and-his-friends-are-the-nightmare-of-cybersecurity-experts","status":"publish","type":"post","link":"https:\/\/cms-articles.softonic.io\/en\/chatgpt-and-his-friends-are-the-nightmare-of-cybersecurity-experts\/","title":{"rendered":"The Rise of ChatGPT and Its Cohorts: A Menace to Cybersecurity"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">AI generative chatbots, like ChatGPT and Google Bard, are the subject of ongoing work to improve their usability and capabilities, <a href=\"https:\/\/en.softonic.com\/articles\/its-official-we-will-never-be-able-to-trust-artificial-intelligence-and-less-than-chatgpt\" target=\"_blank\" rel=\"noreferrer noopener\">but researchers have also discovered some quite concerning security vulnerabilities<\/a>.<\/p>\n\n\n<div class=\"sc-card-program\">\r\n  <div class=\"sc-card-program__body\">\r\n    <div class=\"sc-card-program__row clearfix\">\r\n      <div class=\"sc-card-program__col-logo\">\r\n        <img decoding=\"async\" class=\"sc-card-program__img\" alt=\"ChatGPT\" src=\"https:\/\/images.sftcdn.net\/images\/t_app-icon-s\/p\/47ef1772-2a82-4750-b97a-354b13dbd112\/3647786732\/chatgpt-ChatGPT-icon.png\" width=\"100px\" height=\"100px\">\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-title\">\r\n        <span class=\"sc-card-program__title\">ChatGPT<\/span>\r\n        <a class=\"sc-card-program__button sc-card-program-internal\" href=\"https:\/\/chatgpt.en.softonic.com\/iphone\" target=\"_self\" rel=\"noopener noreferrer\">DOWNLOAD<\/a>\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-rating\">\r\n        <svg class=\"rating-score__content\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" version=\"1.1\" x=\"0\" y=\"0\" viewbox=\"0 0 50 50\" enable-background=\"new 0 0 50 50\" xml:space=\"preserve\"><path class=\"rating-score__background rating-score--good\" fill=\"none\" stroke-width=\"6\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><path class=\"rating-score__value rating-score__value--0\" fill=\"none\" stroke-width=\"6\" stroke-dashoffset=\"0\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><text class=\"rating-score__number\" content=\"\" text-anchor=\"middle\" transform=\"matrix(1 0 0 1 25 31.0837)\" data-auto=\"app-user-score\"><\/text><\/svg>\r\n      <\/div>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <span class=\"sc-card-program__description\"><\/span>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <img decoding=\"async\" class=\"sc-card-program__bigpic\" src=\"\" onerror=\"this.style.display='none'\">\r\n    <\/div>\r\n    <a class=\"sc-card-program__link track-link sc-card-program-internal\" href=\"https:\/\/chatgpt.en.softonic.com\/iphone\" target=\"_self\" rel=\"noopener noreferrer\"><\/a>\r\n  <\/div>\r\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/llm-attacks.org\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Carnegie Mellon University (CMU)<\/a> researchers have demonstrated that it is possible to craft adversarial attacks against the language models that power AI chatbots.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>These attacks involve strings of characters that can be appended to a user&#8217;s question or statement<\/strong>, which otherwise the chatbot would have refused to respond to, and they bypass the constraints applied to the chatbot by its creators.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"How To Actually Jailbreak ChatGPT! (Educational Purposes ONLY!)\" width=\"840\" height=\"473\" src=\"https:\/\/www.youtube.com\/embed\/e1IjqS5abi0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">These new and concerning attacks go beyond the recent jailbreaks that have also been discovered. Jailbreaks are specially crafted instructions that allow a user to bypass the restrictions imposed on a chatbot (in this case), producing responses that are normally prohibited.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>While these clever solutions are impressive, their design can be time-consuming<\/strong>. Additionally, once they are discovered and inevitably made public, chatbot creators have no problem fixing them.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">Mother of all LLM jailbreaks: Automatically constructing adversarial prompts using OSS model (Vicuna) weights that work against ChatGPT, Bard, Claude, and Llama 2<br><br>Screenshots: Demo of response without\/with jailbreak suffix<br><br>Linked thread from lead author has details\/PDF <a href=\"https:\/\/t.co\/HDzGmlNNmQ\">https:\/\/t.co\/HDzGmlNNmQ<\/a> <a href=\"https:\/\/t.co\/1nBStKqXri\">pic.twitter.com\/1nBStKqXri<\/a><\/p>&mdash; Riley Goodside (@goodside) <a href=\"https:\/\/twitter.com\/goodside\/status\/1684803086869553152?ref_src=twsrc%5Etfw\">July 28, 2023<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">How do these attacks differ from chatbots?<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">In comparison to intentionally crafted jailbreaks, the attacks built by CMU researchers are generated entirely automatically, making them capable of quickly creating and utilizing these attacks in large quantities.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The researchers specify that the attacks are initially targeted at open-source generative AI models, but they can also be directed at closed-source chatbots that are publicly available, including Bard, ChatGPT, and Claude.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This means that if someone were to create a program that generates these strings of characters, this type of attack could be worryingly easy to carry out, potentially posing a threat to the security and privacy of users.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/articles-img.sftcdn.net\/sft\/articles\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-1024x576.jpg\" alt=\"\" class=\"wp-image-242998\" srcset=\"https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-1024x576.jpg 1024w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-300x169.jpg 300w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-768x433.jpg 768w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-800x450.jpg 800w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-664x374.jpg 664w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-238x134.jpg 238w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-436x246.jpg 436w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-370x208.jpg 370w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-304x170.jpg 304w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-18x10.jpg 18w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-1200x675.jpg 1200w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C-150x84.jpg 150w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2023\/08\/El-modo-abuela-asi-se-hackea-a-C.jpg 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Grandma mode how to hack ChatGPT<\/figcaption><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>This threat multiplies as the technology of these chatbots is integrated into an increasing number of programs and applications<\/strong> (such as Microsoft&#8217;s plans to bring ChatGPT-powered AI to Windows 11 through Copilot).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If that doesn&#8217;t alarm you, researchers speculate whether the architects behind the chatbots will ever be able to patch all such vulnerabilities. <strong>&#8220;As far as we know, there&#8217;s no way to patch this,&#8221;<\/strong> they stated.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Similar attacks have proven to be <strong>a very challenging problem to address in the last 10 years<\/strong>. The CMU researchers conclude their report with a warning for chatbot developers (and other AI tools) to be mindful of such threats as the usage of AI systems continues to grow.<\/p>\n\n\n<div class=\"sc-card-program\">\r\n  <div class=\"sc-card-program__body\">\r\n    <div class=\"sc-card-program__row clearfix\">\r\n      <div class=\"sc-card-program__col-logo\">\r\n        <img decoding=\"async\" class=\"sc-card-program__img\" alt=\"ChatGPT\" src=\"https:\/\/images.sftcdn.net\/images\/t_app-icon-s\/p\/47ef1772-2a82-4750-b97a-354b13dbd112\/3647786732\/chatgpt-ChatGPT-icon.png\" width=\"100px\" height=\"100px\">\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-title\">\r\n        <span class=\"sc-card-program__title\">ChatGPT<\/span>\r\n        <a class=\"sc-card-program__button sc-card-program-internal\" href=\"https:\/\/chatgpt.en.softonic.com\/iphone\" target=\"_self\" rel=\"noopener noreferrer\">DOWNLOAD<\/a>\r\n      <\/div>\r\n      <div class=\"sc-card-program__col-rating\">\r\n        <svg class=\"rating-score__content\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" version=\"1.1\" x=\"0\" y=\"0\" viewbox=\"0 0 50 50\" enable-background=\"new 0 0 50 50\" xml:space=\"preserve\"><path class=\"rating-score__background rating-score--good\" fill=\"none\" stroke-width=\"6\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><path class=\"rating-score__value rating-score__value--0\" fill=\"none\" stroke-width=\"6\" stroke-dashoffset=\"0\" stroke-miterlimit=\"10\" d=\"M40 40c8.3-8.3 8.3-21.7 0-30s-21.7-8.3-30 0 -8.3 21.7 0 30\"><\/path><text class=\"rating-score__number\" content=\"\" text-anchor=\"middle\" transform=\"matrix(1 0 0 1 25 31.0837)\" data-auto=\"app-user-score\"><\/text><\/svg>\r\n      <\/div>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <span class=\"sc-card-program__description\"><\/span>\r\n    <\/div>\r\n    <div class=\"sc-card-program__row\">\r\n      <img decoding=\"async\" class=\"sc-card-program__bigpic\" src=\"\" onerror=\"this.style.display='none'\">\r\n    <\/div>\r\n    <a class=\"sc-card-program__link track-link sc-card-program-internal\" href=\"https:\/\/chatgpt.en.softonic.com\/iphone\" target=\"_self\" rel=\"noopener noreferrer\"><\/a>\r\n  <\/div>\r\n<\/div>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Some of the links added in the article are part of affiliate campaigns and may represent benefits for Softonic.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI chatbots like ChatGPT could be a security nightmare, and experts are trying to contain the chaos this way.<\/p>\n","protected":false},"author":9265,"featured_media":242995,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","wpcf-pageviews":1},"categories":[1015],"tags":[4218],"usertag":[],"vertical":[],"content-category":[],"class_list":["post-242992","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-app-subdomain-redirectionchatgpt"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/242992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/users\/9265"}],"replies":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/comments?post=242992"}],"version-history":[{"count":1,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/242992\/revisions"}],"predecessor-version":[{"id":318717,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/242992\/revisions\/318717"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media\/242995"}],"wp:attachment":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media?parent=242992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/categories?post=242992"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/tags?post=242992"},{"taxonomy":"usertag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/usertag?post=242992"},{"taxonomy":"vertical","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/vertical?post=242992"},{"taxonomy":"content-category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/content-category?post=242992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}