Meta wants to destroy Microsoft Copilot with his new Llama 70B

This AI-based tool includes variants that have been fine-tuned for specific tasks. One of them is CodeLlama-70B, which can comprehend…

In August 2023, Meta launched Code Llama, a large-scale language model explicitly designed for coding tasks, based on the previous model Llama 2. Today, the company has unveiled “a more powerful new version”, Code Llama 70B.

Llama 2 DOWNLOAD

Code Llama 70B has been trained with 500 billion code tokens and associated data. It can process and generate longer code sequences thanks to a contextual window of 100,000 tokens.

According to Meta, Code Llama 70B uses a technique called self-attention to understand code structures. It can implement algorithms, sort, search, and much more from text or code snippets in many languages such as Python, C++, Javascript, and Java.

What does Llama 70B offer and why is it a step further

This AI-based tool includes variants that have been fine-tuned for specific tasks. One of them is CodeLlama-70B-Instruct, which has been trained to understand natural language instructions.

There is also a Python-focused version called CodeLlama-70B-Python. With additional training on 100 billion Python code tokens, it generates Python with “unmatched fluency and accuracy,” according to Meta.

Code Llama 70B can be freely downloaded under the same open license as previous Code Llama models. Meta states that this permissive license allows both academic and commercial users to modify the model.

Llama 2 DOWNLOAD

This is clearly competition to GitHub and Microsoft’s Copilot. Developers can ask Copilot questions about their code, get explanations about specific parts of the code, and even have Copilot fix errors in the code.

Recently, Google also made Duet AI and Gemini Pro available to the general public, its AI-based code generation and completion tool.

Author: Chema Carvajal Sarabia

{ "de-DE": "Journalist, spezialisiert auf Technologie, Unterhaltung und Videospiele. Über das zu schreiben, was mich begeistert (Gadgets, Spiele und Filme), ermöglicht es mir, bei Verstand zu bleiben und mit einem Lächeln im Gesicht aufzuwachen, wenn der Wecker klingelt. PS: Das stimmt nicht 100% der Zeit.", "en-US": "Journalist specialized in technology, entertainment and video games. Writing about what I'm passionate about (gadgets, games and movies) allows me to stay sane and wake up with a smile on my face when the alarm clock goes off. PS: this is not true 100% of the time.", "es-ES": "Content Manager - Periodista especializado en tecnología, entretenimiento y videojuegos. Escribir sobre lo que me apasiona (cacharros, juegos y cine) me permite seguir cuerdo y despertarme con una sonrisa cuando suena el despertador. PD: esto no es cierto el 100 % de las veces.", "fr-FR": "Journaliste spécialisé dans la technologie, le divertissement et les jeux vidéo. Écrire sur ce qui me passionne (gadgets, jeux et films) me permet de rester sain d'esprit et de me réveiller avec le sourire aux lèvres quand le réveil sonne. PS : cela n'est pas vrai 100 % du temps.", "it-IT": "Giornalista specializzato in tecnologia, intrattenimento e videogiochi. Scrivere di ciò che mi appassiona (gadget, giochi e film) mi permette di mantenere la sanità mentale e di svegliarmi con un sorriso sul viso quando suona la sveglia. PS: questo non è vero al 100% del tempo.", "ja-JP": "", "nl-NL": "", "pl-PL": "", "pt-BR": "Jornalista especializado em tecnologia, entretenimento e videogames. Escrever sobre o que me apaixona (gadgets, jogos e filmes) me permite manter a sanidade e acordar com um sorriso no rosto quando o despertador toca. PS: isso não é verdade 100% do tempo.", "social": { "email": "chemacs91@gmail.com", "facebook": "", "twitter": "https://twitter.com/chematopetazo", "linkedin": "" } }