Meta Unveils New AI Assistant, Llama 3.2 Models, and More

Meta introduced a series of AI innovations at the annual Meta Connect 2024 event. These include new versions of the large language model Llama 3.2, the Meta AI voice assistant, updates to Ray-Ban smart glasses, and other developments.

The Llama family of large language models has been updated to version 3.2. The neural networks have become multimodal, capable of processing text and images.

The compact Llama 3.2 11B and the larger 90B can analyze graphs and charts, caption images, and identify objects in pictures. For instance, given a company’s annual income chart, the models can quickly highlight the most successful months. After analyzing a park map, the AI can suggest the trail length or terrain changes.

Two other versions of the model — Llama 3.2 1B and 3B — are more compact. They are designed for smartphone use and are applied for simple tasks like summarizing and rewriting paragraphs.

The Meta AI assistant has gained a voice. Users can ask questions and receive voice responses in Messenger, Facebook, WhatsApp, and Instagram.

Ray-Ban and Meta’s smart glasses have been updated with real-time video processing using artificial intelligence. This allows users to ask the glasses questions about what they see. Additional features include reminders, translation, and integration with music apps.

Meta AI has been trained to edit photos, answer questions about images, and share them in chats. This functionality is enabled by the multimodality of Llama 3.2.

By sending an image to the AI assistant, users can request changes, such as removing an object or updating the background.

Meta AI is available on Instagram.

The event also showcased Orion glasses. They are lightweight and feature a neural interface for control, as well as hand and eye tracking. Small projectors are embedded in the frames. The product is positioned as a continuation of the Ray-Ban smart glasses and is still under development.

Another new gadget is the Meta Quest 3S. This is a cheaper alternative to the Quest 3. The new mixed reality headset is priced at $300, which is $200 less than the standard version. The base model comes with 128 GB of storage and a lower-quality display.

The company is testing a translator mode, where the AI takes original content, translates it into another language, and synchronizes the creator’s lips accordingly.

Back in July, Meta unveiled a collection of new AI systems Llama 3.1, including the “long-awaited” 405B — “the first open-source model of an advanced level.”