Access GPT-4o Voice & Vision EARLY Through Microsoft CoPilot AI!

Microsoft held an AI event where they showcased new features, although it wasn't live-streamed to the public. The press present at the event quickly disseminated the information. The speaker is excited about the announcements due to the close collaboration between OpenAI and Microsoft, which has historically led to Microsoft sharing exclusive AI technology with users. A past example is Dolly 3, which was first released in Microsoft Bing's image creator before being integrated into Chat GPT. The event revealed that GPT-40's multimodal capabilities, including voice and vision, will be part of Microsoft's co-pilot AI, an AI assistant for Windows computers. Live demos were shown, and there's a tease of GPT-40 integration in Xbox for live in-game advice. The video also includes a roundup of features for Microsoft co-pilot AI with PCS, highlighting the most powerful AI processor, local AI capabilities, and the 'recall' feature, which allows users to search their entire computer's history using natural language, powered by GPT-4.

The script discusses the potential of real-time AI-powered translation for live chats, eliminating the need for text translation. This feature could enable users to video call and communicate with others in different languages seamlessly. Additionally, the co-pilot AI is highlighted for its chat GPT-like features, such as brainstorming and image generation using GPT-40's capabilities. The speaker expresses interest in whether these features will be accessible before OpenAI publicly releases them. The presentation also introduces 'recall,' a feature that uses the power of the AI processor to help users find anything they have seen or done on their PC, maintaining privacy by keeping content local. The demo showcases how 'recall' can assist in various tasks, such as finding a specific Discord chat message or a PowerPoint presentation, using natural language and memory clues.

The script describes a demo of the co-pilot AI assisting a user in Minecraft, providing real-time advice and guidance. The AI's natural interaction and engagement create a social experience, even in single-player games. The speaker is intrigued by the idea of an AI companion that can watch and assist with work or gameplay. The video also shows a feature within the Paint app that allows users to draw and have AI enhance the image in real-time, running locally on the AI processor. The script mentions other apps that can utilize the AI processor for features like photo restyling and music remixing, with some being exclusive to the processor.

The script addresses privacy and security concerns related to the new AI features, particularly the 'recall' feature that tracks and remembers everything a user does on their computer. While Microsoft claims that all data stays local for privacy, users express skepticism and distrust. There are also concerns about potential security breaches if a user's computer is hacked. The speaker acknowledges these concerns and notes that the features, while impressive, raise valid questions about user privacy and data security.

The script mentions that the new AI features are set to become available starting June 18th, 2024. The speaker speculates that not all features, particularly the advanced GPT-4 capabilities, will be available by this date. There is anticipation for the natural language and vision co-pilot assistant, which the speaker hopes will be accessible by the launch date. The video concludes with a reflection on the usefulness and novelty of the announced AI features, the importance of keeping up with AI advancements, and the potential for AI to revolutionize various aspects of technology and user experience.