ChatGPT’s New Feature Is Insane

Here are 20 bullet points summarizing the transcript:

• ChatGPT's New Features: ChatGPT has introduced new features in its advanced voice mode, including video and screen sharing capabilities.

• Availability: These features are currently available to ChatGPT Plus and Pro users on iOS and Android, with plans to expand to Enterprise and Education users in January.

• Video Mode: Video mode allows ChatGPT to interact with users in real time based on what it sees on the screen, similar to a video call.

• Screen Sharing: Screen sharing enables users to share their device screens with ChatGPT, allowing the AI to provide context-sensitive assistance for tasks like messaging or browsing.

• Santa Mode: A temporary holiday feature that allows users to interact with ChatGPT in the voice of Santa Claus.

• Limited Availability: Santa Mode is available to all users with access to advanced voice mode but will only be available until early January.

• Privacy: Conversations in Santa Mode are not recorded in chat history and do not affect ChatGPT's memory.

• Similar Features: Other AI platforms like Google's Project Astra and Microsoft's Co-pilot Vision offer similar screen-sharing and visual interaction capabilities.

• Future Possibilities: Future advancements may include AI models that can actively interact with a computer's interface, such as opening tabs or launching applications.

• Impact: These new features demonstrate AI's evolving capabilities and potential to revolutionize how we interact with technology in our daily lives.

• Multimodal Interactions: OpenAI introduced the concept of multimodal interactions with GPT-4, showcasing its vision for ChatGPT to watch a game and narrate the events unfolding.

• Advanced Voice Mode: The rollout of advanced voice mode marked the beginning of a new era in interactive AI communication.

• Video Mode Functionality: ChatGPT can observe the user's surroundings, recognize objects, and even remember individuals who introduced themselves during the conversation.

• Real-time Interaction: OpenAI's video mode mimics the feel of a video call, allowing ChatGPT to interact instantly to what users present on screen.

• Project Astra: Google's Project Astra allows users to initiate a video call and the AI Gemini 2.0 responds to inquiries based on its visual observations.

• Early AI Devices: Early AI devices like the Humane Pins and the Rabbit R1 were promoted as AI voice assistants that could answer questions based on their video feed observations.

• Screen Sharing Functionality: Screen sharing allows users to open various smartphone apps and pose questions to ChatGPT about what it sees on the screen.

• Co-pilot Vision: Microsoft's Co-pilot Vision enables Pro subscribers to start a co-pilot chat while browsing, allowing it to analyze images on a web page and aid in shopping choices.

• Enterprise Applications: Businesses could harness screen sharing to optimize workflows, allowing AI agents to offer real-time feedback or recommendations based on what's displayed.

• Anthropic's Computer Use Feature: Anthropic's computer use feature proposes that AI models could move beyond mere observation to perform tasks like opening tabs and launching applications for users.

• https://www.youtube.com/watch?v=Y1VXu7W5AaM