Microsoft's new AI-first computers, featuring a CPU, GPU, and a dedicated Neural Processing Unit (NPU), are designed to run AI inference directly on the device. This allows for seamless AI integration without the latency associated with cloud-based solutions.

These computers are touted as the most powerful ever built, outperforming the latest M3 series MacBooks in various tests. The new Co-Pilot experience is designed to be a snappable app that can be placed anywhere on the screen, providing a more integrated and responsive AI assistant.

One of the key features is the Recall function, which remembers everything the user has done on the computer, including browsing history, documents, and applications used. This allows for quick retrieval and search of past activities, essentially providing a photographic memory for the user's computing experience.

Additionally, the AI-first computers enable real-time transcription and translation, allowing for seamless communication across language barriers during video calls and meetings. This feature leverages the NPU to process the audio and provide subtitles in real-time.

Overall, these AI-first computers aim to revolutionize the PC experience by deeply integrating AI capabilities directly into the hardware, enabling more responsive and personalized interactions without the need for constant internet connectivity or cloud-based processing.

Microsoft's new Co-Pilot feature is designed to be your AI-powered assistant, seamlessly integrated into your Windows 11 experience. With the ability to run AI inference directly on the device, Co-Pilot offers real-time responsiveness without the delays associated with cloud-based solutions.

The new Co-Pilot app can be easily positioned and resized on your screen, allowing you to access its capabilities whenever needed. Whether you're playing Minecraft, editing photos, or coding, Co-Pilot can provide contextual assistance, making suggestions and guiding you through tasks.

One of the standout features is the real-time transcription and translation capabilities. Co-Pilot can transcribe audio from video conferencing tools like Microsoft Teams, Zoom, or Google Meet, and provide real-time translations, breaking down language barriers and facilitating seamless communication.

The Recall feature is another powerful tool, allowing you to revisit and search through your recent computer activities, including websites visited, documents worked on, and even the steps taken while creating digital artwork. This photographic memory of your digital interactions can be a valuable resource for productivity and recollection.

Importantly, Microsoft has addressed privacy concerns by providing users with the ability to control and manage the data stored by Co-Pilot. You can choose which activities are recorded, and easily delete any unwanted snapshots or memories, ensuring your privacy is maintained.

With the integration of the Neural Processing Unit (NPU) in these new AI-first devices, Co-Pilot can leverage the dedicated hardware to run its AI models without relying on the cloud, further enhancing privacy and responsiveness. This marks a significant step forward in the evolution of personal computing, where AI assistants become seamless and ubiquitous companions.

The new Recall feature introduced by Microsoft is a game-changer for digital productivity. It essentially provides a photographic memory for your computer, allowing you to easily revisit and retrieve any content or activity from your recent history.

With Recall, you can seamlessly navigate through your past actions, from browsing websites to editing documents and images. The feature creates a comprehensive timeline of your digital activities, making it effortless to retrace your steps and find exactly what you need.

One of the standout capabilities of Recall is its ability to visually display the iterations of your work. For example, you can see the step-by-step progression of an image you edited in Microsoft Paint, allowing you to quickly identify and revert to a previous version if needed.

Moreover, Recall offers granular control over your digital footprint. If there are any activities or content you wish to remove from the memory, you can easily delete specific snapshots with a simple click, ensuring your privacy and control over your data.

The integration of Recall within the Windows 11 ecosystem further enhances its utility, seamlessly blending with the overall user experience. Whether you're a power user or someone who appreciates the convenience of having a digital assistant, Recall is poised to revolutionize the way you interact with your computer and manage your digital life.

Microsoft's new Co-Pilot feature is designed to be an AI-first computing experience, with the AI inference running directly on the device's CPU, GPU, and Neural Processing Unit (NPU). This allows for seamless AI-powered capabilities without the latency associated with cloud-based solutions.

One of the key demonstrations showcased Co-Pilot's ability to assist a first-time Minecraft player. By observing the player's actions and understanding the game environment, Co-Pilot was able to provide real-time suggestions and guidance on what the player should do next. This integration of AI-powered assistance directly within the gaming experience is a significant step forward.

Similarly, Co-Pilot was shown to be capable of enhancing photo editing workflows. By analyzing the user's edits and providing recommendations, Co-Pilot was able to help the user achieve their desired photo adjustments more efficiently. This seamless integration of AI-powered tools within the user's existing applications is a testament to Microsoft's vision for AI-first computing.

The ability to have natural language conversations with Co-Pilot, similar to the experiences demonstrated with ChatGPT, is also a key feature. Users can simply speak to Co-Pilot and receive real-time responses, without the need to connect to the cloud. This on-device AI processing enables a more responsive and privacy-focused interaction.

Overall, the capabilities showcased by Co-Pilot highlight Microsoft's commitment to bringing powerful AI tools directly to users' fingertips, without the constraints of cloud-based solutions. This represents a significant step forward in the evolution of personal computing and the integration of AI-driven experiences.

Microsoft has addressed several key privacy concerns regarding the new Co-Pilot feature and the Recall functionality:

1. Opt-out Capabilities: Users will have the ability to turn off or customize the Co-Pilot and Recall features within the Windows 11 settings. This allows users to control the level of data collection and retention.

2. No Training on User Data: Microsoft has stated that they will never train on any of the data collected by the Co-Pilot or Recall features. The AI processing is done locally on the device, without sending information to the cloud.

3. Deletion of Recorded Data: Users can manually delete any snapshots or recorded data from the Recall feature that they do not want to be retained on their device.

4. Offline Functionality: Since the AI processing is handled by the dedicated Neural Processing Unit (NPU) on the new Microsoft devices, the Co-Pilot can be used without an internet connection, further reducing privacy concerns around cloud-based data processing.

By providing users with granular control over the data collection and retention, as well as ensuring that the data is not used for training or sent to the cloud, Microsoft aims to address the primary privacy concerns raised by users. The focus on local, offline AI processing is a key strategy to mitigate privacy risks and provide users with a more secure and transparent AI experience.

Microsoft also showcased their new Surface PCs during the event. These devices feature impressive capabilities, including a new feature that allows users to draw rough sketches in Microsoft Paint, and the AI will then recreate the image in various styles, such as pixel art, watercolor, or realistic.

Additionally, the Surface laptops with the Neural Processing Unit (NPU) demonstrated significantly faster performance compared to the M3 series Macs when using Adobe Photoshop. Microsoft also highlighted their collaboration with Blackmagic Design, showcasing the AI-powered features in DaVinci Resolve, such as the AI Roto scoping tools, which were able to process the tasks quickly by leveraging the NPU instead of the GPU.

One of the most impressive demonstrations was the real-time transcription and translation capabilities. Users can have conversations over platforms like Microsoft Teams, Zoom, or Google Meet, and the system will automatically transcribe the audio in real-time and translate it to the desired language, effectively breaking down language barriers.

Overall, the new Surface PCs showcase Microsoft's commitment to integrating advanced AI capabilities into their hardware, providing users with a seamless and efficient computing experience, whether they are creating content, coding, or collaborating with others.

One of the most impressive features showcased at the Microsoft Build event was the real-time transcription and translation capabilities. The demonstration showed how people can have conversations over platforms like Microsoft Teams, Zoom, or Google Meet, and the audio will be transcribed in real-time, with the text also being translated to another language.

This feature effectively breaks down language barriers, allowing individuals to communicate seamlessly, regardless of the languages they speak. As the speaker talks in, for example, Japanese, the text below will be automatically translated to English, and vice versa. This real-time transcription and translation can be a game-changer for global collaboration and communication, making it easier for people from different linguistic backgrounds to understand each other.

The ability to have these language barriers removed, with the technology handling the translation in real-time, is a significant advancement that can greatly improve the efficiency and inclusivity of online meetings and discussions. This feature, combined with the other AI-powered capabilities showcased, such as the Co-Pilot and the Recall function, demonstrates Microsoft's commitment to pushing the boundaries of what's possible with AI integration in their products and services.

The new AI-first computers from Microsoft, with their powerful CPU, GPU, and NPU (Neural Processing Unit), represent a significant advancement in the integration of AI into personal computing. These devices are designed to run AI inference locally, eliminating the latency associated with cloud-based AI assistants.

The introduction of the revamped Microsoft Co-Pilot, which can be seamlessly integrated into Windows 11, offers users a versatile and responsive AI assistant. The ability to converse with the AI, receive real-time transcription and translation, and leverage its capabilities while gaming or working on creative tasks, showcases the potential of this technology.

The Recall feature, which allows users to easily access and manage their computer's activity history, is a powerful tool that can enhance productivity and organization. However, the privacy concerns raised by users are understandable, and Microsoft has addressed these by providing users with the ability to control and delete the data stored in the Recall feature.

Overall, the advancements presented by Microsoft in the AI and computing space are impressive and demonstrate the company's commitment to pushing the boundaries of personal computing. As the technology continues to evolve, it will be crucial for Microsoft to maintain a strong focus on user privacy and security, ensuring that the benefits of these AI-powered features are balanced with the necessary safeguards.