Search
Close this search box.

New AI-Powered Innovations for Copilot+ PCs and Windows 11

New AI-Powered Innovations for Copilot+ PCs and Windows 11

Analyst(s): Keith Kirkpatrick
Publication Date: October 7, 2024

Microsoft is introducing new AI-driven features to Copilot+ PCs and Windows 11, designed to simplify everyday tasks and enhance security. Key innovations include Recall, Click to Do, improved Windows Search, and Super Resolution in Photos. These updates highlight the company’s commitment to AI-driven productivity and privacy, empowering users with smarter, faster computing.

What is Covered in this Article:

  • Overview of new AI features in Copilot+ PCs
  • Introduction to Recall, Click to Do, and Super Resolution
  • The expanded ecosystem of native apps for Arm-based Copilot+ PCs
  • Predictions for future market impact and technology trends

The News: Microsoft is expanding the capabilities of Copilot+ PCs and Windows 11 with new AI-powered features. These innovations include the Recall tool, which allows users to securely retrieve previously viewed content, and Click to Do, which overlays contextual quick actions to simplify workflows.

Additional enhancements, such as improved Windows Search, Super Resolution for photos, and new AI tools in Paint, will further enhance productivity and creativity. Starting in November, these features will roll out to Windows Insider users, with broader availability planned soon. The updates align with Microsoft’s vision of integrating AI to transform the computing experience while maintaining strong security and privacy measures.

New AI-Powered Innovations for Copilot+ PCs and Windows 11

Analyst Take: The latest AI-driven updates to Copilot+ PCs and Windows 11 represent a significant leap forward in personal computing. Microsoft is addressing the growing demand for seamless, intelligent workflows by enhancing productivity tools such as Recall and Click to Do. The inclusion of high-performance AI features, such as Super Resolution in Photos and AI-powered Paint tools, caters to both casual users and professionals, adding value across different user groups.

Moreover, these innovations’ focus on security and privacy reflects Microsoft’s commitment to protecting user data as AI becomes more pervasive. These updates will likely drive the adoption of Copilot+ PCs, especially as more native apps become available for Arm-based systems, positioning Microsoft as a leader in the AI-enabled PC market.

The Emergence of AI in Personal Computing

Microsoft has consistently pushed the boundaries of AI by integrating it into their products, and the Copilot+ PCs, launched earlier this year, were a significant milestone in this journey. These PCs, built with AI at their core, offer users a more intelligent and efficient experience, allowing them to complete tasks faster and with greater accuracy. As the demand for smarter devices grows, Microsoft continues to enhance its AI-powered features, making Copilot+ PCs the most secure and powerful Windows devices on the market.

Key AI-Driven Features in Copilot+ PCs

Several new features have been announced, each aimed at enhancing productivity, security, and ease of use. These features are designed to make Copilot+ PCs more intuitive and capable of handling everyday tasks with minimal user input.

1. Recall (Preview)

Recall is an innovative tool that allows users to instantly find any content they have previously viewed on their PC. Unlike traditional search tools, Recall is optimized for security, ensuring that sensitive information remains protected. Users can opt-in to save snapshots and use Windows Hello to confirm their identity before accessing Recall. Additionally, a sensitive information filter automatically obscures confidential data, such as credit card details or personal identification numbers.

This feature is currently being rolled out to Windows Insiders on Snapdragon-powered Copilot+ PCs, with Intel and AMD-powered devices expected to receive it later in the year. The integration of enhanced security measures makes Recall an essential tool for users working with sensitive information, offering both convenience and peace of mind.

2. Click to Do (Preview)

This feature overlays contextual quick actions directly onto the user’s screen. This feature simplifies workflows by providing relevant suggestions, such as image editing options such as background blur or object removal in Photos, or text-related actions such as summarization or rewriting. Users can also initiate web searches, send emails, or open websites with just a few clicks without leaving their current screen.

Click to Do is context-aware and accessible from any screen on a Copilot+ PC. This feature enhances productivity by reducing the number of steps required to complete tasks, allowing users to stay focused on their work.

3. Improved Windows Search

Users can now search for files, photos, and settings using everyday language, eliminating the need to remember file names or locations. The AI-powered search tool can even find photos stored in OneDrive by analyzing their content. This feature is powered by the same 40+ TOPS NPU that drives many other AI-enabled features in Copilot+ PCs.

4. Super Resolution in Photos

This tool uses AI to upscale lower-resolution images up to 4K without compromising quality. Users can enhance their photos by simply adjusting a slider transforming old or blurry images into sharp, high-quality visuals. Super Resolution is particularly useful for those who regularly work with digital images. It offers a fast and efficient way to improve image quality without requiring specialized software.

5. Generative Fill and Erase in Paint

With the introduction of Generative Fill and Erase, Microsoft Paint allows users to add or remove elements from their images with precision, giving them greater creative freedom. The updated diffusion-based model ensures that the results are both faster and more accurate than previous versions. Including these tools in Paint aligns with Microsoft’s vision of making advanced AI tools accessible to all users, regardless of their technical expertise.

Expanding the Ecosystem: More Apps for Arm-Based Copilot+ PCs

As Copilot+ PCs continue to evolve, Microsoft is also expanding the range of native apps available for Arm-based Copilot+ PCs. Popular applications such as Chrome, Zoom, Spotify, and Adobe’s Creative Suite are already compatible with Windows on Arm, offering users a diverse range of tools for productivity, entertainment, and security.

In the coming months, more apps, including Vegas Pro, Fantastical, and Sketchbook Pro are expected to join the lineup. This expansion highlights Microsoft’s commitment to providing users with a comprehensive ecosystem of applications that fully exploit the Copilot+ PC’s AI capabilities.

The target market includes creative professionals, businesses, and everyday users. Creative apps such as Adobe Creative Suite and Vegas Pro will leverage AI capabilities in content creation. At the same time, businesses benefit from enhanced productivity, such as instantly finding previous documents without complex searches (through Recall) and security features. With more apps coming, signups are expected to rise as users seek powerful, AI-driven devices for work and creativity.

Looking Ahead: AI-Driven Innovation and Security

Microsoft’s vision for the future of computing is firmly rooted in AI-driven innovation. As the technology landscape continues to evolve, the company remains committed to ensuring that its products are both cutting-edge and secure. Copilot+ PCs have advanced security features that protect user data, ensuring that AI tools can be used safely in everyday life.

By integrating AI into every aspect of the Windows 11 experience, Microsoft is empowering users to work smarter, not harder. The use of copilots within its core Windows experience is also useful in two additional ways. First, usage data captured from these users can be used as a proxy for enterprise users of Microsoft Dynamics 365, which are also seeing the rollout of AI features. Second, the additional utilization of copilots within a consumer experience will further drive familiarity with generative AI, and make users more comfortable with the technology in a business experience as well.

What to Watch:

  • Apple and Google’s AI advancements in their OS and hardware ecosystems.
  • Expansion of AI capabilities in mobile chipsets from Qualcomm and AMD to further integrate into Windows PCs.
  • Increasing partnerships between PC manufacturers and AI software developers to offer enhanced native applications.
  • Adoption trends in enterprises seeking secure AI-powered devices to streamline workflows and maintain data protection.
  • Regulatory scrutiny over AI tools and how security and privacy concerns might shape future innovations.

See the complete blog post of the new experiences coming to Copilot + PCs and Windows 11 on the Microsoft website.

Disclosure: The Futurum Group is a research and advisory firm that engages or has engaged in research, analysis, and advisory services with many technology companies, including those mentioned in this article. The author does not hold any equity positions with any company mentioned in this article.

Analysis and opinions expressed herein are specific to the analyst individually and data and other information that might have been provided for validation, not those of The Futurum Group as a whole.

Other insights from The Futurum Group:

HPE Smartens Aruba Networking Central with AI to Scintillate Hybrid Clouds

Adobe’s Holiday E-commerce Forecast: GenAI and Its Impact on Shopping Behavior

NetApp Insight 2024: Making Waves with AI

Author Information

Keith has over 25 years of experience in research, marketing, and consulting-based fields.

He has authored in-depth reports and market forecast studies covering artificial intelligence, biometrics, data analytics, robotics, high performance computing, and quantum computing, with a specific focus on the use of these technologies within large enterprise organizations and SMBs. He has also established strong working relationships with the international technology vendor community and is a frequent speaker at industry conferences and events.

In his career as a financial and technology journalist he has written for national and trade publications, including BusinessWeek, CNBC.com, Investment Dealers’ Digest, The Red Herring, The Communications of the ACM, and Mobile Computing & Communications, among others.

He is a member of the Association of Independent Information Professionals (AIIP).

Keith holds dual Bachelor of Arts degrees in Magazine Journalism and Sociology from Syracuse University.

SHARE:

Latest Insights:

Despite Year-To-Year Revenue Decline, GlobalFoundries Builds Momentum With Strategic Partnerships and Growth in High-Demand Sectors
Bob Sutor, VP and Practice Lead for Emerging Technologies at The Futurum Group, discusses GlobalFoundries’ Q3 2024 earnings, with key partnerships in automotive and AI sectors and industry-wide pressures and challenges in the semiconductor market.
Kyndryl’s Growth Fueled by Strategic Alliances, AI-Powered Delivery, and Margin-Expanding Initiatives
Camberley Bates, Chief Technological Advisor at The Futurum Group, analyzes Kyndryl’s Q2 FY25 earnings. Focused on strategic growth through alliances, AI-enabled platforms, and margin expansion initiatives.
Empowering Mainframes for the Hybrid Cloud Era with Open-Source Innovation
Steven Dickens shares his insights on The Open Mainframe Project leading the charge around open-source capabilities on mainframes, particularly through Zowe, an open-source tool for hybrid-friendly interfaces and DevOps integration. With Broadcom now offering free enterprise support for Zowe, mainframe environments can connect more seamlessly with cloud-native applications, safe in the knowledge that they have support from a proven vendor.
Daniel Newman and Patrick Moorhead share insights on Qualcomm, IBM, and SAP, leading AI innovation in enterprise tech, with insights into Qualcomm's Snapdragon Summit, IBM's Granite 3.0 AI models, and SAP's cloud-powered ERP solutions.