Copilot Labs

Copilot Labs allows us to test and learn in a limited preview environment, to trial new experiences, gather feedback, and refine them before a wider release.

A limited number of Copilot Pro subscribers in select countries will see the ‘Copilot Labs’ label on select features, beginning this Fall.

Go to copilot.microsoft.com and in the conversation with Copilot, simply tap the ‘Think Deeper’ button before submitting your prompt to experience the power of this new capability.

Think Deeper is currently available in all markets that have Copilot Pro.

Copilot Pro supports Arabic, Chinese Simplified, Czech, Danish, Dutch, English, Finnish, French, German, Hebrew, Hungarian, Italian, Japanese, Korean, Norwegian, Polish, Portuguese, Russian, Spanish, Swedish, Thai, and Turkish. Learn more about languages supported in Copilot.

Usage of Think Deeper is limited by a weekly number of messages. The exact amount depends on how many other Copilot Pro subscribers are using the feature at the same time. You will get a message when capacity is not available or when you have reached your limit for the week.

Copilot Vision is a user-initiated experience. You decide when and how to use it. Users initiate a session when in the Edge browser, by clicking the Vision button on the new Copilot Composer. Throughout the session, the Composer and browser tab clearly indicate that Copilot can see your page and is listening to you. You can turn Copilot Vision on or off at any time, and it will automatically stop after 5 minutes of inactivity.

Copilot Vision will be accessible to Copilot Pro users who agree to the terms and are signed into their Microsoft Account. We will gradually roll out Copilot Vision, starting with a limited number of Copilot Pro subscribers in the United States.

Copilot Vision uses the text and pixels on a website to enhance and elevate a user’s experience with the website. The goal of this feature is to help users gain more from their web browsing experience and we expect users to end up spending more time on websites as a result. Copilot Vision uses only the website a user is looking at to answer questions or drive discussions. It does not click into other websites on a user’s behalf, nor does it prevent them from doing so.

Copilot Vision will come to Copilot Labs in the future to a limited number of Copilot Pro subscribers in the United States. Copilot Labs allows us to test and learn in a limited preview environment and trial new experiences, gather feedback, and refine them before a wider release. We have taken important steps to put boundaries on the types of websites Copilot Vision can engage with and are starting with a limited list of popular websites.

Microsoft continues to assess Copilot Vision as part of Microsoft’s multi-step Responsible AI process. This process applies a holistic approach to safety evaluations that include scalable machine evaluations, human annotated safety evaluations, and adversarial red teaming, with a particular focus on responsible AI issues.

Copilot Vision will log Microsoft standard diagnostic data such as crash information or networking errors to debug issues and improve the product. Microsoft will not disclose or use data for any purpose other than to provide the experience. Microsoft will not train the generative AI models in Copilot Vision on your conversations or interactions with the feature during this preview.

During Copilot Vision preview in Copilot Labs, we have taken important steps to put boundaries on the types of websites Copilot Vision can engage with. We are starting with a limited list of popular websites to ensure it’s a safe experience for everyone. Copilot Vision honors website controls for usage of their content by Copilot.

No training on webpages: Copilot Vision processes webpage text and images viewed by the user in real-time and then discards the result at the end of the user session. Microsoft will not train the generative AI models in Copilot on your conversations or interactions with the feature during this preview.

We have taken important steps to put boundaries on the types of websites Copilot Vision can engage with and are starting with a limited list of popular websites. Additionally, we’ve programmed Copilot Vision to not provide responses based on paywalled content.

Microsoft respects the machine-readable directions provided by websites that do not want content on their pages to be used with our generative AI models.