Since we first announced the new consumer Copilot in October, we have loved seeing the ways people have made Copilot their own. It has helped people think through their ideas and get a fresh perspective, has made it less overwhelming to find the right information, and has even helped people feel supported when navigating difficult conversations. In the last few weeks, we have taken our users’ feedback and worked to further improve the speed, simplicity, and personality of Copilot and its Voice to make it a more helpful AI companion.
With this goal in mind, starting today, we are introducing an experience where – with your permission – Copilot can now understand the full context of what you’re doing online. When you choose to enable Copilot Vision, it sees the page you’re on, it reads along with you, and you can talk through the problem you’re facing together. Browsing no longer needs to be a lonely experience with just you and all your tabs. We are taking the first step to make this a reality by rolling out Copilot Vision as a preview for a limited number of Pro subscribers through Copilot Labs.
Vision is the first AI experience of its kind, available only on Microsoft Edge. It is a new way to invite AI along with you as you navigate the web, tucked neatly into the bottom of your Edge browser whenever you want to ask for help. It’s almost like having a second set of eyes as you browse, just turn on Copilot Vision to instantly scan, analyze, and offer insights based on what it sees.
For example, imagine having it help you plan a fun day at a museum, pointing out all the information you need to know before you visit.
Or maybe Vision could help with your holiday shopping by pointing out which products you see on a page that match your needs and preferences.
Vision could even simplify information and learning. Watch Vision help us learn how to play a new game, like Geoguessr.
Your Privacy Matters
As we’ve built Copilot Vision, we have made your security, control and privacy the top priority. To start, Vision is entirely opt-in, so you decide when to turn it on as your second set of eyes on the web. In addition, once you end a session with Vision, all data about what you say and the context you share with Copilot is deleted. Every time you use Vision, your data is handled and protected in accordance with the Microsoft Privacy Statement. Only Copilot’s responses are logged to improve our safety systems.
Early Feedback
Vision is still an experimental experience. As we roll this out, Vision will only interact with a select set of websites to start. Over time, we will cautiously expand this list. It’s important to stress that Vision does not capture, store or use any data from publishers to train our models. In short, we’re prioritizing copyright, creators, and our user’s privacy and safety – and are putting them all first.
We’re encouraged by early feedback, working closely with a group of impartial testers outside of Microsoft, to help us make this a useful and safe experience right out of the gate. Some of those we’ve collaborated with are third-party publishers, who help us understand how Vision could be used to help people better engage and make decisions on their pages. These inputs will help us design Vision to be more helpful in how it interacts with web pages.
Availability
We are rolling Vision out carefully, coming first to a limited number of Copilot Pro subscribers in the United States, through Copilot Labs. As mentioned, Vision will only work on a select set of websites initially. We’re taking our time to gather feedback, iterate on the technology, and will expand access to more Pro subscribers and more websites over time.
Thank you again to everyone using Copilot and sharing feedback on what’s working, and what can be improved. It’s how we will make AI more supportive and truly helpful. Join us on this journey: learn about Copilot Labs, or see what you can already do today with Copilot in Edge, or Copilot on iOS, Android and other social apps.
