Microsoft’s Copilot Enters a New Era of AI with Personalized and Visual Capabilities

In celebration of its 50th anniversary, Microsoft has rolled out a series of powerful new upgrades to its AI-driven assistant, Copilot. The chatbot is now equipped with expanded capabilities, allowing it to interact with most websites and take action such as booking tickets or making dining reservations. It can also retain personal preferences like your favorite foods or films, and has been enhanced with visual intelligence, enabling it to analyze real-time video from your phone’s camera and answer related questions.

These updates arrive amid reports that Microsoft is considering a broader overhaul of Copilot. Traditionally powered by OpenAI’s models, the assistant could soon rely more on Microsoft’s own AI technology. While Copilot has often trailed behind tools like ChatGPT and Google’s Gemini, this latest wave of enhancements signals an effort to catch up and potentially lead in the AI space.

As of now, Copilot can carry out web-based tasks in a manner similar to agent-like tools such as OpenAI’s Operator. Microsoft has partnered with platforms including Expedia, OpenTable, Booking.com, Tripadvisor, and several others to ensure the assistant can handle real-world requests from day one. For example, a simple command like sending flowers to a loved one will prompt Copilot to begin the process online.

Additionally, Copilot now helps users monitor prices and sales across the web, providing alerts when deals are found and linking directly to purchase pages. However, Microsoft hasn’t disclosed much about how these functions operate in detail or what limitations exist. Like with other AI agents, some websites might choose to block Copilot from interacting with their platforms.

Other updates are more straightforward. Copilot now creates interactive audio summaries resembling podcasts, featuring AI-generated hosts who can be interrupted and asked questions mid-dialogue. On mobile devices, the assistant can interpret what’s visible through your camera or photo gallery, while the Windows version will soon be able to assist with desktop tasks like file organization and settings adjustments. These features will first roll out to Windows Insider users.

Microsoft also introduced new tools like Pages, a workspace for consolidating projects, and Deep Research, which scours various sources to address complex queries. Copilot’s memory functions have also been expanded to offer more personalized interactions, though users can review, delete, or opt out of this feature entirely to maintain control over their data.