You can now interact with Google Gemini to fix your writing and code, get podcast-style summaries

Google’s Gemini is getting a significant upgrade today, introducing new ways for users to interact with their documents and code through an interactive workspace called Canvas and a feature that turns files into spoken conversations called Audio Overview. This means you can now work on text and programming projects with real-time feedback and listen to summaries of your documents as if they were a podcast.For quite some time, AI has been evolving from simply answering questions to becoming a more active partner in various tasks. The introduction of Gemini’s Canvas and Audio Overview represents the next step in this evolution, aiming to make AI a more integrated and versatile tool for both creative and analytical work.

Canvas for refining your projects

Canvas provides a fresh digital space where you can directly create and refine documents or write and edit computer code. When you start a Canvas, any changes you make to the text or code appear instantly. This real-time interaction allows you to collaborate with Gemini itself and see the impact of your edits right away. As you write, Gemini can offer suggestions for improving your work, such as making a paragraph shorter or change the tone of an entire document. The tool will allow you to highlight text and ask Gemini to make it more concise, professional, or even more casual, and then also allow you to share it with others by exporting it to Google Docs.

Canvas for coding

Beyond text, Canvas also aims to simplify the process of working with code. Gemini has already shown its usefulness in programming by helping with tasks like writing code, finding errors, and explaining what code does. Now, Canvas brings all of this into a single, streamlined environment for turning coding ideas into working prototypes. Whether you’re building a website feature, a Python tool, a simple game, or a simulation, Canvas allows you to quickly create initial versions of your projects. It’s also designed to be a helpful tool for those learning to code, providing a space to experiment and see results quickly. Within Canvas, you can even generate and preview how your web-based code, like HTML and React, will look and function.

Canvas will begin to roll out today globally for those with Gemini and Gemini Advanced subscriptions.

Audio Overview for Podcast-style summarizing

Another interesting addition to Gemini is the Audio Overview feature. This feature takes your documents, presentations, and even lengthy research reports and transforms them into audio discussions, similar to a podcast. With a single click, Gemini will create a conversation between two AI voices that delve into the content of your uploaded files. They will summarize the key points, identify connections between different ideas, and offer different ways of looking at the information. This could be a valuable tool for learning and understanding complex information in a more engaging way. 

I can definitely see how these new features in Gemini could help someone who often has to review long documents or learn new coding concepts, like students, for example. The ability to listen to a summarized discussion or work on code with real-time AI assistance could also save a lot of time and make the process much more accessible. One could even prepare this in advance and listen to it while commuting to work or school. Talk about multitasking!