ChatGPT is definitely a conversational chatbot. But it also possesses the power of "vision." They aren't humanoid robots, but they are multimodal, as they can process and generate a wide variety of data. This includes the ability to read screenshots. Because ChatGPT can read and interpret images, it can not only extract text but also understand intent and return different layouts and contexts.
Some people have discovered a "hidden shortcut" to get high-quality results from ChatGPT using screenshots. While text is great, images provide spatial context, automatic formatting, and are very useful for retrieving non-selectable data that simple copy-paste operations can't collect. Use it for any type of data that you can't otherwise transfer to the clipboard.
Use ChatGPT as a troubleshooting tool to debug application and user interface issues.
Upload the bug report instead of searching on Google.
If an application crashes or displays a strange warning, take a screenshot and ask ChatGPT what it means. It can read the error code, identify the surrounding context, and suggest possible solutions. Encountering a Windows blue screen error code that looks like a code? Don't copy those long strings of technical text. Just take a screenshot and let ChatGPT troubleshoot your computer step by step.
Uploading screenshots eliminates the need to search for solutions within discussion threads. For example, ChatGPT can read the entire dialog box, including the dimmed buttons and the app name at the top. That added context often leads to more accurate, step-by-step troubleshooting advice in one place.
Take advantage of simple English language with complex online forms.
Decoding the terminology into a simple guide.
In his book "On Writing Well," William Zinsser emphasizes the importance of omitting superfluous words from each sentence, keeping only the simplest elements. Perhaps those working in large administrative agencies haven't heard of him. Online forms, especially those from banks, universities, or government services, are often filled with unclear labels. Start by taking screenshots of the forms and asking ChatGPT what a specific field means or what type of information is required. The immediate benefit is reduced guesswork and fewer visits to the counter.
You don't need to ask it what to input. Instead, ask what information the field is requesting and why it's needed. When used this way, ChatGPT becomes a translator of technical terms, not a substitute for your judgment.
Summarize dense slides and charts in seconds.
Transform dense slides into clear notes.
When you're sitting in a lecture or meeting, slides often contain scattered bullet points and small charts. Take a screenshot of the slide and ask ChatGPT to summarize it or extract the key points. This extra step can transform visual clutter into structured notes without having to remember how slide 3 connects to slide 12.
Rearranging a slide into clear bullet points necessitates a second processing layer. This can become a NotebookLM resource for later note-taking and create study materials ready for review.
Create parallel practice questions from a single example.
Turn a question into a mini-exercise.
Want to test your understanding instead of blindly following lectures or textbooks? Take a screenshot of a math, economics, or science question and ask ChatGPT to generate similar questions at the same difficulty level. You can easily replicate the practice exercises without having to search for new ones.
By creating parallel questions, you practice variety instead of memorization. You can even request a harder or easier version. That adaptability can turn a single screenshot into a focused review session.
Using ChatGPT as a tool to support accessibility for non-technical users.
Helping the elderly
Tech interfaces can be challenging, especially for older users or anyone unfamiliar with the app. Guiding older adults on how to interact with ChatGPT (and particularly the more user-friendly ChatGPT Voice) can help alleviate their tech anxiety. Teach them how to take screenshots via the Camera option and ask ChatGPT to explain the function of each section and which option is safest.
You can't always be there to guide older adults. Sometimes, let ChatGPT assist them. Also, not everyone wants a full-fledged technology lesson. Sometimes they just want to know which button to press without breaking something.