Google Lens Explained

Google Lens
Google Lens
Developer:Google
Operating System:Android, iOS, Microsoft Windows, macOS, ChromeOS, Linux
Included With:Google Pixel phones
Replaces:Google Goggles
Language:Lens is able to translate text into most languages supported by Google Translate. Shopping results are available in Austria, Australia, Belgium, Brazil, Canada, Chile, Colombia, Czech Republic, Denmark, France, Germany, India, Indonesia, Ireland, Italy, Japan, Malaysia, Mexico, Netherlands, New Zealand, Norway, Philippines, Poland, Portugal, Russia, Singapore, South Africa, South Korea, Spain, Sweden, Switzerland, Turkey, UAE, United Kingdom, and the United States.
Language Footnote:[1]

Google Lens is an image recognition technology developed by Google, designed to bring up relevant information related to objects it identifies using visual analysis based on a neural network.[2] First announced during Google I/O 2017,[3] it was first provided as a standalone app, later being integrated into Google Camera but was reportedly removed in October 2022.[4] It has also been integrated with the Google Photos and Google Assistant app and with Bard (now Gemini) as of 2023.[5]

Features

Lens

When directing the phone's camera at an object, Google Lens will attempt to identify the object by reading barcodes, QR codes, labels and text, and show relevant search results, web pages, and information.[6] For example, when pointing the device's camera at a Wi-Fi label containing the network name and password, it will automatically connect to the scanned Wi-Fi network. Lens can also use images to identify text and can find results from Google Search or translate the text with Google Translate in augmented reality.[7] Lens is also integrated with the Google Photos and Google Assistant apps.

The service originally launched as Google Goggles, a previous app that functioned similarly but with less capability.[8] [9] Lens uses more advanced deep learning routines in order to empower detection capabilities, similar to other apps like Bixby Vision (for Samsung devices released after 2016) and Image Analysis Toolset also known as IAT (available on Google Play); During Google I/O 2019, Google announced four new features. The software will be able to recognize and recommend items on a menu. It will have the ability to also calculate tips and split bills, show how to prepare dishes from a recipe and can use text-to-speech.[10]

Circle to Search

On January 17, 2024, Samsung Electronics and Google announced Circle to Search,[11] a new feature that allows users to search the web by tapping on circling images that features Lens integration, the feature was originally just on Samsung Galaxy S24 and the Pixel 8, but expanded on other phones of those products,[12] as well as the iOS operating system (via the Google app) and the Google Chrome web browser (albeit known as Search with Lens).[13] [14]

Availability

Google officially launched Google Lens on October 4, 2017, with app previews pre-installed into the Google Pixel 2,[15] not yet widely available for other devices. In November 2017, the feature began rolling out into the Google Assistant for Pixel and Pixel 2 phones[16] A preview of Lens has also been implemented into the Google Photos app for Pixel phones.[17] On March 5, 2018, Google officially released Google Lens to Google Photos on non-Pixel phones.[18] Support for Lens in the iOS version of Google Photos was made on March 15, 2018.[19] Beginning in May 2018, Google Lens was made available within Google Assistant on OnePlus devices[20] as well as being integrated into camera apps of various Android phones.[21] A standalone Google Lens app was made available on Google Play in June 2018. Device support is limited, although it is not clear which devices are not supported or why. It requires Android Marshmallow (6.0) or newer.[22] On December 10, 2018, Google rolled out the Lens visual search feature to the Google app for iOS.[23] In 2022, Google Lens gradually replaced the reverse image search functionality of Google Images, first by replacing it in Google Chrome and later by making it officially available as a web application.[24] A July 2023 update to Google's chatbot Bard integrated Google Lens, allowing users to contextualize their prompts by uploading images and adding image retrieval functionality.[25]

Notes and References

  1. Web site: Google Lens . Google Lens Homepage . June 24, 2019.
  2. Web site: Google Lens app gets two new features. The Times of India.
  3. News: Forget rainbow vomit, Google Lens is AR you can actually use. Nieva. Richard. May 18, 2017. CNET. July 4, 2017.
  4. Web site: Schoon . Ben . 13 December 2022 . Pixel phones lost a handy Google Lens shortcut – here’s how you can still access it quickly . 9to5Google.
  5. News: Google Lens is Google's future. Townsend. Tess. May 19, 2017. Recode. July 4, 2017.
  6. News: Google Lens can use your phone's CAMERA to do operations based on virtual analysis, like connecting your phone to a WiFi network. Villas-Boas. Antonio. May 16, 2017. Business Insider. July 4, 2017.
  7. Web site: Li . Abner . 5 December 2022 . Google Lens replaces Google Translate’s camera mode on Android and iOS . 9to5Google.
  8. News: Google Lens is a powerful, AI-driven visual search app. Conditt. Jessica. May 17, 2017. Engadget. July 4, 2017.
  9. News: Google Lens: Everything you need to know. Dobie. Alex. October 6, 2017. Android Central. June 5, 2018. en.
  10. Web site: Google just showed off 4 major updates to its futuristic Lens technology that anyone who goes out to restaurants will love. Villas-Boas. Antonio. Business Insider. 2019-05-11.
  11. Web site: 2024-01-17 . Google reveals Circle to Search function for enhanced searching . 2024-05-08 . Shacknews . en.
  12. Web site: Google's Circle to Search Is Coming to a Bunch of Other Pixel Devices . 2024-05-08 . CNET . en.
  13. Web site: Vonau . Manuel . 2024-03-22 . What’s new in Chrome 124: Changes to local password storage . 2024-05-08 . Android Police . en.
  14. Web site: Li . Abner . 2024-05-08 . Google effectively brings Android's Circle to Search to any iPhone with new Lens shortcut . 2024-05-08 . 9to5Google . en-US.
  15. News: Pixel 2 Owners Get the First Glimpse of Google Lens Computer Vision Possibilities. Grigonis. Hillary. October 4, 2017. Digital Trends. October 13, 2017.
  16. News: Google Lens now more widely rolling out in Assistant on Pixel, Pixel 2 [Gallery]]. Li. Abner. November 27, 2017. 9to5Google. November 29, 2017. en-US.
  17. News: Google Lens starts rolling out to 2016 Pixel phones. Ong. Thuy. October 24, 2017. The Verge. October 25, 2017.
  18. News: Google Lens is coming to all Android phones running Google Photos. The Verge. 2018-03-06.
  19. News: Google Lens is now available on iOS. Ong. Thuy. March 16, 2018. The Verge. March 16, 2018.
  20. News: OnePlus Phones Now Getting Google Lens Feature in Google Assistant. Patel. Nilen. March 28, 2020. Google Gadgets360.com. March 28, 2020.
  21. News: Google integrates into new camera app. Solsman. Joan. May 8, 2018. CNET. May 8, 2018. en.
  22. News: Google Lens is now available as a standalone app. Liao. Shannon. June 4, 2018. The Verge. June 5, 2018.
  23. News: Google Lens visual search now rolling out to Google app for iOS. Li. Abner. December 10, 2018. 9to5Google. December 11, 2018.
  24. Web site: Google Chrome drops right-click reverse image search in favor of Lens. March 21, 2022. Android Police.
  25. Web site: Google Images on the web now uses Google Lens. Li. Abner. August 10, 2022. 9to5Google. August 17, 2022.