Understanding the technology behind the sixth sense begins with knowing what the sixth sense is. If your goal is to understand what sixth sense is, then you are in the right place. This guide will tell you all you need to know about the sixth sense technology, so read on to find out.
The sixth sense technology has made its way into our world today and keeps getting better. It’d interest you to note that some of the science fiction movies where the display of computer screen appears on walls, commands are given by gestures, the smart digital environment which talks to us to do our work and so on were all done by the sixth sense technology. So now, what is sixth sense technology?
What is Sixth Sense Technology?
Sixth Sense is a worn gestural interface that enhances the physical world around us with digital information and lets us use hand gestures to interact with that information. It is based on the concepts of amplified reality and has well applied its insights into it. Sixth sense technology has integrated real-world objects with the digital world.
The fabulous 6th sense technology is a combination of many beautiful technologies. The thing which makes it outstanding is the excellent integration of all those technologies and presents it into a single portable and economical product. It associates technologies like hand gesture recognition, image capturing, processing, manipulation, etc. It superimposes the digital world on the real world.
Sixth sense technology is a view of the augmented reality concept. Like senses enable us to perceive information about the environment in different ways it also aims at perceiving information. The sixth sense is in fact, about comprehending information more than our available senses.
Today, there is not just this physical world from where we get information but also the digital world which has become a part of our life. This digital world is now as significant to us as this physical world. And with the internet, the digital world can be expanded many times to the physical world.
Evolution of Sixth Sense Technology
Steve Mann is considered as the founder of Sixth Sense technology, he made a wearable computer in 1990. Also, He implemented the Sixth Sense technology as the neck-worn projector with a camera system. At the time he did this, he was a media lab student.
Pranav Mistry, an Indian research assistant in MIT Media Lab continued his work. He brought up exciting new applications from this technology. Sixth sense technology was developed at media labs at MIT and coined Wear Ur World (WUW). The inventors filed a patent under the name Wear Ur World (WUW) in February 2010.
Components of Sixth Sense
- Camera – Key input device, that acts as a digital eye. Able to capture input by user gestures.
- Projector – Key output device and projects digital information from the device on the surface or wall.
- Mobile Computing device – Microsoft enabled device and used as the brain of setup. It is pre-programmed to complete the tax.
- Mirror – It reflects the projection to the perfect desirable place
- Microphone – Required when using paper. Used as a setup.
- Colored Markers – In figures, used as gestures or simply clicking images.
Why choose sixth sense technology?
Individuals make choices after acquiring inputs from the senses, for example, the sense of sight, or sense of touch. But the information we collect isn’t enough to result in the right decisions. But the information which could help to make a good decision is largely available on the internet. Although the information can be gathered by connecting devices like computers and mobiles they are restricted to the screen and there is no direct interaction between the tangible physical world and the intangible digital world.
Since the sixth sense technology uses the senses, it is able to recognize gestures. Furthermore, the gesture recognition technique basically focuses on emotion recognition from the face and hand gesture recognition.
The gesture recognition technique also enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interfaces which requires the need of a keyboard or mouse to interact with the computer. An interface that solely depends on the gestures requires precise hand pose tracking.
This sixth sense technology provides us with the liberty of communicating with the digital world with hand gestures. This technology has a wide application in the field of artificial intelligence. This methodology can aid in the synthesis of bots that will be able to interact with humans.
How does sixth sense work?
The sixth sense technology uses different technologies like gesture recognition, image processing, etc. At the moment, the commercial product isn’t launched but the model is ready. The sixth sense model is made using common and easily available equipment like a compact projector, a mirror, mobile components, color markers, and a camera.
The projector shows visual images on a surface. This surface can be a wall, table, book, or even your hand. Thus, the entire world is available on your screen now. When the user moves their hands to form different movements with colored markers on the fingertips, the camera captures these movements. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. Recognition is made using the computer vision technique. These markers act as visual tracking fiducially.
The software program processes this video stream data and interprets the movements into gestures. The gestures are different from one another and are assigned some commands. These gestures can act as input to the application that is projected by the projector. Since the projector is aligned downwards for compactness; therefore images would be formed at the user’s feet if the mirror wasn’t used. The mirror reflects the image formed by the projector to the front. The entire hardware is fabricated in the form of a pendant.
Applications of Sixth Sense
- Fingers as brush: The user can draw anything on paint with the help of his fingers. This drawing can be 3D also. Hence, no need to use a mouse.
- Capture photos with fingers: using the fingers the user can capture photos hence, no need to carry an additional gizmo. The box created by the fingers acts as a frame for capturing a photo.
- Making a call: Using this technology, there is no need to physically take out the phone to make a call. Using Sixth Sense, one can call another person in a swift and convenient manner. On using this application, the number pad is displayed on any surface the user wants. When the user positions fingers on displayed numbers, the device automatically understands the numbers that the user is signaling and dials the number without using the dialer. The dialer will be projected on the palm and the user can dial the number using their other hand.
- Read Books easily: Check out the ratings of the Book you are going to buy, it checks the ratings from the internet. And another amazing thing is that it reads the book for you.
- Video Newspapers: like the video newspapers of Harry Potter this technology identifies the news headline and then projects the relevant video.
- Check your Flight Status: Just place the ticket in front of the projector and it checks its status from the internet.
- Clock: the user just needs to make a gesture of the clock and the watch will be projected on the user’s hand.
- Access anywhere internet: the users can browse the internet on any surface even on their palm.
- Getting product information: Product information can be obtained by Sixth Sense technology because it uses image recognition or image-maker technology. As soon as the user picks up a product off the shelf, the system scans the product and feeds information such as product specification, user ratings, reviews, and other relevant information to the user.
A few of the advantages of the Sixth Sense Technology are:
- Support Multi-touch and multi-user interaction
- Cost-effective because a device cost up to $300
- We can directly access data from machines in a real-time approach
- Mind map the idea anywhere
- Open-source software
- Hardware limitations of the devices, that we currently carry with us
- For example, many phones will not permit the external camera feed to be manipulated in real-time
- Post-processing can occur sometimes
Methods of further development
Searching for substitutes for color markers would be one of the ways to further improve this device. Improving the device so that it can be used in diverse sectors like gaming, education, and entertainment will produce a greater number of consumers. For instance, an extra speaker can be added to elevate the experience.
An application that can convert gestures into sound could be developed. And this application, in turn, may be used to help people with certain disabilities communicate more effectively with others.
The problem with vision algorithms for gesture recognition can be rectified by integrating artificial intelligence (AI) with the device. This would help recognize human signals much more efficiently, and errors in misinterpretation of gestures would be greatly reduced.
In conclusion, The connection between the physical world and the digital world is a huge milestone achieved by mankind. There are many scopes of further modifications to this technology, which will in time be addressed.