Phonandroid : actu Android et High-tech

Samsung: what if the smartphone's selfie sensor turns your table into a keyboard?

At CES in Las Vegas, to be held next week, Samsung will showcase several technologies, one of which allows you to use a table or other flat surface as a virtual keyboard. Its name is SelfieType. And it easily fits any device with a webcam.

samsung selfietype

Samsung will attend CES in Las Vegas next week. If two smartphones are expected, the Galaxy Note 10 Lite and Galaxy S10 Lite, the Korean company should take the opportunity to also disclose the tips from its two project incubation programs, C-Lab Inside and C-Lab Outside. Nine projects will be unveiled. All use innovative technologies, but do not necessarily concern mobile telephony. Some are aimed at the home automation market, while others are for connected accessories.

Our two favorite projects are called SelfieType and Hyler. The first illustrates this article. It is a software function which can, theoretically, adapt to all devices fitted with a webcam. The principle is simple: you place the device in front of you and you tap any flat surface as if you had a keyboard under your fingers. And, what you type appears on the screen. The system now works with Qwerty keyboards. But in theory, it works with any type of keyboard.

For this to work, SelfieType therefore uses the webcam to capture in real time the position of the fingers and their movements. Knowing where your fingers are and which moves, the software, boosted by artificial intelligence, deduces the numbers and letters entered by the user. The beauty of the system is that it only requires a webcam and not a system developed like Face ID from Apple or Kinect from Microsoft. In addition, it works with all surfaces.

A function that would go well with the S-Pen

The second project that caught our attention is called Hyler. It is a hardware and software solution. Hyler is a smart highlighter. You highlight text printed on paper with Hyler as with traditional stabylo. And the system automatically scans the sentences to enter them in an application installed on the phone or tablet. You can also start a search on your smartphone from the text you have selected.

Read also: Samsung will integrate a camera in the Galaxy Note S-Pen to avoid the hole in the screen

The advantage of this technology for Samsung is certainlyenrich the services offered by the S-Pen in the medium term Galaxy Tab (see Galaxy Note). Of course, this will require adaptation to the tip of the accessory. But it will be the only one, since the current S-Pen is already equipped with everything you need: accelerator, gyroscope, Bluetooth, etc. maybe come with the successor of the Galaxy Note 10?