Limits...
Expansion of Smartwatch Touch Interface from Touchscreen to Around Device Interface Using Infrared Line Image Sensors.

Lim SC, Shin J, Kim SC, Park J - Sensors (Basel) (2015)

Bottom Line: However, the small form factor of a smartwatch limits the available interactive surface area.For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures.Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

View Article: PubMed Central - PubMed

Affiliation: Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea. soochul.lim@samsung.com.

ABSTRACT
Touchscreen interaction has become a fundamental means of controlling mobile phones and smartwatches. However, the small form factor of a smartwatch limits the available interactive surface area. To overcome this limitation, we propose the expansion of the touch region of the screen to the back of the user's hand. We developed a touch module for sensing the touched finger position on the back of the hand using infrared (IR) line image sensors, based on the calibrated IR intensity and the maximum intensity region of an IR array. For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures. The gyroscope incorporates a dynamic time warping gesture recognition algorithm for eliminating unintended touch inputs during the free motion of the wrist while wearing the smartwatch. The prototype of the developed sensing module was implemented in a commercial smartwatch, and it was confirmed that the sensed positional information of the finger when it was used to touch the back of the hand could be used to control the smartwatch graphical user interface. Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

No MeSH data available.


Practical user interface and example application of the Android smartwatch with the developed sensor module: (a) rightward swipe gesture to change the mode from the watch mode to the menu of the smartwatch; (b) downward swipe gesture to scroll to the next image in the photo gallery application of the smartwatch; (c) click gesture to execute a speed dial; (d) leftward-downward swipe gesture to operate the “back” button.
© Copyright Policy
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4541898&req=5

sensors-15-16642-f007: Practical user interface and example application of the Android smartwatch with the developed sensor module: (a) rightward swipe gesture to change the mode from the watch mode to the menu of the smartwatch; (b) downward swipe gesture to scroll to the next image in the photo gallery application of the smartwatch; (c) click gesture to execute a speed dial; (d) leftward-downward swipe gesture to operate the “back” button.

Mentions: Figure 7 shows an example of a practical user interface and application for the Android smartwatch. The screenshots show how each gesture of the user is followed. The smartwatch user interface and applications could be controlled by the developed touch interface. The user interaction consists of swipe and click gestures, which can be used to invoke a variety of functions of the developed smartwatch. The touch boundary line of the x-y position is decided by dividing the area with the amount of the graphical user interface at the calibrated pixel position and intensity, as shown in Figure 4 and Figure 5. The chosen position can be mapped to the position of the graphic user interface element during the user’s click motion. The rightward/leftward swipe gesture is assigned to scroll the menu horizontally, and the upward/downward swipe gesture is assigned to scroll vertically through the photo gallery, telephone directory, etc. For example, if the user desires to scroll through the gallery to a certain picture, the finger is used to touch the back of the hand and a downward swipe gesture is executed. The gesture sequentially scrolls to the next picture in the gallery (Figure 7a). A rightward swipe gesture is used to change the mode from the watch mode to the smartwatch menu (Figure 7b). A click gesture on the back of the hand is used to select from the menu or speed dial list, similarly to the operation of an ordinary smartphone. Each area on the back of the hand is mapped to the virtual x-y coordinates. Figure 7c shows an example of a click gesture for speed dialing. A leftward-downward swipe gesture anywhere in the user interface is used to operate the “back” button (Figure 7d).


Expansion of Smartwatch Touch Interface from Touchscreen to Around Device Interface Using Infrared Line Image Sensors.

Lim SC, Shin J, Kim SC, Park J - Sensors (Basel) (2015)

Practical user interface and example application of the Android smartwatch with the developed sensor module: (a) rightward swipe gesture to change the mode from the watch mode to the menu of the smartwatch; (b) downward swipe gesture to scroll to the next image in the photo gallery application of the smartwatch; (c) click gesture to execute a speed dial; (d) leftward-downward swipe gesture to operate the “back” button.
© Copyright Policy
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4541898&req=5

sensors-15-16642-f007: Practical user interface and example application of the Android smartwatch with the developed sensor module: (a) rightward swipe gesture to change the mode from the watch mode to the menu of the smartwatch; (b) downward swipe gesture to scroll to the next image in the photo gallery application of the smartwatch; (c) click gesture to execute a speed dial; (d) leftward-downward swipe gesture to operate the “back” button.
Mentions: Figure 7 shows an example of a practical user interface and application for the Android smartwatch. The screenshots show how each gesture of the user is followed. The smartwatch user interface and applications could be controlled by the developed touch interface. The user interaction consists of swipe and click gestures, which can be used to invoke a variety of functions of the developed smartwatch. The touch boundary line of the x-y position is decided by dividing the area with the amount of the graphical user interface at the calibrated pixel position and intensity, as shown in Figure 4 and Figure 5. The chosen position can be mapped to the position of the graphic user interface element during the user’s click motion. The rightward/leftward swipe gesture is assigned to scroll the menu horizontally, and the upward/downward swipe gesture is assigned to scroll vertically through the photo gallery, telephone directory, etc. For example, if the user desires to scroll through the gallery to a certain picture, the finger is used to touch the back of the hand and a downward swipe gesture is executed. The gesture sequentially scrolls to the next picture in the gallery (Figure 7a). A rightward swipe gesture is used to change the mode from the watch mode to the smartwatch menu (Figure 7b). A click gesture on the back of the hand is used to select from the menu or speed dial list, similarly to the operation of an ordinary smartphone. Each area on the back of the hand is mapped to the virtual x-y coordinates. Figure 7c shows an example of a click gesture for speed dialing. A leftward-downward swipe gesture anywhere in the user interface is used to operate the “back” button (Figure 7d).

Bottom Line: However, the small form factor of a smartwatch limits the available interactive surface area.For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures.Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

View Article: PubMed Central - PubMed

Affiliation: Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea. soochul.lim@samsung.com.

ABSTRACT
Touchscreen interaction has become a fundamental means of controlling mobile phones and smartwatches. However, the small form factor of a smartwatch limits the available interactive surface area. To overcome this limitation, we propose the expansion of the touch region of the screen to the back of the user's hand. We developed a touch module for sensing the touched finger position on the back of the hand using infrared (IR) line image sensors, based on the calibrated IR intensity and the maximum intensity region of an IR array. For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures. The gyroscope incorporates a dynamic time warping gesture recognition algorithm for eliminating unintended touch inputs during the free motion of the wrist while wearing the smartwatch. The prototype of the developed sensing module was implemented in a commercial smartwatch, and it was confirmed that the sensed positional information of the finger when it was used to touch the back of the hand could be used to control the smartwatch graphical user interface. Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

No MeSH data available.