Limits...
Expansion of Smartwatch Touch Interface from Touchscreen to Around Device Interface Using Infrared Line Image Sensors.

Lim SC, Shin J, Kim SC, Park J - Sensors (Basel) (2015)

Bottom Line: However, the small form factor of a smartwatch limits the available interactive surface area.For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures.Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

View Article: PubMed Central - PubMed

Affiliation: Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea. soochul.lim@samsung.com.

ABSTRACT
Touchscreen interaction has become a fundamental means of controlling mobile phones and smartwatches. However, the small form factor of a smartwatch limits the available interactive surface area. To overcome this limitation, we propose the expansion of the touch region of the screen to the back of the user's hand. We developed a touch module for sensing the touched finger position on the back of the hand using infrared (IR) line image sensors, based on the calibrated IR intensity and the maximum intensity region of an IR array. For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures. The gyroscope incorporates a dynamic time warping gesture recognition algorithm for eliminating unintended touch inputs during the free motion of the wrist while wearing the smartwatch. The prototype of the developed sensing module was implemented in a commercial smartwatch, and it was confirmed that the sensed positional information of the finger when it was used to touch the back of the hand could be used to control the smartwatch graphical user interface. Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

No MeSH data available.


Measurement results of (a) IR intensity (upper sensor), (b) IR intensity (lower sensor), (c) peak pixel position (upper sensor), and (d) peak pixel position (lower sensor).
© Copyright Policy
Related In: Results  -  Collection

License
getmorefigures.php?uid=PMC4541898&req=5

sensors-15-16642-f004: Measurement results of (a) IR intensity (upper sensor), (b) IR intensity (lower sensor), (c) peak pixel position (upper sensor), and (d) peak pixel position (lower sensor).

Mentions: To measure the peak position and the IR intensity at each position on the back of the hand, we used a six-degree-of-freedom (6-DoF) industrial robot (VP-6242G, Denso, Nagoya, Japan). The robot can be controlled with a resolution of 1 mm and the peak position and IR intensity could therefore be measured at each exact position on the back of the hand. The measurement setup is shown in Figure 3. The developed smartwatch was placed on a prototype hand, and the peak positions and IR intensities were measured when the robot used a tip with a diameter of 12 mm to touch the back of the mockup hand. The tip was moved over the back of the hand and the peak position and IR intensity at each position were measured with a resolution of 1 mm. Figure 4 shows the raw data of the peak position and maximum IR intensity of the signal from the IR line image sensor. Figure 4a,b shows the maximum IR intensities of the upper and lower sensors for each robot tip position. The line sensor receives the light reflected by the finger, and the acquired data has nonlinear characteristics. In Figure 4a,b the intensity at the center in the y direction is higher than those in the side areas at the same distance from the smartwatch (same tip position in the x direction) because the viewing angles of the two IR emitters overlapped. Figure 4c,d show the pixel positions with the maximum IR intensity of the signal from the IR line sensor for each robot tip position. The pixel position of the maximum IR intensity for a given x position increased with increasing y position on the back of the hand. These linear characteristics can be used to determine the y position touched by the finger.


Expansion of Smartwatch Touch Interface from Touchscreen to Around Device Interface Using Infrared Line Image Sensors.

Lim SC, Shin J, Kim SC, Park J - Sensors (Basel) (2015)

Measurement results of (a) IR intensity (upper sensor), (b) IR intensity (lower sensor), (c) peak pixel position (upper sensor), and (d) peak pixel position (lower sensor).
© Copyright Policy
Related In: Results  -  Collection

License
Show All Figures
getmorefigures.php?uid=PMC4541898&req=5

sensors-15-16642-f004: Measurement results of (a) IR intensity (upper sensor), (b) IR intensity (lower sensor), (c) peak pixel position (upper sensor), and (d) peak pixel position (lower sensor).
Mentions: To measure the peak position and the IR intensity at each position on the back of the hand, we used a six-degree-of-freedom (6-DoF) industrial robot (VP-6242G, Denso, Nagoya, Japan). The robot can be controlled with a resolution of 1 mm and the peak position and IR intensity could therefore be measured at each exact position on the back of the hand. The measurement setup is shown in Figure 3. The developed smartwatch was placed on a prototype hand, and the peak positions and IR intensities were measured when the robot used a tip with a diameter of 12 mm to touch the back of the mockup hand. The tip was moved over the back of the hand and the peak position and IR intensity at each position were measured with a resolution of 1 mm. Figure 4 shows the raw data of the peak position and maximum IR intensity of the signal from the IR line image sensor. Figure 4a,b shows the maximum IR intensities of the upper and lower sensors for each robot tip position. The line sensor receives the light reflected by the finger, and the acquired data has nonlinear characteristics. In Figure 4a,b the intensity at the center in the y direction is higher than those in the side areas at the same distance from the smartwatch (same tip position in the x direction) because the viewing angles of the two IR emitters overlapped. Figure 4c,d show the pixel positions with the maximum IR intensity of the signal from the IR line sensor for each robot tip position. The pixel position of the maximum IR intensity for a given x position increased with increasing y position on the back of the hand. These linear characteristics can be used to determine the y position touched by the finger.

Bottom Line: However, the small form factor of a smartwatch limits the available interactive surface area.For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures.Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

View Article: PubMed Central - PubMed

Affiliation: Device & System Research Center, Samsung Advanced Institute of Technology, 130 Samsung-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do 443-803, Korea. soochul.lim@samsung.com.

ABSTRACT
Touchscreen interaction has become a fundamental means of controlling mobile phones and smartwatches. However, the small form factor of a smartwatch limits the available interactive surface area. To overcome this limitation, we propose the expansion of the touch region of the screen to the back of the user's hand. We developed a touch module for sensing the touched finger position on the back of the hand using infrared (IR) line image sensors, based on the calibrated IR intensity and the maximum intensity region of an IR array. For complete touch-sensing solution, a gyroscope installed in the smartwatch is used to read the wrist gestures. The gyroscope incorporates a dynamic time warping gesture recognition algorithm for eliminating unintended touch inputs during the free motion of the wrist while wearing the smartwatch. The prototype of the developed sensing module was implemented in a commercial smartwatch, and it was confirmed that the sensed positional information of the finger when it was used to touch the back of the hand could be used to control the smartwatch graphical user interface. Our system not only affords a novel experience for smartwatch users, but also provides a basis for developing other useful interfaces.

No MeSH data available.