Tag Archives: HMI

Profile of an IoT processor for the industrial and consumer markets


 If there’s a single major stumbling block that is hindering the IoT take-off at the larger industrial scale, it’s security.


The intersection of data with intelligent machines is creating new possibilities in industrial automation, and this new frontier is now being increasingly known as the Industrial Internet of Things (IIoT). However, if there is a single major stumbling block that is hindering the IoT take-off at the larger industrial scale, it’s security.

It’s imperative to have reliable data in the industrial automation environment, and here, the additional security layers in the IoT hardware often lead to compromises in performance. Then, there is counterfeiting of products and application software, which is becoming a growing concern in the rapidly expanding IoT market.

sama5d2_google_1160x805_090215

Atmel’s answer to security concerns in the IIoT infrastructure: a microprocessor (MPU) that can deliver the security while maintaining the level of performance that Internet-connected systems require. The company’s Cortex A5 chip — the Atmel | SMART SAMA5D4 — securely stores and transfers data, as well as safeguards software assets to prevent cloning of IoT applications.

The SAMA5D4 series of MPUs enables on-the-fly encryption and decryption of software code from the external DRAM. Moreover, it boasts security features such as secure boot, tamper detection pins and safe erasure of security-critical data. The A5D4 processor also incorporates ARM’s system-wide security approach, TrustZone, which is used to secure peripherals such as memory and crypto blocks. TrustZone —comprising of security extensions that can be implemented in a number of ARM cores — is tightly integrated into ARM’s Cortex-A processors. It runs the processor in two different modes: First, a secure environment executes critical security and safety software, and secondly, a normal environment runs the rich OS software applications such as Linux. This lets embedded designers isolate critical software from OS software.

The system approach allows control access to CPU, memories, DMA and peripherals with programmable secure regions. That, in turn, ensures that on-chip parts like CPU and off-chip parts like peripherals are protected from software attacks.

Trust

Performance Uplift

The Atmel SMART | SAMA5D4 processor is based on the Cortex-A5, the smallest and simplest of the Cortex-A series cores that support the 32-bit ARMv7 instruction set. It’s targeted at applications requiring high-precision computing and fast signal processing — that includes industrial and consumer applications such as control panels, communication gateways and imaging terminals.

The use cases for SAMA5D4 span from kiosks, vending machines and barcode scanners, to smart grid, communications gateways and control panels for security, home automation, thermostats, etc. Atmel’s MPU features peripherals for connectivity and user interface applications. For instance, it offers a TFT LCD controller for human-machine interface (HMI) and control panel applications and a dual Ethernet MAC for networking and gateway solutions.

Apart from providing high-grade security, SAMA5D4 adds two other crucial features to address the limitations of its predecessor, SAMA5D3 processor. First, it uplifts performance through ARM’s NEON DSP engine and 128kB L2 cache. The NEON DSP with 128-bit single instruction, multiple data (SIMD) architecture accelerates signal processing for more effective handling of multimedia and graphics. Likewise, L2 cache enhances data processing capability for imaging applications.

The second prominent feature of the SAMA5D4 is video playback that boasts 720p resolution hardware video decoder with post-image processing capability. Atmel’s embedded processor offers video playback for H.264, VP8 and MPEG4 formats at 30fps.

A Quick Overview of the SAMA5D4

The SAMA5D4 processor, which got a 14 percent performance boost from its predecessor MPU, increasing operating speed to 528 MHz, is a testament of the changing microprocessor market in the IoT arena. Atmel’s microprocessor for IoT markets delivers 840 DMIPS that can facilitate imaging-centric applications hungry for processing power. Aside from that, the SAMA5D4 is equipped with a 32-bit wide DDR controller running up to 176 MHz, which can deliver up to 1408MB/s of bandwidth. That’s a critical element for high-speed peripherals common in the industrial environments where microprocessors are required to process large amounts of data.

sama5d4-block-diagram_734x612_large

Finally, the SAMA5D4 is configurable in either a 16- or 32-bit bus interface allowing developers a trade-off between performance and memory cost. There are four distinct chips in the SAMA5D4 family: SAMA5D41 (16-bit DDR), SAMA5D42 (32-bit DDR), SAMA5D43 (16-bit DDR along with H.264 video decoder)and SAMA5D44 (32-bit DDR along with H.264 video decoder).

The SoC-specific hardware security and embedded vision capabilities are a stark reminder of specific requirements of different facets of IoT, in this case, industrial and consumers markets. And Atmel’s specific focus on security and rich media just shows how the semiconductor industry is getting around the key IoT stumbling blocks.


Majeed Ahmad is the author of books Smartphone: Mobile Revolution at the Crossroads of Communications, Computing and Consumer Electronics and The Next Web of 50 Billion Devices: Mobile Internet’s Past, Present and Future.

Nextion is a high-performance TFT display for your next project


Nextion’s drag-and-drop editor makes GUI development a piece of cake.


Often times, Makers look to implement a small TFT display to control their gadgets, only to find that it may a bit more difficult or time-consuming to interface with the hardware than imagined. This is a problem Shenzhen-based startup ITEAD Studio is hoping to solve with its TFT HMI touchscreen. Nextion is a seamless HMI solution that not only serves as an objective-oriented display, but simplifies the GUI development process with the aid of a WYSIWYG editor.

20150420235504-nextion43

Nextion enables developers to build a user interface without having to code, and provides them with a complete, high-quality display to design advanced graphical embedded applications with smaller RAM, a lower frequency MCU and at a lower cost. Available in both 2.4” and 4.3″ models, Nextion is a true analog touchscreen interface with programmable function buttons for the most robust IoT and consumer electronic applications, ranging from vehicle dashboards and wearable device displays to 3D printer screens and DIY Arduino projects. In fact, its creators note that the TFT HMI is an ideal replacement for conventional LCD and LED Nixie tubes.

20150410210600-nextion_r12_c2

Both versions of the Nextion consist of an SD card slot, a touch sensor, a GPU, a UART interface, Flash memory, while the larger of the two includes an RGB buffer and driver among a few other spec differences. The TFT board uses only one serial port for communicating, and a microSD card is used to upload code faster than via the USB to UART interface.

20150413231748-nextionbuffer

Notable variations between the two models include:

  • Nextion-2.4″
    • Resolution: 320×240
    • Refresh rate: 80 ms
    • Flash: 4MB
    • 4-pin UART interface
    • Board size: 74.43mm x 42.85mm x 3.32mm
    • Display size: 60.78mm x 42.62mm
    • Power consumption: 20 mA (sleep), 90 mA (active)
  •  Nextion-4.3″
    • Resolution: 480×272
    • Refresh rate: 20 ms
    • Flash: 16MB
    • 6-pin UART interface
    • Board size: 120mm x 73.59mm x 4.48 mm
    • Display size: 105.39mm x 67.18mm
    • Power Consumption – 30 mA (sleep), 250 mA (active)

What’s more, the Nextion Editor allows users to easily drag-and-drop their own images and icons, and comes loaded with pre-defined components like buttons, progress bar, menus, gauges and text — which can be personalized in both Chinese and English. With the DIY community in mind, the program also features a “custom component” sharing function that lets Makers create their own custom components and then share them with friends and colleagues over the cloud.

Buttons

“This lets you get rid of the wiring trouble. We notice that most engineers spend much time in application development but get unpleasant results, the ITEAD Studio team writes. “With the help of this WYSIWYG editor, GUI designing is a piece of cake.”

Moving ahead, Nextion will come with an Arduino library as well, which will give Makers the ability to ease development for their next Atmel based project, including how to add a simple button or display a progress bar adjusted with a potentiometer. At the moment, the Editor is only available for Windows, but the team reveals that Linux and Mac support is in the works.

Interested? Head over to Nextion’s official Indiegogo page, where the team is currently seeking $20,000. Shipment to backers is expected to begin in July 2015.

Report: Automotive touch panel revenues to hit $1.5 billion by 2018


Most touch panels for 2017 car models will use capacitive touch technology, IHS report reveals. 


The explosion of touch-enabled screens used in smartphones, tablets and other consumer devices, along with improvements in touch technology, are increasing the demand for touchscreen automotive displays used for navigation, entertainment and online services, climate control, energy efficiency tracking and other activities.

According to a recent study by research firm IHS, the CAGR for global automotive touch panel shipments will average 18% through 2018, with revenues forecasted to reach $1.5 billion. This includes shipments of factory-installed automotive touch panel systems, aftermarket applications, dealer installations, as well as service replacements.

IHS_Automotive_Touch_Panel_Shipments_150402

IHS notes that though projective-capacitive touch (PCT) technology has been a topic of discussion since 2012, adoption is finally expected to begin in 2015 models, which is leading to the charge for touch-panel shipments. That’s because the role of automotive displays is changing. What was once just a simple way to view information from a navigation system or a car audio system, has evolved into a human-to-machine interface (HMI) for devices of in and out of the vehicle.

Due to improvements in the consumer interface, IHS reveals that most touch panels for 2017 car models will use capacitive touch technology, which is expected to surpass the use of resistive technology over the next two years.

Moving ahead, state-of-the-art cars will surely be equipped with multi-touch capacitive sensors typically found in smartphones and tablets, along with capacitive buttons to create a modern look and intuitive use — all of which will be made possible through Atmel’s comprehensive platforms and solutions for in-vehicle HMIs.

Video: Rob Valiton discusses the future of automotive at CES 2015


The car of the future could have a curved center display with tons of real estate for driver information and entertainment. 


It’s no surprise that automotive technology has emerged as an integral component of our digital lifestyle, as more and more consumers are looking to bring their mobile devices seamlessly into their vehicles. During CES 2015, ARMdevices.net had the chance to catch up with Rob Valiton, Atmel Senior Vice President & General Manager, to discuss the connected car — most notably, the next generation of infotainment user interfaces.

10929927_1014246888592481_347934713395376436_n

With up to a hundred million lines of code, at least 30 MCU-controlled devices — and some with as many as 100 — the vehicle is the ideal application to bring smart, connected devices in the era of the Internet of Things (IoT). Not only will these automobiles be packed with futuristic functionality ranging from navigation and parking assistance to diagnosis and road conditions, they will become much more intuitive and integrated with smartphone-like interfaces. In order to provide this, the car of tomorrow will feature a curved center console display offering a large amount of real estate for information to drivers. And, the newly-announced AvantCar 2.0 will make this possible.

Luckily, the AvantCar 2.0 brings advanced connectivity into the vehicle through an advanced HMI console connected to a concept car highlighting car access, car networking, MCUs, audio-over-Ethernet, MHL support and security technologies. Focusing on user requirements, the fully-functional console concept boasts curved touchscreens using maXTouch touchscreen controllers and XSense flexible touch sensors, as well as Atmel’s QTouch with proximity sensing, and LIN networking for ambient lighting controls.

What will smartphones look like in 2020?

Thanks to Moore’s Law, electronic devices are increasingly packed with more power and functionality, improving our life qualities with more convenience, productivity, and entertainment. Just to put things in perspective, Steve Cichon of Trending Buffalo shows that an iPhone (assuming an iPhone 5S at the beginning of 2014, when his blog was written) can replace $3,054.82 worth of electronics sold in Radio Shack in 1991, according to a flyer post in The Buffalo News.

radioshackad

“It’s nothing new, but it’s a great example of the technology of only two decades ago now replaced by the 3.95 ounce bundle of plastic, glass, and processors in our pockets,” says Steve Cichon.

As cool as we think our smartphones are today, I dare to say that two decades later by 2035, when people compare their personal electronics (assuming they don’t use the term “smartphones” anymore!) against the current smartphone features, they would be amazed by how big, heavy and slow these electronics are today. If you still don’t get what I mean, take a look at this 1991 Sony Walkman Commercial, and try to recall how cool the Walkman was in 1991.

While I certainly do not have the crystal ball that tells me what kind of personal electronic devices people will be using by 2035, I would like to make a few guesses of what smartphones would look like in just 5 years, say 2020.

User Interface

I believe touchscreen [with touchscreen controllers] will still be the main user interface for smartphones by 2020. While Generation Z are called “digital natives,” I think kids who are born after Generation Z would be “touch natives.” Toddlers and young children playing with iPod Touch, iPhone and iPad today will attempt to touch all display interfaces as their way of interacting with electronics in the coming years. I also believe smartphone interfaces would expand beyond just touch, and there are two possible expansions within five years: gesture controls and voice commands.

Gesture control refers to hand or facial interactions with the smartphone.  Samsung’s Galaxy S4 (with Air View) and Amazon’s Fire Phone (with 4 corner cameras) made interesting attempts for enabling hand and facial gesture recognition, but unfortunately, these features were not very successfully adopted by consumers because they were hard to learn, limited by hardware capabilities, and unreliable or inconsistent to use. But smartphone OEMs will continue improve their designs, and smartphones will eventually be capable of reliably recognize our intentions by tracking our hand or eyeball motions, or facial expressions.

Voice command is widely popular today, but will become a lot more useful in five years. Think of Apple’s Siri, Google’s Google Now and Microsoft’s Cortana, as cloud computing becomes more artificial intelligent with more data and computational power, they will become more dependable for average consumers to adapt. I hope that by 2020, my daily commutes with Apple’s Siri will no longer be worse than talking to my 2-year old son — Siri will help me change FM radio channels or launch a Podcast via Carplay in my dashboard. I will also be able to ask Google Now to order a pizza for me (topped with bacon, pepperoni and sausage, of course) without directly talking to the pizza-shop guy. Google Now will tell me when the pizza might arrive (based on the traffic congestion conditions), and open the door for me through my Nest, which as a Bluetooth connection to my front door’s electronic lock.

Integration

Needless to say, smartphones will be further integrated come the year 2020. Smartphone integration will follow a much similar path as the PC’s integration, except it will take place A LOT faster. Integration doesn’t always mean electronic components will disappear; rather, it can also mean that more hardware performance is integrated into the device. Today’s leading smartphones are packed with a Quad- or Octa-core Application Processor, running between 1.3 to 2.5GHz. By 2020, I’m guessing that smartphone CPUs will be 8 to 16-cores, running between 2.5-4.0 GHz range, (they probably will eat today’s Intel Core i7, designed for high-performance PCs, for lunch.)with 8-10GB RAM and 500-750 GB of storage.

I also believe smartphones will integrate more hardware components for better “context-awareness.” Today’s leading smartphones are easily packed with 10 sensors — gyro, ambient light, accelerometer, barometer, hall sensor, finger scanner, heart rate monitor, among a number of others. I think more microphones (today’s camera usually has at least two microphones) and cameras (again, at least two today) will be packed into the devices to enable improved awareness — 4, 6 or even 8 microphones and cameras are quite possible by 2020. For instance, having multiple microphones enables listening from different positions inside the phone and at different frequencies (i.e. not only voice commands); in addition, it will allow the smartphone to determine its location, its surroundings (whether inside or out) how far it is away from the voice command and even how to improve noise cancellation. Also, having multiple cameras will allow the device to better track facial expressions (Amazon’s Fire Phone is a good example), to capture better 3D and panorama images, or to refocus photos by post-processing (hTC One M8 is a good example).

Further, component-level integration will continue to happen. With increasing applications processor power, the A/P will be able to take over many digital processing from discrete components inside the phone, although I think Sensor Hub will continue to drive low-power, context-awareness tasks while the A/P sleeps.

Display Technology

Do you envision 4K displays (i.e.3840 x 2160) on your smartphone? Today, Apple’s “Retina Display” in the iPhone 5S offers a 326 pixel-per-inch, and many new smartphone displays exceed that pixel density. Smartphone displays are increasing in sizes, moving from 3.2″ and 4″ just a few years ago to 4.7″, 5.2″, 5.5″ and even 6.4”. As the screen sizes increase, as will the display resolution, while keeping the high PPI density.

I think both LCD and AMOLED displays will continue to exist in 2020, as both technologies have their advantages and disadvantages for smartphone applications. From a consumer perspective, I would expect both types of displays to improve on resolution, color accuracy (for example, Xiaomi’s latest Mi4 display has a color gamut covering 84% of the NTSC range, and that’s even better than Apple’s iPhone 5S display), power consumption and thinner assembly allowing for slimmer industrial design.

As smartphones with 2K displays be introduced by the end of 2014, it isn’t unreasonable to say that 4K displays would be used in smartphones, perhaps by or even before 2020.  However, everything has a cost, and the extra pixels that our human eye cannot resolve will consume power from the graphic engine. Would you prefer to trade off some pixel densities with longer battery life? Personally, I think we do not need a 4K smartphone screen. (And yet, I may laugh at myself saying this when we look back five years from now.)

Battery Technology

The thirst for more power is always there. With increased processing capabilities, context-awareness and better display technologies, we can only assume that future smartphones will require more power than what they are carrying today. Today’s top-tier smartphones can package a battery around 3000 mAh. That’s plenty of juice for a day, but consumers always crave for longer battery life or more powerful smartphones with longer video streaming time. Luckily, research on new battery technologies have been increased, thanks to the explosion of portable electronics. I believe there are two types of technologies that will be available and improve our smartphone experiences by 2020:

Battery with higher density: Forbes recently reported that a group of researchers at Stanford University designed a new solution to increase the capacity of existing battery technology by 400%. This is just one of the promising researches we’ve seen in recent years that could one day be deployed for mass production in just a few years. For the same size of battery that lasts for a day of use in 2014, we can expect that smartphones will last for a week without charging by 2020. On the other hand, smartphone OEMs can also select to use a smaller size battery in the smartphone, and in exchange, use the extra room inside the smartphone to integrate other components and features.

Battery with rapid charging capabilities: A gadget-lover’s dream is to get a full-charge of their smartphones within 5 minutes of charging. Today, UNU’s Ultrapak battery pack can deliver a full charge to devices after just 15 minutes of charging itself up. This isn’t to say the technology is ready for smartphone integration, due to various reasons; however, we’re seeing smartphones adopting rapid charging technologies today (such as Oppo’s Find 7) and we should expect that smartphones will have a much shorter charge time thanks to various rapid-charging standards, such as Qualcomm’s Quick Charge 2.0. Several smartphone models have adopted this standard, including Xiaomi’s Mi3, Mi4, Samsung Galaxy S5 and hTC One M8.

Smartphone Camera

Last but certainly not least, I think smartphone cameras will certainly undergo many improvements by 2020. In fact, the smartphone camera performance is one of the features driving smartphone sales. A safe and simple prediction is that camera’s pixel density would continue to increase as CMOS sensor technology advances. Today, Microsoft’s Lumia 1020 has 41 megapixels, yet I don’t see an average consumer needing that many pixels even by 2020. Personally, I would be very happy with a camera that offers 15-20 megapixel — good photographers understand that pixel isn’t the only determining factor for a good camera, as it is only one of the key aspects.

I am not expecting the camera in a smartphone is capable of optical zooming. Instead, I’d much rather have a smartphone that’s light and portable. In fact, today’s smartphone cameras are pretty good by themselves, but there are always improvements can be made. I think the iPhone 5S cameras can be better with image stabilization, the Galaxy S4 camera can be better with faster start-up and better low-light sensitivity, and the hTC One M8 camera can be designed better with more pixels and improved dynamic contrasting.

Here is a my wishlist for a smartphone camera that I would carry around in 2020, and it’s perhaps not the “2020 Edition of Lumia 1020” camera:

  • 20 megapixel with Image Stabilization, perhaps a wide, f/1.0 aperture
  • HDR, Panorama view
  • Excellent white balance and color accuracy
  • Excellent low-light sensitivity
  • Full manual control
  • Extremely short start-up latency, and fast and accurate auto-focus
  • 4K video recording @ 120fps (with simultaneous image recording)

I may not be a fortune teller, but there you go… that’s my prediction for what a smartphone will look like in the year 2020. Would you be interested in spending your hard-earned dough in 2020 for a smartphone with the above spec? Everyone has an opinion on what the future entails, and my idea of a smartphone five years from now are as good as those of the readers of this blog. I think we would all agree that the advancements in technology will continue to improve the quality of lives. As smartphones become more personal and depend ended upon, we’ll all reap the benefits from the smartphone evolution.

 

For I have seen the shadow of the curved touchscreen

Last year’s CES was the modern technology equivalent of the voyage of Ferdinand Magellan, proving beyond any shadow of doubt displays no longer can be thought of as only flat. While the massive curved 105-inch TVs shown by LG and Samsung drew many gawkers, the implications of curved touch displays are even wider.

At DAC 50 there were more than a few chuckles and some mystified looks when Samsung’s Dr. Stephen Woo spent a lot of his keynote address highlighting flexible displays as one of the challenges for smarter mobile devices (spin to the 27:41 mark of the video for his forward-looking comments). I think if we had polled that room at that second, there would have been two reactions: 1) yeah, right, a flexible phone, or 2) hmmmm, there must be something else going on. His comments should have provided the clue the flat display theory was about to dissolve:

Is there any major revolution coming to us? My answer to that is yes. I’m afraid that we as EDA, as well as the semiconductor industry, are not fully appreciating the magnitude of the revolution.

Woo showed the brief clip from CES 2013 introducing the first Samsung flexible display prototype, hinting that while exciting, it is still a ways from practicality. Why? He went on to explore the rigid structure of the current high volume smartphone – flat display, flat and hard board with flat and hard chips, and a hard case. I have some unpleasant recollections of trying chips on flex harnesses in the defense industry, and the problems become non-trivial with bigger parts and shock forces coming into play, not to mention manufacturing costs.

We might be getting thrown off by the limiting context of a phone as we know it. A gently curved but still fixed display poses fewer problems in fabrication using current technology. Corning has announced 3D-shaped Gorilla Glass, and Apple, LG, and Samsung are all chasing curved display fabrication and gently curved phone concepts today.

The real possibilities for smaller curved displays jump out in the context of wearables and the Internet of Things. The missing piece from this discussion: the touch interface. Flexible displays present a challenge well beyond the simplistic knobs-and-sliders, or even the science of multi-touch that allows swiping and other gestures. Abandoning the relative ease of planar coordinates implies not only smarter touch sensors, but algorithms behind them that can handle the challenges of projecting capacitance into curved space.

Illustrating the potential for curved displays with touch interfaces in automotive design, AvantCar debuted at CES 2014. Courtesy Atmel.

 

Atmel fully appreciates the magnitude of this revolution, and through a combination of serendipity and good planning is in the right place at the right time to make curved touchscreens for wearables and the IoT happen. With CES becoming an almost-auto show, it was the logical place to showcase the AvantCar proof of concept, illustrating just what curves can do for touch-enabled displays in consumer design. (Old web design axiom, holds true for industrial design too: men tend to like straight lines and precise grids, women tend to like curves and swooshes – combine both in a design for the win.)

The metal mesh technology in XSense – “fine line metal” or FLM – means the touch sensor is fabricated on a flexible PET film, able to conform to flat or reasonably curved displays up to 12 inches. XSense uses mutual capacitance, with electrodes in an orthogonal matrix, really an array of small touchscreens within a larger display. This removes ambiguity in the reported multiple touch coordinates by reporting points independently, and coincidentally enables better handling of polar coordinates following the curve of a display using Atmel’s maxTouch microcontrollers.

Utilizing fine line metal - copper etch on PET film - Atmel's XSense touch sensor is able to conform to gently curved displays.

 

Now visualize this idea outside of the car environment, extended to a myriad of IoT and wearable devices. Gone are the clunky elastomeric buttons of the typical appliance, replaced by a shaped display with configurable interfaces depending on context. Free of the need for flat surfaces and mechanical switches in designs, touch displays can be integrated into many more wearable and everyday consumer devices.

Dr. Woo’s vision of flexible displays may be a bit early, but the idea of curved displays looks to be ready for prime time. The same revolution created by projected capacitance for touch in smartphones and tablets can now impact all kinds of smaller devices, a boon for user experience designers looking for more attractive and creative ways to present interfaces.

For more on the curved automotive console proof of concept, check out Atmel’s blog on AvantCar.

What do you think of the emergence of curved displays and the coming revolution in device design? How do you see curved touchscreens changing the way industrial designers think of the user interface on devices? Looking out further, what other technological improvements are needed?

This post has been republished with permission from SemiWiki.com, where Don Dingee is a featured blogger. It first appeared there on January 10, 2014.

Ootsidebox goes touchless with the 3Dpad



Ootsidebox has introduced the 3Dpad, a sophisticated touchless gesture control interface with a depth perception of 10cm.

The platform – which recently made its Indiegogo debut – comprises three primary components:

“To detect the proximity of the human hand or finger, we use the projected capacitive technique. This is the principle of virtually all modern touch screens – except that now we are in the air, relatively far away from the detector surface (10 cm max). So we build capacitors which are as ‘open’ as possible, using electrodes drawn on the electrode plane PCB in order to obtain a maximum ‘hand effect,'” 3Dpad creator Jean-Noël explained.

“[Meanwhile], the capacitors formed by the electrodes are part of an oscillator whose frequency is influenced by the distance of a hand. When it enters the electrostatic field, this ‘intruder’ is going to cut the field lines and divert the electrical charges. The closer the hand approaches the electrodes, the more the oscillator’s frequency increases.”

According to Jean-Noël, the system employs a phase/frequency comparator along with a control and locking program.

“This simple system makes the conversion of the very small frequency shift into a variation in a voltage signal which is easy to use,” he said.

On the software side, an embedded software (sketch) running on the Atmel-based Arduino Uno is tasked with calculating 3D coordinates, recognizing basic gestures (swipes, push and rotations) and relaying the data to a host device on the USB COM Port.

“The evaluation software (PC) will enable you to quickly evaluate the 3D-Pad. You’ll see all the values sent by the Arduino Uno (1), the gesture events (2) and the 3D coordinates in the form of a cursor (3),” he added.

As Jean-Noël notes, 3Dpad is only the starting point for Ootsidebox, as the company is currently working on a number of HMI related projects, including touchless & gesture interfaces, telehaptics, wearable tech and even artificial intelligence (AI).

Interested in learning more about the 3Dpad? You can check out the project’s official page here.

Interview: Jean-Noël talks Ootsidebox

Jean-Noël says projected capacity is the primary principle behind his Atmel-powered Ootsidebox, with an electric field projected in front of the existing touch surface affected by movements of the hand. Simply put, it is possible to calculate 3D coordinates and recognize certain gestures by measuring the perturbations of an oscillator caused by the movement of the user’s fingers (or an object) at several centimeters from the control surface.

Recently, Atmel’s Tom Vu had the opportunity to discuss the Ootsidebox with product inventor Jean Noel Lefebvre. 

Tom Vu:

What is the basic history of Ootsidebox?

Jean Noel: I kicked off this project 6 years ago and have worked on it full time since March 2013. Most of the parts used to construct  Ootsidebox are actually off-the-shelf electronics.

ootsodebox1

More specifically, I used the Atmel AT90USB1286 microcontroller (MCU) to power the device. Currently, I am exploring the possibility of meshing the popular Unity 3D gaming Engine with Ootsidebox. Combining a well known gaming engine will help us tease out more latent, long-term potential for the project, while simultaneously expanding the boundaries of game play with touchless or hybrid touch/touchless technology.

TV: How does Ootsidebox differ from other touchless and gesture sensor solutions?

JN: First of all, there is nothing at the center. For the microchip solution, you need a center electrode with two layers integrated within the body. In contrast, Ootsidebox is designed to be platform and device agnostic. In fact, the incasing can be modeled to fit around existing technologies and devices. Take, for example, example, the Android or iPad. The idea that you can simply wrap this touchless interface around existing devices and products opens new possibilities while enhancing use-cases for existing devices.

ootsidebox2

With this external fitting, much like an accessory, one can quickly enable their devices to be touchless, with gestures executed from within 10cm (set to double very soon) at maximum in front of a small screen. The device can be used in many different scenarios. For example, say you are in the kitchen cooking with greasy hands filled with sauce. The Ootsidebox can be set to seamlessly interact with various kitchen appliances – without the user ever having to touch knobs, buttons, glass, dials or sliders. Instead, activating/adjusting appliances can be performed via simple gestures (left to right or circular motions). Of course, there are many additional applications that can benefit from a touchless interface, ranging from home consumer device, gaming, health or even industrial uses.

TV:  Can you tell me more about the product design?  Is there any particular reason you chose Atmel AVR?

JN: The design is very simple, using only well known “stock components” found on any distributor or reseller site. The more complex part may be found in the 14bits DAC in SPI. Most of the components are “old school” logical chips such as 4000 family (my best friends for a long time in electronics). As for the microcontroller, I didn’t need high performance uC, so 8 bits were enough. The idea is to prepare Ootsidebox for mainstream adoption via a strategy of simplicity, a philosophy which fits well with Makers and the open source community. In terms of selecting the appropriate uC, I was careful to precisely balance price and performance. I also took into consideration various factors such as the large AVR community, availability of open source libs and the quality of the support and tools from the chip manufacturer. The mindset, reputation and philosophy of the brand (Atmel and Arduino) helped steer my uC choice. In fact, startups today are very closely tied to Maker Movement, reflecting Arduino and Atmel. That’s why I’m very confident when choosing Atmel, because Atmel and the Arduino community really support the Maker Movement today.

TV: How does Ootsidebox differ from other platforms on the market?

JN: It’s really a control device that computes touchless gestures versus touching and manipulating. Most of us are quite familiar with the ongoing touch revolution, as we use the very same interface interacting with smartphones and tablets on a daily basis. In addition, there are already commercially viable products such as Android devices equipped with sensor hubs that are designed to process gestural movement of the hand.

ootsidebox3

Ootsidebox differs on many levels, as the device is meant to be an add-on or fitting to an already existing device. Easy modification will encourage HMI enhancements for existing products or emerging devices. Remember, a consumer/user does not have to be married to just one product line from a major manufacturer. With Ootsidebox, you can control the devices without touching; move up, down, side-to-side, rotational, and even emulating the click of a button. Perhaps most importantly, the touchless interface will undoubtedly inspire future design roadmaps. For example, the touchless form factor is perfect for industrial and medical use. Just imagine a dentist needing to activate or handle various devices during treatment when messy hands are not necessarily ideal.

TV: What is the future of Ootsidebox? Do you plan on making it open source?

JN: Yes, there are plans to launch a campaign on Kickstarter or Indiegogo to attract more involvement in the development and use of this touchless sensor solution. The platform and innovative slope for additional development is limitless. We plan on releasing Ootsidebox as open source / open hardware, complete with specs for mechanical design. Crowdsourcing will help spur additional innovation, while allowing the platform to accommodate a wider degree of functionality. 

TV: How do Hackerspaces influence your work?

JN: A few years ago, disruptive products and ideas were conceived in garages. Today, the very same process takes place in Hackerspaces, where creativity thrives and technical skills abound. By designing projects in Hackerspaces, Makers and engineers are fully connected with a worldwide network of creative people boasting different backgrounds. This synergy significantly accelerates the innovation process.

TV:  What is your personal experience with AVR microcontrollers (MCUs) and Arduino boards?

JN: I was using other brands before I discovered the benefits of AVR uC during my discussions about Ootsidebox with my friends at Elektor Labs.

ootsidebox4

Also during my stay at Noisebridge Hackerspace, Mitch Altman was using AVR Arduino to teach electronics for newbies (I really love what’s happening there). My first experience with the Arduino environment was with Teensy++ 2.0, based on the AT90USB1286 MCU. This Atmel AVR microcontroller is the one I used for my last prototype of the Ootsidebox tablet accessory, which will be launched soon on Kickstarter or Indiegogo. We are also working on a smaller project with Elektor Labs. Essentially, it’s a “3D Pad” built in the form of a shield for Arduino.

TV: Are touchless gestures the future of user interfaces?

JN: Touchless gestures are a part of the natural evolution of the more traditional user interface. It’s a way to provide a more natural and intuitive user experience, which is somewhat of a growing requirement due to the proliferation of complex equipment in our everyday life. Of course, touchless gesture interaction is also more natural. In the future, with the help of Ootsidebox technology, product designers and Makers will not create electronic platforms to “manipulate” or “interact” with devices, but rather, for individuals to directly “communicate” with them instead.

Really, people expect them to be as smart as living entities. I learned that during various discussions with scientists about the project. In the brain, “communicating” vs. “manipulating” simply does not invoke the same connections pathways. Clearly, touchless and gesture UI are paving the way to a very fascinating evolution of consumer electronics in the near future. That being said, I see touchless user interfaces complimenting, rather than replacing, multi-touch, much the same way the mouse didn’t replace a keyboard.

Clearly, this kind of technology can help save lives, while reducing nosocomial risk in healthcare environments. It may also allows drivers to stay more attentive to the road when navigating with gesture-based infotainment. Personally, I’m dreaming of disruptive aesthetic designs in the field of high-tech consumer electronics. I can’t wait to see what a guy like Philippe Starck will be able to create. As I noted earlier, this project is 100% open and we invite everyone to participate on Twitter. Just post your questions and suggestions here: @OOTSIDEBOX, while including the hashtag #AtmelBlog. I’ll answer you personally. You can also check us out here on Facebook

Video: Atmel’s AvantCar demo

Earlier this month, Atmel debuted its AvantCar concept at CES 2014 in Las Vegas. The fully functional console features two large curved touchscreen displays – without mechanical buttons. 

Instead, the touchscreens integrate capacitive touch buttons and sliders, allowing users to navigate general applications typically found within an automotive center console.

This includes global navigation system (GPS), car thermostat, audio controls for a radio or media player, seat controls and more. AvantCar also allows drivers to personalize their in-vehicle environment using advanced touch capabilities and LIN connectivity system to control ambient lighting.

According to Atmel Marketing Director Stephan Thaler, AvantCar successfully demonstrates the future of human machine interface (HMI) in upcoming vehicles. Indeed, next-generation automotive designs will be influenced by a wide range of trends in the consumer market such as slick and curved centerstack designs, as well as customization by appearance, color, navigation and interaction with a smartphone or tablet.

Atmel offers a number of comprehensive platforms and solutions to address the current and future requirements of a modern in-vehicle human-machine interface (HMI). However, the AvantCar Centerstack demo is the company’s first fully functional concept showcasing groundbreaking solutions within the automobile.

 To be sure, AvantCar is powered entirely by Atmel technology, including maXTouch (two touchscreens), XSense (curved panel design), QTouch (touch buttons and sliders), dedicated algorithms running on Atmel touch chips and microcontrollers (proximity detection), as well as LIN-based ambient lighting control.

Interested in learning more about Atmel’s AvantCar demo? You can check out our in-depth article on the subject here.

AT91SAM9X35 powers SBC with touchscreen display



Premier Farnell has launched the EDM6070AR-01, a fully-integrated embedded display module (EDM) that pairs an ARM9-based single board computer (SBC) with a 7” LCD and touch-screen assembly. According to Premier Farnell CTO David Shen, the multi-function embedded EDM is powered by Atmel’s  AT91SAM9X35 industrial microprocessor (MPU).

armsbcdisplay3

“The EDM6070AR-01, designed as an all-in-one solution, is ideally suited for a variety of embedded control HMI (human machine interface) applications including industrial control terminals, intelligent instruments, medical products, network terminals as well as data acquisition and analysis,” he explained.

armsbcdisplay1

“The module has a plate with display, connectors and place for the Mini6935 module with ARM microcontroller.”

The module also includes a pre-loaded Smart-Home demo app with an intuitive smart-LED controller that allows users to set independent light levels in each room, regulate temperature and humidity, play streamed audio files and manage surveillance cameras.

armsbcdisplay2

Aside from Atmel’s ARM-based MPU, key EDM6070AR-01 specs include:

  • 128MB DDR2 SDRAM
  • 256MB NAND Flash
  • 4MB Data Flash
  • 24-bit TFT LCD module, 7” (800 x 480, 24-bit color depth)
  • four-wire resistive touch-screen
  • SD card interface
  • Power supply: +12V@1.25A

On the software side, the EDM6070AR-01 is packaged with Linux BSP, offering support for Linux QT GUI (Graphical User Interface) and multiple file systems such as FAT and NTFS. 

As noted above, the SBC is also supplied with a Smart Home demo app and a number of example applications for developers.

armsbcdisplay4

The EDM6070AR-01 is available for $179 with the 7” LCD, although a standalone CPU module can be picked up for $69. Both are live on Farnell element14 in Europe, Newark element14 in North America and element14 in APAC.