Tag Archives: smart objects

Henri wants to help designers create ambient UIs for smart devices


This interactive gizmo is making it easier for designers to explore the ambient UIs of tomorrow’s gadgets. 


Smart devices will undoubtedly continue to proliferate over the coming years. With billions of these connected gizmos expected to hit the market and ultimately make their way into our homes, this leaves one important question: How do you communicate with an Internet-enabled appliance when it doesn’t have a screen? Think about it: Your toothbrush. Your robotic vacuum. Your cooking utensils. Typically speaking, these sort of items emit luminescent cues that are used to catch your attention only when in need of a battery charge or some sort of malfunction. That’s exactly the conundrum design firm Method has set out to solve with what they’re calling Henri.

3043132-slide-s-3-a-box-for-designing-the-screenless

“[At the moment], there isn’t an easy way to design that. You need someone with fairly strong programming skills,” Daniel Nacamuli, Method’s lead interaction designer explains.

Instead, Henri is an interactive gadget that wants to make it easier for designers to explore the ambient user interfaces of IoT devices. The device has been developed to function as an abstract stand-in for a connected home product such your smart lights, thermostats or locks. Housed in a wooden enclosure, the system is comprised of a central box, two control panels and a desktop user interface. The main console is packed with an Atmel based Arduino, a round set of LED lights, and a built-in speaker.

3043132-slide-s-8-a-box-for-designing-the-screenless

Two control panels of steel knobs are linked to Henri, enabling users (even without any sort of coding background) to easily experiment with enchanted interface elements. With just a few turn of its dials, designers can devise a wide-range of patterns of lights and sounds with varying pulses, hues, intensities and durations (zero to 16 seconds), as well as watch them play back in real-time on its central hub.

The Arduino is tasked with recording the sequence and relaying it back to the desktop interface for storage. The main box also syncs with synthesizers so users can simultaneously create sound cues. Later, Henri can reprogram all of this into the final piece of hardware.

3043132-slide-s-5-a-box-for-designing-the-screenless

Additionally, Henri will certainly come in handy for designers across a plethora of industries like gaming. “You could use the controller to fine tune animation on a screen. Say your animation is of the sun setting and that sun is going to move down. Normally they’ll use some animation software with a timeline. What could feel more natural, is to turn the dial on the Henri, to turn the speed,” Nacamuli tells Wired. 

This interactive device is merely one component of Method’s overall efforts to raise awareness around the design of ambient user interfaces for the Internet of Things. The firm unveiled the Henri box as part of a workshop earlier this year in its Bay Area office during San Francisco’s IxDA conference. There, attendees were paired in teams and asked to program light and sound patterns on the Henri to communicate test scenarios.

outcome4-1380

“After initial brainstorming, it was clear we could use this opportunity to solve a set of problems and roadblocks that have inhibited us from designing non-screen based products in our own practice,” the team writes. “Henri allows those concepts to be tested real-time, and enhance the overall capabilities of both the designer and the product. It helped people literally think outside of the box, and be productive while playing.”

Intrigued? Head over to the project’s case study here.

These 20+ everyday objects have gone from mundane to magical


The wizarding world of Harry Potter won’t be the only place you’ll find enchanted objects. 


According to MIT Media Lab researcher David Rose, the term “enchanted object” is used to describe any everyday object with extraordinary functions.

“We are now standing at the precipice of the next transformative development: the Internet of Things. Soon, connected technology will be embedded in hundreds of everyday objects we already use: our cars, wallets, watches, umbrellas, even our trash cans. These objects will respond to our needs, come to know us, and learn to think on our behalf.”

enchantedobjectsposter

Entitled “Enchanted Objects: Design, Human Desire, and the Internet of Things,” Rose’s latest book depicts the blueprint for a better (or shall we say ‘smarter’) future, where efficient solutions come hand in hand with technology that delights our senses. Not only are these innovative things fun and alluring, they may hold the key to better satisfying our needs and improving our lives.

“The big lesson here for companies is that they need to embrace and start designing for this world of enchanted objects,” Rose said in a recent BI:Tech interview. “It will mean a key change for how we interact with technology, and it’s a great opportunity for all of these traditional product companies.”

As we prepare for this embedded future where microcontrollers will give once-ordinary objects super “powers,” we’ve decided to explore some of the items currently in existence today. From a pill bottle that can alert you when you’ve skipped your medication to an umbrella that says whether it’ll rain, these gadgets provide us with a glimpse into smarter society — one where fairy tale enchantment becomes a reality.

And, with this state of ambience ever so close, our friends at element14 are challenging hobbyists, designers and engineers alike to add some magic and mystic back into the realm of everyday objects using the new Atmel | SMART SAMA5D4 Xplained Ultra, Arduino Yún (ATmega32U4) and Arduino Uno (ATmega328), among several other kits.

“The Internet of Things may hit a roadblock: namely, the lack of secure communications between objects and individuals could lead to a situation in which data is being shared without explicit consent and exploited for malicious purposes,” element14 adds. “Therefore any Internet of Things challenge we will undertake in the future will have a security aspect: we will want to see that appropriate security measures have been built into the solutions. Bonus points will be given for clear demonstrations of this in the finished project.”

They couldn’t be more correct. When the world around us becomes increasingly more connected, each and every thing will also need to be secure. Without security, there is no way to trust that the authenticity of things and integrity of its data. Due to the drive for bigger data, the cloud and smart communicating, things are becoming ambient; and, because those things all require security, security itself is becoming ambient as well. Fortunately, as Atmel’s resident security expert Bill Boldt explains, there’s an easy way to spread protection to each of the nodes: CryptoAuthentication.

These so-called enchanted objects are broken down into six caterogies, each based upon human desires. The segments include omniscience (the desire to know all), telepathy (the desire for human connection), safekeeping (the desire to protect), immortality (the desire to be healthy), teleportation (the desire to move effortlessly) and expression (the desire to make).

Like Arthur C. Clarke once said, “Any sufficiently advanced technology is indistinguishable from magic.”

Vitality GlowCap

the-vitality-glowcap-reminds-you-to-take-your-medications-by-lighting-up-making-chirping-sounds-and-eventually-sending-you-a-text-message-you-can-share-your-medication-data-with-a-remote-loved-one-a-professional-caregiver-and-your-pharmacy

Always seem to forget to take that pill in the morning or before bed? This smart cap will remind you to take your medications by lighting up, making chirping sounds, and eventually sending you a text message. You can share your medication data with a remote loved one, a professional caregiver, and even your pharmacy. No more calling to refill those prescriptions!

The Ambient Umbrella

the-ambient-umbrella-has-a-handle-that-will-glow-if-snow-or-rain-is-in-the-forecast-reminding-you-to-grab-it-on-your-way-out-the-door

What if your umbrella had a handle that would glow if snow or rain was in the forecast? You’ll never forget to grab it on your way out the door again!

Google Latitude Doorbell

the-google-latitude-doorbell-created-at-the-mit-media-lab-chimes-a-tune-when-a-family-member-is-approaching-the-house-each-family-member-has-their-own-tune.jpg

Created at the MIT Media Lab, the Google Latitude Doorbell chimes a tune when a family member is approaching the house. Each family member has their own tune. Have some fun with it: Imagine setting it to play “Master of the House” from Les Misérables as you approached the door, or the Jaws theme song for your mother-in-law.

The Ambient Orb

the-ambient-orb-tracks-real-time-data-for-the-stock-market-pollen-count-traffic-congestion-and-more-and-glows-specific-colors-to-let-you-know-if-the-data-looks-good-or-bad

When you think of David Rose and ambient object, this “magical” orb is often times the first thing that pops into mind. This device tracks real-time data for the stock market, pollen count, traffic congestion, and more, and glows specific colors to let you know if the data looks good or bad.

SunSprite

sunsprite-is-a-small-clip-that-measures-the-amount-of-bright-light-you-take-in-during-the-day-in-order-to-help-you-improve-your-energy-levels-sleep-cycle-mood-and-more.jpg

Feel like you’re walking on sunshine? This small will let you know whether you’re actually taking in enough bright light during your day, in order to help you improve your energy levels, sleep cycle, mood, and so much more.

Energy Joule

the-energy-joule-tracks-energy-prices-by-glowing-red-if-prices-are-high-yellow-if-prices-are-average-and-green-if-prices-are-low

Let’s face it, energy bills are the worst — especially those living in extremely cold climates in the winter and warm in the summer. To better help you save a buck or two, the Energy Joule can track energy costs by glowing red if prices are high, yellow if prices are average, and green if prices are low.

The Facebook Coffee Table

CoffeeTable

‘Like!’ This innovation is bringing coffee talk into the digital era. The incredibly social-savvy table listens to your conversations and displays photos from your Facebook page whenever they are appropriate to the conversation. Think Mark Zuckerberg meets Minority Report.

MemoMi

memomi-is-a-mirror-that-records-the-outfits-you-try-on-so-you-can-compare-them-and-decide-what-to-buy-or-wear.jpg

Never quite sure as to which outfit to buy? Ladies, you’re in luck. This smart mirror records the outfits you try on, so you can compare them and decide what to buy or wear. Never have to go back and forth again.

Amazon Trash Can

the-amazon-trash-can-created-at-the-mit-media-lab-scans-any-objects-youre-throwing-away-and-automatically-re-orders-them-from-amazon.jpg

Forget to replace the toilet paper? Run out of milk? Need laundry detergent? This trash can can now scans any object you’re disposing and automatically reorder it from Amazon.

Pandora Chair

the-pandora-chair-created-at-the-mit-media-lab-plays-different-music-based-on-your-level-of-incline-if-youre-sitting-upright-the-chair-will-play-upbeat-music-if-youre-leaning-back-it-will-play-something-peaceful.jpg

This gives a whole new meaning to ‘musical chairs!’ The Pandora Chair is designed to play music based on your level of incline. Envision the possibilities: Sit back, relax and enjoy the tunes of the caribbean. Or, sit upright, intensely focus on your work while listening to some “Eye of the Tiger.”

Vessyl

vessyl-is-a-smart-cup-that-identifies-what-kind-of-liquid-youre-drinking-and-lets-you-know-how-many-calories-and-how-much-sugar-fat-protein-sodium-and-caffeine-are-in-that-drink.jpg

As our days get too busy, it can quickly become too difficult to manage our liquid intake. Luckily, a smart cup can do that for you — it knows what kind of fluid you’re drinking and track how many calories and how much sugar, fat, protein, sodium, and caffeine are in that beverage.

The Skype Cabinet

the-skype-cabinet-created-at-the-mit-media-lab-allows-you-to-simply-open-a-wooden-door-and-connect-to-a-friend-or-loved-one-via-skype-a-proximity-sensor-allows-the-cabinet-to-glow-when-a-friend-is-available.jpg

Tired of always having to grab the computer, flip it open and sign into Skype? Thanks to this project from MIT Media Lab, all you have to do is simply open a wooden door to telconnect with a friend or loved one. No more setup, bad lighting, or those irritating headphones.

TrakDot

trakdot-is-a-luggage-tracker-that-you-place-inside-your-suitcase-you-can-then-see-the-location-of-your-luggage-by-using-the-trakdot-app-which-connects-to-the-tracking-device.jpg

NOTHING, we repeat NOTHING is worse than losing your luggage while traveling. This smart luggage tracker can slide right inside your suitcase and inform you of its whereabouts using its companion app, which connects to the tracking device.

Energy Clock

Clock

Are the culprit in your household’s excessive energy consumption? This innovative clock shares real-time feedback on the amount of energy your home is using. It learns your consumption habits, then offers some subtle feedback on how you’re tracking against yourself.

Goji Smart Lock

20130603114032-Side_image

As we inch closer to a Jetsons-like future, of course there will be smart locks! Easily lock and unlock your door with your smartphone, after snapping pictures of visitors at your door and automatically sending real-time picture alerts to your device.

Nabaztag

Nabaztag-rabbit-an-internet-rabbit

Yes, this is exactly what it looks like: a WiFi-enabled rabbit. Unlike Peter Cottontail, this device tells you the time, a recap of the week, RSS news feeds, a report on the air quality or traffic, an MP3 alarm clock, a weather forecast, a stock ticker, and even e-mail alerts.

Good Night Lamp

tmp566261011321978880

In essence, the Good Night Lamp is a physical social network. The lamps, which come in a set of two, work in unison. Turning on the larger one not only emits light but triggers on the little one as well. This connectivity allows you to keep in touch with people all over the world without having to pick up the phone.

Tagg Dog Collar

pet_tracker

Tagg is a GPS device that attaches to the collar of your dog. The system enables pet owners to define a safe zone around there home and instantly receive text and email alerts when the pet leaves that zone. What’s more, the wearable also monitors their activity and fitness by measuring the amount of activity in their day.

Mimo Baby Shirt

20131216-restdevices_mimo-0334-copy

Boston-based startup Rest Devices has developed a smart baby onesie for parents. Founded by a group of former MIT students, Mimo monitors the respiration, skin temperature, body position, sleeping and activity levels of infants. Meaning, those with newborns will soon no longer have to worry about getting up and frequently checking on the baby throughout the night, instead only when necessary.

Nest Thermostat

nest-thermostat-auto-away

The Nest Thermostat doesn’t need to be programmed, and is equipped to learn and remember your temperature habits. Meaning, the device turns itself down when you’re away to help save energy and can change the temperature from anywhere using your smartphone, tablet or laptop.

HAPI Fork

specs-5forks

The smart fork, which was introduced at last year’s CES, uses electronic sensors to monitor your eating habits. Designed by HAPILABS, the ARM Cortex-M0 embedded utensil tracks the number of bites, intake speed as well as notifies you to step away from the dinner plate. This information is then uploaded via USB or Bluetooth to an online dashboard to analyze your progress.

Narrative Camera

camera_narrative-clip-teardown-02

The future for anyone who wants to tell their own story has never looked brighter. That is because of the Atmel | SMART SAM9G25 powered Narrative Clip — a tiny, automatic 5-megapixel camera paired with an app that offers users access to a “photographic memory” which is both searchable and shareable. Clip it onto your shirt and let it snap away, recording all your daily activities in 30-second increments.

Feeling inspired? Head over to element14’s official contest page here to get started. The grand prize winner will receive a trip to World Maker Faire 2015 in New York.

16 ordinary objects ‘enchanted’ by smart technology

According to MIT Media Lab researcher David Rose, the term “enchanted object” is used to describe any everyday object with extraordinary functions. “We are now standing at the precipice of the next transformative development: the Internet of Things. Soon, connected technology will be embedded in hundreds of everyday objects we already use: our cars, wallets, watches, umbrellas, even our trash cans. These objects will respond to our needs, come to know us, and learn to think on our behalf,” Rose notes in his latest book.

EnchantedObjectsPoster

Entitled “Enchanted Objects: Design, Human Desire, and the Internet of Things,” the book depicts the blueprint for a better (or shall we say ‘smarter’) future, where efficient solutions come hand in hand with technology that delights our sense. Not only are these innovative things fun and alluring, they may hold the key to better satisfying our needs and improving our lives. “The big lesson here for companies is that they need to embrace and start designing for this world of enchanted objects,” Rose said in a recent BI:Tech interview. “It will mean a key change for how we interact with technology, and it’s a great opportunity for all of these traditional product companies.”

Rose believes that the IoT will be fully realized in the near future. To prepare for it at this moment, he is developing technology that analyzes photographs. The die-hard Maker emphasizes that cameras will soon be everywhere, capturing photos of everything. “We’re already seeing this materializing. DropCam allows people to stream videos of their homes and the Narrative camera records everything you do in a day. The photos recorded by these devices are not attractive or artistic, but the meta-data within them is stunning,” he told Fast Company

As we prepare for this embedded future — where versatile microcontrollers will give once-ordinary objects super “powers” — let’s explore some of the coolest, most enchanted objects currently in our world today. From a pill bottle that can alert you when you’ve skipped your medication to an umbrella that says whether it’ll rain, these objects provide us with a glimpse into smarter society — one where fairy tales actually become reality.


Vitality GlowCap

the-vitality-glowcap-reminds-you-to-take-your-medications-by-lighting-up-making-chirping-sounds-and-eventually-sending-you-a-text-message-you-can-share-your-medication-data-with-a-remote-loved-one-a-professional-caregiver-and-your-pharmacy

Always seem to forget to take that pill in the morning or before bed? This smart cap will remind you to take your medications by lighting up, making chirping sounds, and eventually sending you a text message. You can share your medication data with a remote loved one, a professional caregiver, and even your pharmacy. No more calling to refill those prescriptions!


The Ambient Umbrella

the-ambient-umbrella-has-a-handle-that-will-glow-if-snow-or-rain-is-in-the-forecast-reminding-you-to-grab-it-on-your-way-out-the-door

What if your umbrella had a handle that would glow if snow or rain was in the forecast? You’ll never forget to grab it on your way out the door again!


Google Latitude Doorbell

the-google-latitude-doorbell-created-at-the-mit-media-lab-chimes-a-tune-when-a-family-member-is-approaching-the-house-each-family-member-has-their-own-tune.jpg

Created at the MIT Media Lab, the Google Latitude Doorbell chimes a tune when a family member is approaching the house. Each family member has their own tune. Have some fun with it: Imagine setting it to play “Master of the House” from Les Misérables as you approached the door, or the Jaws theme song for your mother-in-law.


The Ambient Orb

the-ambient-orb-tracks-real-time-data-for-the-stock-market-pollen-count-traffic-congestion-and-more-and-glows-specific-colors-to-let-you-know-if-the-data-looks-good-or-bad

When you think of David Rose and ambient object, this “magical” orb is often times the first thing that pops into mind. This device tracks real-time data for the stock market, pollen count, traffic congestion, and more, and glows specific colors to let you know if the data looks good or bad.


SunSprite

sunsprite-is-a-small-clip-that-measures-the-amount-of-bright-light-you-take-in-during-the-day-in-order-to-help-you-improve-your-energy-levels-sleep-cycle-mood-and-more.jpg

Feel like you’re walking on sunshine? This small will let you know whether you’re actually taking in enough bright light during your day, in order to help you improve your energy levels, sleep cycle, mood, and so much more.


Energy Joule

the-energy-joule-tracks-energy-prices-by-glowing-red-if-prices-are-high-yellow-if-prices-are-average-and-green-if-prices-are-low

Let’s face it, energy bills are the worst — especially those living in extremely cold climates in the winter and warm in the summer. To better help you save a buck or two, the Energy Joule can track energy costs by glowing red if prices are high, yellow if prices are average, and green if prices are low.


The Facebook Coffee Table

CoffeeTable

“Like!” Developed at the MIT Media Lab, this incredibly social-savvy coffee table listens to your conversations and displays photos from your Facebook page whenever they are appropriate to the conversation. Think Mark Zuckerberg meets Minority Report.


MemoMi

memomi-is-a-mirror-that-records-the-outfits-you-try-on-so-you-can-compare-them-and-decide-what-to-buy-or-wear.jpg

Never quite sure as to which outfit to buy? Ladies, you’re in luck. This smart mirror records the outfits you try on, so you can compare them and decide what to buy or wear. Never have to go back and forth again.


Amazon Trash Can

the-amazon-trash-can-created-at-the-mit-media-lab-scans-any-objects-youre-throwing-away-and-automatically-re-orders-them-from-amazon.jpg

Forget to replace the toilet paper? Run out of milk? Need laundry detergent? This trash can can now scans any object you’re disposing and automatically reorder it from Amazon.


Pandora Chair

the-pandora-chair-created-at-the-mit-media-lab-plays-different-music-based-on-your-level-of-incline-if-youre-sitting-upright-the-chair-will-play-upbeat-music-if-youre-leaning-back-it-will-play-something-peaceful.jpg

Created at the MIT Media Lab, the chair plays various music based on your level of incline. Envision the possibilities: Sit back, relax and enjoy the tunes of the caribbean. Or, sit upright, intensely focus on your work while listening to some “Eye of the Tiger.”


Vessyl

vessyl-is-a-smart-cup-that-identifies-what-kind-of-liquid-youre-drinking-and-lets-you-know-how-many-calories-and-how-much-sugar-fat-protein-sodium-and-caffeine-are-in-that-drink.jpg

As our days get too busy, it can quickly become too difficult to manage our liquid intake. Luckily, a smart cup can do that for you — it knows what kind of fluid you’re drinking and track how many calories and how much sugar, fat, protein, sodium, and caffeine are in that beverage.


The Skype Cabinet

the-skype-cabinet-created-at-the-mit-media-lab-allows-you-to-simply-open-a-wooden-door-and-connect-to-a-friend-or-loved-one-via-skype-a-proximity-sensor-allows-the-cabinet-to-glow-when-a-friend-is-available.jpg

Tired of always having to grab the computer, flip it open and sign into Skype? Thanks to this recent creation from MIT Media Lab, all you have to do is simply open a wooden door and connect to a friend or loved one via Skype. No more setup, bad lighting, or those irritating headphones.


TrakDot

trakdot-is-a-luggage-tracker-that-you-place-inside-your-suitcase-you-can-then-see-the-location-of-your-luggage-by-using-the-trakdot-app-which-connects-to-the-tracking-device.jpg

NOTHING, we repeat NOTHING is worse than losing your luggage while traveling. This smart luggage tracker can slide right inside your suitcase and inform you of its whereabouts using its companion app, which connects to the tracking device.


Energy Clock

Clock

Are the culprit in your household’s excessive energy consumption? This innovative clock shares real-time feedback on the amount of energy your home is using. It learns your consumption habits, then offers some subtle feedback on how you’re tracking against yourself.


Goji Smart Lock

20130603114032-Side_image

As we inch closer to a Jetsons-like future, of course there will be smart locks! Easily lock and unlock your door with your smartphone, after snapping pictures of visitors at your door and automatically sending real-time picture alerts to your device.


Nabaztag

Nabaztag-rabbit-an-internet-rabbit

Yes, this is exactly what it looks like: a WiFi-enabled rabbit. Unlike Peter Cottontail, this device tells you the time, a recap of the week, RSS news feeds, a report on the air quality or traffic, an MP3 alarm clock, a weather forecast, a stock ticker, and even e-mail alerts.


IoT’s Impact on Human-Tech Relationship

In a recent interview with O’Reilly Radar, Rose explored technology and its implications by first focusing on user needs. He stated, “I am confident that enchanted objects will change how we live. They will change health. They will change transportation. They will change housing. They will change how we understand our own habits around energy and resource conservation, and they will even help us with creativity and expression. I’m confident there’s a promising future in terms of this new way of interacting and positioning ourselves relative to technology. I think one of the biggest challenges is to not think about this as computing. I don’t think there is a ‘future of computing.’”

As O’Reilly Radar’s Mary Treseler notes, designers and entrepreneurs alike must focus on creating products and services that focus on human desires and needs — omniscience, telepathy, safekeeping, immortality, teleportation, expression, many of which mentioned above.

“If you can invent things that resonate with people’s existing drives, desires, fantasies — the ones that we’ve had for a millennium that are revealed through fairy tales and through folklore and through pop culture — you’re much more likely to succeed,” Rose adds. (You can listen to the entire interview here.)

Evident from the ambient objects above, a connected future is well on its way. From lighting to energy, a new generation of smart products set to increasingly power our lives calls for smarter chips. Internet and wireless enabled devices embedded with microcontrollers will give these once-ordinary “things” new science fiction-like future. Evident by the aforementioned examples, David Rose’s concept serves as a blueprint for our next-generational world, one in which is equipped with countless sensors, data and real-time interaction.

Interested in reading more? Check out the MIT Media Lab researcher and Vitality CEO’s latest book here.

1:1 Interview with Michael Koster


Three-part Interview Series (Part 2)


Series 2 – IoT Toolkit and Roadmap

Tom Vu (TV):  What is in the roadmap for IoT Toolkit?

Michael Koster (MK):

The IoT Toolkit is an Open Source project to develop a set of tools for building multi-protocol Internet of Things Gateways and Service gateways that enable horizontal co-operation between multiple different protocols and cloud services. The project consists of the Smart Object API, gateway service, and related tools.

IoT Smart Object Structure

IoT Smart Object Structure

The foundation of the platform is purely bottom up, based on applying best practices and standards in modern web architecture to the problem of interoperability of IoT data models. I believe that the practice of rough consensus and running code results in better solutions than a top-down standard, once you know the basic architecture of the system you’re building.

To that end, I created a public github and started building the framework of the data model encapsulations and service layer, and mapped out some resourceful access methods via a REST interface. The idea was to make a small server that could run in a gateway or cloud instance so I could start playing with the code and build some demos.

The next step is to start building a community consensus around, and participation in, the data models and the platform. The IoT Toolkit is a platform to connect applications and a mixture of devices using various connected protocols.  It’s real power lies in its broader use, where it can span across all of our connected resources in industry, ranging from commerce, education, transportation, environment, and us. It’s a horizontal platform intended to drive Internet of Things more widely as an eventual de facto standard, built for the people who are interested in building out Internet of Things products and services based on broad interoperability.

IoT Sensor Nets Toolkit

IoT Applications Run on Cloud or On Gateway

We intend to create a Request For Comment (RFC), initiate a formal process for the wider Internet of Things platform and standards.  An community agreed upon process similar to the world wide web that we use today, based on rough consensus and running code, with RFCs serving as working documents and de facto standards that people can obtain reference code, run in their system to test against their needs, and improve and modify if necessary, feeding back into the RFC for community review and possible incorporation of the modifications.

The Internet of Things interoperability platform stands as an ideal candidate, leveraging the power of the open source community’s development process.  In turn, community involvement is taken to a new level, across many fields of discipline, and in many directions. Here is where we can get the most benefit of an agile community.  Crowdsource the development process based on principles of open communication and free of the need for participants to protect interests toward proprietary intellectual property.

We need to build the platform together meshed around the community of Makers, DIY, Designers, Entrepreneurs, Futurist, Hackers, and Architects to enable prototyping in an open ecosystem.  Proliferation then occurs; a diverse background of developers, designers, architects, and entrepreneurs have many avenues of participation. They can create a new landscape of IoT systems and products.

This broad participation extends to industry, academia and the public sector.  We are aiming for broad participation from these folks, build a global platform based on common needs. As a member of the steering committee, when I participated in the IoT World Forum, I heard from the technical leaders of enterprise companies (Cisco and others), research departments, and IoT service providers. They believe an open horizontal platform would be needed to enable applications that span across their existing vertical markets and M2M platforms.

Instead of a top-down approach, where people from corporations and institutions get together in a big meeting and put all their wish lists together to make a standard, we’re taking an overall bottom-up approach, bringing together a diverse community ranging from makers to open source developers, and entrepreneurs. Together with corporations, academia, and public sector, we all will participate in a very broad open source project to develop a platform that can be ubiquitous that everyone can use.

In many ways, this is modeled after the Internet and World Wide Web itself.  As we need to create a more formal standard, it will likely engage with the IETF and W3C. A good example is the semantic sensor network incubator project, which is an SSN ontology that describes everything about sensors and sensing. This enables broad interoperability between different sensor systems and platforms, based on common data models and descriptions. What we want to do is something similar to that, only on a more comprehensive scale and intended for the Internet of Things.

Tom Vu (TV):  Can you take us through a tour of the Data Object model importance and how it yields significance for simple and sophisticated connected devices?

Michael Koster (MK):

The Internet of Things today consists of many different sensor networks and protocols, connected to dedicated cloud services, providing access through smartphone and browser apps. It is rare for these separate “silos” to cooperate or interact with each other.

We abstract the complexity of sensor nets connecting devices and hardware by adding a layer of semantic discovery and linkage. This enables the sensors and actuators on disparate sensor nets to be easily combined to build integrated applications.

The way this works is using a few techniques. First, the different sensor nets are integrated through a common abstraction layer. This works a lot like device drivers in an operating system, adapting different devices and protocols to a common system interface. Only in this case, they are adapted to a common data model.

The common data model for sensor nets is based on the new IETF CoRE application protocol and sensor descriptions. This provides standard ways for common types of sensors to be discovered by their attributes, and standard ways for the data to be linked into applications, by providing descriptions of the JSON or BSON data structure the sensor provides as it’s output.

We use the W3C Linked Data standard to provide web representations of data models for sensor data and other IoT data streams. Linked data representations of IETF CoRE sensor descriptions are web-facing equivalents of CoRE sensor net resources. Linked data provides capabilities beyond what CoRE provides, so we can add functions like graph-based access control, database-like queries, and big data analysis.

Internet Smart Objects

Internet Smart Object

Internet of Things Applications are essentially graph-structured applications. By using Linked data descriptions of JSON structures and the meaning of the data behind the representation, we can create applications that link together data from different disparate sources into single application graphs.

Then we enable the platform with an event-action programming model and distributed software components. The common semantic language enables the data sources and software components to easily be assembled and make data flow connections. The result is an event-driven architecture of self-describing granular scale software objects. The objects represent sensors, actuators, software components, and user interaction endpoints.

FOAT Control Graph

Interent of Things with FOAT Control Graph


Tom Vu (TV):  Who and what companies should be involved?

Michael Koster (MK):

Whoever wants to participate in the building out of the Internet of Things. The people that use the infrastructure should build it out; the people who want to provide products and services based on interoperability, along with those who provide the backplane of thinking low power microcontrollers / microprocessors, connected sensors, and importantly the network infrastructure.

We want to enable all avenues of participation to allow corporations, academia, policy and standards makers, entrepreneurs and platform developers, makers, and DIY hackers all to be involved in building the platform as a community.

For corporations, we will provide an important role, to build a vendor-neutral platform for data sharing and exchange, an open horizontal platform that will allow the integration of what were traditionally vertical markets into new horizontal markets.

Anyone participating or expecting to participate in the emerging Internet of Things, Internet of Everything, Industrial Internet, Connected World, or similar IoT ecosystems initiatives, could benefit by participating in creating this platform. Companies that provide network infrastructure and want to build in value add can adopt this standard platform and provide it as infrastructure. Companies that want to provide new services and new connected devices that can use the IoT Toolkit to easily deploy and connect with existing resources could benefit.

All companies, organizations, and people that can benefit from an open Internet of Things are welcome to participate in the creation of a platform that everyone can use.

Tom Vu (TV):  How important is Open Source to Internet of Things evolution?

Michael Koster (MK):

I don’t see how the Internet of Things can evolve into what everyone expects it to without a large open source component. We need to go back to Conway’s law and look at it from both the system we’re trying to create and the organization that creates it. Interoperability and sharing are key in the system we want to create. It’s only natural that we create an open development organization where we all participate in both the decisions and the work.

Removing the attachment of intellectual property, changes the dynamics of the development team, keeps things engaged and moving forward solving problems. It’s important for software infrastructure projects like this to remove the barrier to cooperation that arises from the self-protection instinct around proprietary Intellectual Property, or even egoism associated with soft intellectual property, “my” code.

Instead, we turn the whole project into a merit-based system as opposed to being ego driven.  Rather than worry about guarding our property, we are motivated to solve the problems and contribute more to the deliverable. The limits to participation are removed and there is a more rapid exposure of intentions and goals. Engagement and innovation can rule in this environment of deep collaboration.

Tim Berners-Lee said that he was able to achieve the creation of the World Wide Web system because he didn’t have to ask permission or worry about violating someone’s copyright. We are creating the same environment for people who want to build our platform, and even for those who want to build their services and applications on top of the platform.

We are going to create the service enabled layer as open source as well so that any one of the companies can help proliferate the idea and everyone has influence and access to the development of the underlying IoT platform.  If it’s open source infrastructure and platform software, you can make a service on top of that software that can contain proprietary code. With our license, you can even customize and extend the platform for your own needs as a separate project.

Tom Vu (TV):  Describe your work with the EU IoT organization and how you are involved as a voice for the Internet of Things?

Michael Koster (MK):

I work with the IoT Architecture group within the overall EU Internet of Things project. The IoT-A group is closely related to the Future Internet project. They have an Architecture Reference Model describing different features one might build in an IoT platform, a sort of Architecture for Architectures. Since their process mirrors my own design process to a large extent, I found their reference model to be compatible with my own architecture modeling process.

They are conducting a Top-Down activity, stewarding the participation in the architecture and standardization model.  One of the ways I work with IoT-A is to use the Smart Object API as a validation case for the Architecture Reference Model. They are building the reference model top down, and we’re building the architecture bottom-up, based on a common expression of architecture relationships and descriptions.

I am also involved in advocating open source of IoT and building of local IoT demonstrator projects, educating around IoT, open data, etc. as well as user controlled resource access and privacy.  I am providing a voice for open source and open standards, into the standards movement going forward.

Here in the USA, there is not anything like what they have in Europe. Here the process will be to engage corporations and institutions and create a participatory structure that enables fair and open opportunity for influence and access to both the development process and the final products.

Tom Vu (TV):  How important is an open standard – building of an RFC in which all industries can agree upon ultimately serving to a wider scale factors of adoption and proliferation?

Michael Koster (MK):

To simply put it, the construction of a formal RFC is something that describes part of system.  A Request for Comments (RFC) is a memorandum published by the Internet Engineering Task Force (IETF) describing methods, behaviors, research, or innovations applicable to the working of the Internet and Internet-connected systems.  It is a process or evolution in achieving a more widely adopted standard.  The founders of the Internet created this process, and http, etc are all built using original RFC process from many years ago.

Through the Internet Engineering Task Force, engineers and computer scientists may publish discourse in the form of an RFC, either for peer review or simply to convey new concepts, information, or (occasionally) engineering humor. The IETF adopts some of the proposals published as RFCs as Internet standards.

If the IoT Toolkit platform becomes adopted, it may eventually be as many as 10-12 different RFCs, but it’s important to get people to agree on common first set.  This is the initial phase into a more pervasively used universal standard.  In fact, it’s sort of like a strawman platform.  It’s intent is to describe and collaborate, but also invoke and seek out broader participation…  We are at the stage of putting proposals together over the next few weeks and setting up meetings to talk to many people around collaboration and participation in building an Internet of Things platform.

We believe that an open standard platform for horizontal interoperability is key to achieving the promise of the Internet of Things. Everyone needs to be able to present and process machine information in machine understandable formats on the IoT, just as we humans enjoy commonly understandable web data formats and standardized browsers on today’s WWW. It’s important that developers be able to focus on solving problems for their clients and not waste resources on communication and translation.

Read Part Three to Learn More about Why IoT (Internet of Things) Matters?

Here are Part 1 and Part 2 of the Interview Series.