MMI Task Force
Spatial intelligence project
Wearfit project
2021
MMI TF (multimodal interaction TF)(2021-2023)
Insights :
Some initial ideas within scenarios –
•User is jogging while listening to music in Samsung Galaxy buds – text message notification – User swipes on buds – Buds reads out message – User swipes again to reply using voice
•
•User has written grocery list on fridge – opens camera – asks camera to save the list into reminders
Ideations resulted in few concepts.
After thorough feasibility checks and scrutiny, one feature was taken for commercialization into Samsung Handsets.
It is an early variant of Circle to search
Task force was created to brainstorm and create new ideas for handset which can help users perform day to day tasks easier with the help of multimodality
Multimodality :
Humans are multimodal beings, natural interactions are usually multimodal in nature
Highly simplified user journey example :
Learnings :
•Using each individual device capability to bring seamless natural experience to users. Transition of tasks while maintaining synergy between various services and devices
•Collaborating with third party vendors for making a 2 minute long concept video
User is running in park with buds on, listening to music
They get a notification – message from friend about meetup plan
After he listens to the message read out, he asks bixby to enter meetup schedule into calendar
After confirming his input, Bixby creates calendar
Calendar entry and reminder is set for the user about meetup with friend
Spatial Intelligence Project (2021)
The scenario chosen was a complex one, which is shopping and indoor navigation using VPS.
Concepts were centered around :
•Spatial app design
•Navigating to product
•Finding info about product
•Consulting a loved about the product
•Purchase experience
UI/UX, concepting for emerging, internal tech
Context :
This project was based on a requirement set forward by R&D team at HQ in South Korea.
Due to pandemic, the world was seeking less interpersonal interaction and this concept was about using Samsung smart tag technology in conjunction with AR capabilities to help user in day to day scenarios.
Learnings :
Intricacies of creating a user journey for navigating in real world using AR in phone. A POC was made for this concept, at office space, shopping experience was enacted.
User is in mall, and they reach decathlon
Spatial intel app of that shop is opened, user searches for product
Spatial intel app of that shop is opened, user searches for product
After reaching the product they can get more info demo etc
User can ship product directly to home or purchase in hand
Wear fit project (2021)
Our ideation centered around using :
•Galaxy watch
•Galaxy buds
•Samsung smart tv and its cameras
•Samsung smart things ecosystem
A combination of all of this will contribute to users’ gamified fitness journey
Insights :
•If venturing into a new area, we found it best to make our fitness games unique so that users do not benchmark it against already existing products
•Use the strength of each individual hardware for improving the experience, loop in any hardware that could aid the experience
Research, Product landscape understanding, concepting
Context :
Products like Nintendo Switch’s Ringfit Adventure was showing promise in the gamified fitness landscape
Myself and the team dived into the possibilities of using hardware and software from Samsung’s own to create a similar or comparable gamified fitness experience
Learnings :
An understanding about tech based fitness landscape, apps, services, hardware those are on the forefront in gamified fitness
A gameplay image of Ringfit Adventure
Samsung hardware – Galaxy Buds, Watch
