Welcome to Project Soli

My name is Ivan Poupyrev, and I work for Advanced
Technology and Projects group at Google. The hand is the ultimate
input device. It’s extremely precise,
it’s extremely fast, and it’s very natural
for us to use it. Capturing the possibilities
of the human hand was one of my passions. How could we take
this incredible capability, the finesse of human actions
and finesse of using our hand, but apply it
to the virtual world? We use radio frequency spectrum,
which is radars, to track human hand. Radars have been used
for many different things– to track cars, big objects,
satellites and planes. We’re using them
to track micro motions, twitches, of the human hand and then use that
to interact with wearables and Internet of Things and other computing devices. Lien: Our team is focused
on taking radar hardware and turning it
into a gesture sensor. Radar is a technology which transmits a radio wave
towards a target, and then the receiver
of the radar intercepts the reflected energy
from that target. The reason why we’re able
to interpret so much from this one radar signal is because of the full
gesture recognition pipeline that we’ve built. The various stages
of this pipeline are designed to extract
specific gesture information from this one radar signal
that we receive at a high frame rate. Amihood: From these strange,
foreign range Doppler signals, we are actually interpreting
human intent. Karagozler: Radar
has some unique properties when compared to cameras,
for example. It has very high
positional accuracy, which means that you can sense
the tiniest motions. Schwesig: We arrived
at this idea of virtual tools because we recognized
that there are certain archetypes of controls,
like a volume knob or a physical slider,
a volume slider, Imagine a button between your thumb
and your index finger, and the button’s not there, but pressing this
is a very clear action. And there’s an actual
physical haptic feedback that occurs as you perform
that action. The hand can both embody
a virtual tool, and it can also be, you know, acting on that virtual tool
at the same time. So if we can recognize
that action, we have an interesting direction
for interacting with technology. Poupyrev: So when we started
this project, you know, me and my team,
we looked at the project idea, and we thought,
“Are we gonna make it or not? Eh, we don’t know.” But we have to do it. Because unless you do it,
you don’t know. Raja: What I think I’m most
proud of about our project is, we have pushed
the processing power of the electronics itself
further out to do the sensing part for us. Poupyrev:
The radar has a property which no other technology has. It can work through materials. You can embed it into objects. It allows us to track
really precise motions. And what is most exciting
about it is that you can shrink
the entire radar and put it in a tiny chip. That’s what makes this approach
so promising. It’s extremely reliable. There’s nothing to break. There’s no moving parts. There’s no lenses. There’s nothing,
just a piece of sand on your board. Schwesig: Now we are at a point
where we have the hardware where we can sense
these interactions, and we can put them to work. We can explore
how well they work and how well they might work
in products. Poupyrev:
It blows your mind, usually, when you see things people do. And that I’m really
looking forward to. I’m really looking forward to releasing this
to the development community, and I really want them
to be excited and motivated to do something cool with it,

100 thoughts on “Welcome to Project Soli

  1. This innovation is coming to pixel 4 …that means for gaming VR too , and button less phone. And a virtual stylus pen .

  2. Помоему просто сорит своими ипителиями над датчиком.

  3. Pixel 4…OK sure, that will be a nice proof of concept, but the real game changer here (and the real money) is going to come when Google sells this chip to everyone and it becomes ubiquitous. No doubt that's why they've put effort into mocking up other devices and have designed a logo for it so people can recognize that their microwave, coffee maker, or radio has this chip in it.

  4. need further development like adding a master who had access or admin because someone might use the self destruction button unexpectedly

  5. Nice tech, but combined with a google phone… Never again masturabate near your mobile or google will know!

  6. Cool stuff, but is anyone doing serious research on how all these EM waves are affecting us? Bluetooth, cellular data, radar, xray, microwave,….. and many others. It just seems we're getting a higher dose, and from parts of the EMS that we never did before.

  7. Have been watching this video for the last four years; they said it's coming but no sign of it yet.

  8. This Swedish company raytelligence.com is using radar technique with AI to measure and monitor vital signs and other data for elderly care.

  9. The possibilities are endless. I thought of surgeons doing microsurgery with robotic hands remotely. Holy smokes this is genius

  10. Anybody else hear "interact with werewolves" at first instead of "wearables?" I was thinking heck yes, bring me werewolf interaction!

  11. The way of the Segway. Google burning ad money and wasting talent by barely focusing on user needs. Meanwhile, Gmail seems reliable and was well-designed, but it's being crapified. Web search was good, but has become biased crap to suit political/intelligence need, as has Google News. Android was crap from the get-go and has stayed crap. Nothing on the self-driving auto front, while the competition is pulling ahead. Youtube and Google Map/Earth are very good, neither was made in-house.

  12. I am planning to implement in our products and looking contact person who can provide soli sensor details, can you please share contact details if you have

  13. I see absolutely nothing intuitive about this method of interaction. It's cool tech but I don't see it being useful for common consumers if it doesn't feel intuitive to use

  14. Once again one company comes up with an idea and does the R&D. Then Apple will perfect it in about 2 years and call it their own.

  15. Fast forward to next year when I try to unlock my device with this and get locked out because of too many tries.

  16. So I am a little late getting my Google 3. But then I just learned that Apple made a deal with Intel and is now going to build its own chips.

  17. So.. it's project natal(Kinect) for your phone? Just glad it's run by Google and not M$.. otherwise they'd release it and then remove most of the features later on.. Sorry bro, got ya money!

  18. I see Soli becoming not only a difference between other smartphones for Pixel 4 from a technical point of view, but, if Google does this right, it could be the next generation of interaction with devices, much like the same way Apple changed touchscreens.

    This could become an advanced new UI for Pixels. I just hope that they have some convincing ways of 3rd party developers being able to show off what Soli can really do.

  19. This wold be interesting on a game console hooked to a large TV screen, that I use from the other end of the room. The phone is in my hands.

  20. Jesus, this is so clever, great implementation is critical as this could easily just be a gimmick but if it can be used thoughtfully and intelligently it could change the market and make everything around it feel just old.

  21. People commenting upon the wasted time and money on this technology which is not going to be used anywhere…
    "Meanwhile Google Pixel 4 promo and leaks"😅

Leave a Reply

Your email address will not be published. Required fields are marked *