People are sensitive to video. Looks at the reaction from the Ring Super Bowl commercial and Nest Camera video retrieval news from a few weeks ago.
Your phone and watch are spyware mostly just spying on you. Sure they could be used to spy on others but the directness of an always on smart glass camera lens in one’s face is a little more jarring.
People don't have issues with smartphones, smartwatches, or any other "smart" stuff that isn't spyware.
The issue isn't smarts, it's supporting stasi-as-a-service.