Consider the average consumer. Their Apple or Android devices are constantly spying on them and sending telemetry back through the Google and Apple Mesh networks. The phones are designed to constantly send back your location via Google's SUPL GPS outdoors and through WiFi scanning indoors. Since each phone has a unique ID, this location can then be matched to you, and through cross-device tracking to everything you do online on a computer. Google knows where you sleep at night, and if you have an Apple phone, both Apple and Google know because Apple piggybacks onto Google's proprietary technology protocol at the celltower level. That's just one issue of physical tracking, we're not getting into the data of your phone activity which is also being monitored through closed-source software. There are projects to create an open-source Linux phone, but as these projects are not economically viable they require donations. Has the average person donated? No, they don't give a shit. They also haven't installed GrapheneOS or a similar custom operating system that could protect their privacy to some extent. These days, cars are filled to the brim with spyware. The car company can track essentially all your movements because the car is hooked up to the Internet. Some manufacturers have even started to force the car owners to pay subscriptions to take advantage of features that are already installed into the vehicle, e.g. heated car seats. Has the average person complained about the tracking, about not being able to use all the features of the products they already paid for? No, they don't give a shit. Since Windows 10 and onward, Windows itself also comes packaged with a ton of spyware which people have found a way to remove but require you to complete a complex series of steps during installation. Has the average person done this? Of course not. On the subject of "Smart" TVs, any TV you hook up to the Internet is always sending back your personal information through the Google Mesh network. The information piggybacks its' back way to Google using smart objects in your environment: your neighbour's WiFi, your smart meter, the LED smart lamp posts the city installed outside under the pretense of the environment, all the way up to celltowers and then Big Tech. On the hardware level, the circuit board housing the speaker also houses a microphone. In other words, if you hook your TV to the Internet, it's likely that everything you say is also being sent back but we can't know because the code is also closed-source. Some gaming consoles and other accessory devices have also started to include cameras, which are likely used exactly as you would expect.
So we've established that the average person is an absolute moron with no understanding of the technology they use and zero survival instincts and zero ability to see how things could spin of control. What do you seriously think would happen if an AI was implemented? It would remain open-source, all bunnies and rainbows, no corruption or data-mining at all? Of course not. That's pure fantasy. They would use the information gathered by the AI on you to exploit and manipulate you at levels you could scarcely even imagine.