An robotic eye made of lines and concentric circles with digits on the sideImage via The Indian Express. Some of the problems that developer face when implementing on-device machine learning solutions in their apps is that they increase the size of the APK, performance can take a hit on less powerful hardware, and there is a lack of more advanced features because developers tend to utilize older APIs to target more devices and users.
Machine learning (ML) is now widely used in a wide range of applications for many different use-cases. On-device ML has many advantages over its server-based version, including minimal latency and independence from internet connectivity, but it also has many disadvantages. With the Android ML Platform, which is scheduled to launch later this year, Google promises it will fix these issues.
Google will tackle all these issues with its Android ML Platform, which it is boasting as an updateable and integrated on-device inference stack. APKs will not have to include machine learning libraries because the binaries for TensorFlow Lite will already be present in the OS. Performance will be managed and optimized by the system, which includes automatic triggering of hardware acceleration, among other things. Moreover, it will feature a standard Neural Networks API that spans across multiple Android versions.
More importantly, this API will be decoupled from the OS in the sense that updates can be offered via Google Play Services instead of having to release an OS update. In the same vein, Google is also collaborating with chipset manufacturers so that driver updates can be delivered in the same way and the dependency on OS updates is reduced.Google says that the Android ML Platform will be made available later this year, but those interested in testing it sooner can sign up for the early access program here.