Google's TensorFlow Serving Goes Open-Source


Some readers are likely to be more familiar with the concept of machine learning than others. In short, it's a way for an A.I. to be constantly improved that works by allowing the system to look over data it's compiled in the past and by figuring out what's related and appropriate, learn how to handle situations involving new data. Machine learning is used extensively in things like A.I. voice assistants, security suites and search engines. Alphabet, in fact, makes extensive use of machine learning. So extensive, in fact, that they developed their own system for it, called TensorFlow. The deployment module that allows TensorFlow systems to receive new data, be implemented in existing systems and be improved upon while still working is a vital part of TensorFlow. It is this part that Google announced on February 17 has now gone open-source.

Google previously made the main part of TensorFlow open-source, but now that Serving has joined the main piece of the puzzle on GitHub, those who want to implement machine learning but couldn't make their own system for whatever reason, will be able to use Google's in-house system for their own operations. TensorFlow serving is also compatible with home brewed and commercial machine learning solutions, allowing for fairly simple in-place deployment of just about any type of machine learning system within a service framework, as well as iteration on the solution's core and feeding it new data.


TensorFlow Serving, even with tweaks to make the open-source version compatible with systems outside of Google's stable, is extremely efficient; On a top of the line machine and pushing the main TensorFlow program, it managed to output up to 100,000 operations per core per second in testing. TensorFlow serving is written in C++, making it extremely versatile and easy to port to just about any architecture or machine. The blog post from Google also touts Linux compatibility. TensorFlow Serving is up on GitHub right now under the Apache 2.0 open source license. If you're curious about the new system, about machine learning in general, or you know exactly what you're doing and you'd like to see how TensorFlow serving can improve your machine learning system, hit up the source link to read the detailed blog post from Google in full and complete with GitHub link.

Share this page

Copyright ©2016 Android Headlines. All Rights Reserved.

This post may contain affiliate links. See our privacy policy for more information.
Senior Staff Writer

Daniel has been writing for Android Headlines since 2015, and is one of the site's Senior Staff Writers. He's been living the Android life since 2010, and has been interested in technology of all sorts since childhood. His personal, educational and professional backgrounds in computer science, gaming, literature, and music leave him uniquely equipped to handle a wide range of news topics for the site. These include the likes of machine learning, Voice assistants, AI technology development news in the Android world. Contact him at [email protected]

View Comments