- Terminus FE1.1 USB hub board: the solution to connect four USB devicesPosted 3 months ago
- Understanding the Mechanics of 3D PrintingPosted 4 months ago
- SDS011 the Air Quality SensorPosted 5 months ago
- NIXIE STYLE LED DISPLAYPosted 9 months ago
- TOTEM: learning by experimentingPosted 9 months ago
- Google Assistant Voice Controlled Switch – NodeMCU IOT ProjePosted 9 months ago
- Water Softener Salt Level MonitorPosted 9 months ago
- Sparkly Air SensorPosted 10 months ago
- Ultra sonic distance finder with live statusPosted 10 months ago
- Windows interface to have total control over lampsPosted 10 months ago
Oracle Open Sourced Graphpipe to Improve the Deployment of Machine Learning Models
Oracle open-sourced Graphpipe, a tool created to make it easy to serve machine learning models in the cloud made by popular frameworks like TensorFlow, MXNet, Caffe2, and PyTorch.
GraphPipe is designed to solve three particular challenges: First, there’s no standard for model serving APIs, meaning business applications typically need a bespoke client to communicate with a deployed model. Next, building a model server is simply hard, and there are few out-of-the-box solutions for deployment. Lastly, the solutions that enterprises typically use now — like a python-JSON API — don’t provide the performance needed for critical business applications.
GraphPipe includes: a set of flatbuffer definitions, guidelines for serving models consistently according to the flatbuffer definitions, examples for serving models from various machine learning frameworks, and client libraries for querying models served via GraphPipe.
With these tools, a business should be able to deploy a model across multiple servers, or create an ensemble of models from different frameworks, with a common protocol. GraphPipe should also help deploy machine learning for IoT applications that rely on running models remotely.
The tool is available for free on Github and joins a series of open source tools launched in recent years for developers who want to use AI.