Please provide your feedback in this short Flings' survey.
fling logo of Supernova - Accelerating Machine Learning Inference

Supernova - Accelerating Machine Learning Inference

version 1.2 — December 17, 2020

Contributors 6

View All

Summary

With machine learning is widely used in enterprises, big data are trained on the edge, inference services go to production either in the cloud or on the edge.

On the edge

  • Edge devices have limited resources, space and power supply
  • Edge servers cost much higher than devices
  • Hardware accelerators are heterogeneous in architecture and various on interfaces and performance on the edge

In the cloud

  • Accelerator market is dominated by Nvidia GPU
  • Other options come as AMD GPU, Intel Habana Goya/Altera FPGA, AWS Inferentia, Xilinx FPGA etc
  • Common inference interfaces from cloud to edge doesn’t appear generally
  • Limitation on specific hardware accelerators or cloud leads to new vendor lock-in

Project Supernova is to build a common machine learning inference service framework by enabling machine learning inference accelerators across edge endpoint devices, edge systems and cloud, with or without hardware accelerators.

  • Micro-service based architecture with Restful API
  • Support heterogenous system architectures from leading vendors
  • Support accelerator compilers to native code
  • Neutral to ML training framework file formats
  • Work on both edge devices and clouds
  • Support Xilinx Cloud FPGA
  • Hardware CPU support:
    • x86-64, ARM64
  • Hardware accelerator support:
    • Intel VPU, Google Edge TPU, Nvidia GPU, AMD GPU
  • Software
    • Inference toolkit support: OpenVINO, TensorRT & Tenserflow Lite
    • Training framework data format: Tensorflow, Caffe, ONNX, MxNet

Requirements

The common computing platforms including most resource-constrained edge system, PC, server, etc, where can deploy Linux/Docker.

Instructions

Instructions are included in the download directory as "Supernova Quickstart Guide.docx"

Changelog

Version 1.2 Update 

  • Support Xilinx Cloud FPGA

Version 1.1 Update

  • Support Bitfusion
  • K8S and docker-compose deployment

Version 1.0 Update 

Compared 0.0.1, this release supports:

  1. New HW accelerators - AMD GPU + Xilinx FPGA
  2. CPU Accelerations with OpenVINO
  3. Basic K8S deployment
  4. Versatile APIs
  5. vSphere Bitfusion support
  6. More use cases like facial mask
 
It's version 2 compared to Fling version 1, https://flings.vmware.com/supernova-accelerating-machine-learning-inference,
  1. New HW accelerators - AMD GPU + Xilinx FPGA
  2. CPU Accelerations with OpenVINO ased on AVX/SSE
  3. Basic K8S deployment
  4. Versatile API set
  5. More use cases like facial mask
  6. vSphere Bitfusion support

Please add the following two lines for our release:

Similar Flings

No similar flings found. Check these out instead...
Jun 01, 2021
fling logo of Horizon Event Notifier

Horizon Event Notifier

version 1.5

This tool connects to one or more existing Horizon View Event Database(s) and allows the user to customize which types of alerts to be notified on.

Apr 12, 2021
fling logo of Horizon Session Recording

Horizon Session Recording

version 2.2.5

VMware Horizon Session Recording allows administrators of a VMware Horizon environment record their users activity in their Blast Extreme virtual desktop and application sessions.

Nov 09, 2022
UPDATED
fling logo of Workspace ONE ConQuest

Workspace ONE ConQuest

version 2

ConQuest configures Meta Quest 2 VR consumer devices for enrollment into Workspace ONE UEM. ConQuest is an application for Windows that can be run once a Meta Quest 2 device is set to developer mode and connected to the Windows device via USB. (Mac/Linux versions to follow)

Oct 12, 2022
fling logo of HCIBench

HCIBench

version 2.8.0

HCIBench stands for "Hyper-converged Infrastructure Benchmark". It's essentially an automation wrapper around the popular and proven VDbench open source benchmark tool that makes it easier to automate testing across a HCI cluster.

Jan 22, 2020
fling logo of Cross vCenter Workload Migration Utility

Cross vCenter Workload Migration Utility

version 3.1

This Fling allows users to easily migrate virtual machines in bulk from a graphical user interface between vCenter Servers (same & different SSO Domains supported) using the Cross-vCenter vMotion feature.

Jul 01, 2012
fling logo of Guest Reclaim

Guest Reclaim

version 1.0

GuestReclaim reclaims dead space from NTFS volumes hosted on a thin provisioned SCSI disk. The tool can also reclaim space from full disks and partitions, thereby wiping off the file systems on it. As the tool deals with active data, please take all precautionary measures understanding the SCSI UNMAP framework and backing up important data.

View More