The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Triton Inference Server provides a cloud and edge inferencing solution optimized for both CPUs and GPUs. Triton supports an HTTP/REST and GRPC protocol that allows remote clients to request inferencing for any model being managed by the server. For edge deployments, Triton is available as a shared library with a C API that allows the full functionality of Triton to be included directly in an application.
Category: C/C++ / Artificial Intelligence
Watchers: 116
Star: 3.8k
Fork: 905
Last update: Jun 30, 2022

Related Repos

etri About the Project The repository contains some examples of pre-trained SNN (Spiking Neural Network) models. The models were trained using the MM-BP tr

chenjianqu The MOT implement by Solov2+DeepSORT with C++ (Libtorch, TensorRT).

mmp Source code for pbrt, the renderer described in the third edition of "Physically Based Rendering: From Theory To Implementation", by Matt Pharr, Wenzel Jakob, and Greg Humphreys.

jose-villegas A real time global illumination solution that achieves glossy surfaces, diffuse reflection, specular reflection, ambient occlusion, indirect shadows, soft shadows, emissive materials and 2-bounce GI.

uzh-rpg Learning High-Speed Flight in the Wild This repo contains the code associated with the paper Learning Agile Flight in the Wild. For more information,

Andrew-Helmer C++ implementation of "Stochastic Generation of (t,s) Sample Sequences", by Helmer, Christensen, and Kensler (2021)

RUB-SysSec USENIX 2021 - Nyx: Greybox Hypervisor Fuzzing using Fast Snapshots and Affine Types

Kevincoooool This is a comprehensive project that combines the powerful computing capabilities of ESP32, with functions such as speech recognition, image recognition, GUI learning, and FFT music spectrum. It is suitable for learning image recognition algorithms and making LVGL-based UI interfaces.

Livox-SDK Livox-Free-Space is a fast and effective free-space detection package using Livox LiDAR data. It based on traditional algorithm to segment 3D LiDAR data and generate free-space.

shouxieai C++ library based on tensorrt integration

Livox-SDK This respository implements a robust LiDAR-inertial odometry system for Livox LiDAR. The system uses only a single Livox LiDAR with a built-in IMU. It has a robust initialization module, which is independent to the sensor motion

FeiGeChuanShu Real time yolox Android demo by ncnn

eanswer This repository contains the implementation for the paper An End-to-End Differentiable Framework for Contact-Aware Robot Design (RSS 2021).

Fraunhofer-IMS AIfES (Artificial Intelligence for Embedded Systems) is a platform-independent and standalone AI software framework optimized for embedded systems. The Feedforward Neural Networks (FNN) implemented in AIfES can be freely parameterized, trained, modified or reloaded at runtime.

openppl-public PPLNN, which is short for "PPLNN is a Primitive Library for Neural Network", is a high-performance deep-learning inference engine for efficient AI inferencing.