Optimizing memory usage in large language models fine-tuning with KAITO: Best practices from Phi-3
The Cloud Native team at Azure is working to make AI on Kubernetes more cost-effective and approachable for…
Programming language: PyTorch
On-Device Training: Training a model in browser
Continuing the ONNXRuntime On-Device Training blog series, we are introducing ONNX Runtime Training for Web.
Introducing ONNX Script: Authoring ONNX with the ease of Python
ONNX Script is a new open-source library for directly authoring ONNX models in Python.
Olive: A user-friendly toolchain for hardware-aware model optimization
Introducing Olive, an easy-to-use toolchain for optimizing models with hardware awareness. With Olive, you don't need to be…
Optimizing and deploying transformer INT8 inference with ONNX Runtime-TensorRT on NVIDIA GPUs
Mohit Ayani, Solutions Architect, NVIDIA Shang Zhang, Senior AI Developer Technology Engineer, NVIDIA Jay Rodge, Product Marketing Manager-AI,…
Scaling-up PyTorch inference: Serving billions of daily NLP inferences with ONNX Runtime
Scale, performance, and efficient deployment of state-of-the-art Deep Learning models are ubiquitous challenges as applied machine learning grows…
Supporting efficient large model training on AMD Instinct™ GPUs with DeepSpeed
This post was co-authored by Jithun Nair and Aswin Mathews, members of technical staff at AMD. In recent…
Introducing Distributed Data Parallel support on PyTorch Windows
Model training has been and will be in the foreseeable future one of the most frustrating things machine…
Accelerate PyTorch training with torch-ort
With a simple change to your PyTorch training script, you can now speed up training large language models…
ONNX Runtime release 1.8.1 previews support for accelerated training on AMD GPUs with the AMD ROCm™ Open Software Platform
This post was co-authored by Jeff Daily, a Principal Member of Technical Staff, Deep Learning Software for AMD.…
Journey to optimize large scale transformer model inference with ONNX Runtime
With its resource-efficient and high-performance nature, ONNX Runtime helped us meet the need of deploying a large-scale multi-layer…
Delivering reliable production experiences with PyTorch Enterprise on Microsoft Azure
At Microsoft, we use PyTorch to power products such as Bing and Azure Cognitive Services and we actively…