Features and Functionalities for AI Tools

The Intel AI Tools give data scientists, AI developers, and researchers familiar Python* tools and frameworks to accelerate end-to-end data science and analytics pipelines on Intel® architectures. The components are built using oneAPI libraries for low-level compute optimizations. This toolkit maximizes performance from preprocessing through machine learning, and provides interoperability for efficient model development.

You can find more information at AI Tools.

Users can explore the extensive features of Intel AI Tools through provided feature and functionality samples, offering a deeper understanding of their capabilities.

License

Code samples are licensed under the MIT license. See License.txt for details.

Third party program Licenses can be found here: third-party-programs.txt

Features and Functionalities Samples

AI Tools preset bundle	Component	Folder	Description
Deep Learning	Intel® Neural Compressor (INC)	Intel® Neural Compressor (INC) Quantization Aware Training	Fine-tune a BERT tiny model for emotion classification task using Quantization Aware Training and Inference from Intel® Neural Compressor (INC).
Deep Learning	Intel® Extension for PyTorch (IPEX)	Optimize PyTorch Models using Intel® Extension for PyTorch* (IPEX)	Apply Intel® Extension for PyTorch (IPEX) to a PyTorch workload to gain performance boost.
Deep Learning	Intel® Extension for PyTorch (IPEX)	IntelPyTorch Extensions GPU Inference Optimization with AMP	Use the PyTorch ResNet50 model transfer learning and inference using the CIFAR10 dataset on Intel discrete GPU with Intel® Extension for PyTorch (IPEX).
Deep Learning	Intel® Extension for PyTorch (IPEX)	PyTorch Inference Optimizations with Intel® Advanced Matrix Extensions (Intel® AMX) Bfloat16 Integer8	Analyze inference performance improvements using Intel® Extension for PyTorch (IPEX) with Advanced Matrix Extensions (Intel® AMX) Bfloat16 and Integer8.
Deep Learning	PyTorch	IntelPyTorch TrainingOptimizations Intel® AMX BF16	Analyze training performance improvements using Intel® Extension for PyTorch (IPEX) with Intel® AMX Bfloat16.
Deep Learning	PyTorch	Interactive Chat Based on DialoGPT Model Using Intel® Extension for PyTorch* Quantization	Create interactive chat based on pre-trained DialoGPT model and add the Intel® Extension for PyTorch (IPEX) quantization to it.
Deep Learning	PyTorch	Optimize PyTorch Models using Intel® Extension for PyTorch* (IPEX) Quantization	Inference performance improvements using Intel® Extension for PyTorch (IPEX) with feature quantization.
Deep Learning	TensorFlow	IntelTensorFlow Intel® AMX BF16 Training	Enabling auto-mixed precision to use low-precision datatypes, like bfloat16, for model inference with TensorFlow* .
Deep Learning	TensorFlow	IntelTensorFlow Intel® AMX BF16 Training	Training performance improvements with Intel® AMX BF16.
Deep Learning	TensorFlow	IntelTensorFlow Enabling Auto Mixed Precision for TransferLearning	Enabling auto-mixed precision to use low-precision datatypes, like bfloat16, for transfer learning with TensorFlow*.
Deep Learning	Horovod	IntelTensorFlow Horovod Distributed Deep Learning	Run inference & training workloads across multi-cards using Intel Optimization for Horovod and TensorFlow* on Intel® dGPU's.
Deep Learning	TensorFlow	IntelTensorFlow InferenceOptimization	Optimize a pre-trained model for a better inference performance.
Deep Learning	TensorFlow & Intel® AI Reference Models	IntelTensorFlow Reference Models Inference with FP32 Int8	Run ResNet50 inference on Intel's pretrained FP32 and NT8 model.
Deep Learning	TensorFlow	IntelTensorFlow PerformanceAnalysis	Analyze the performance difference between Stock Tensorflow and Intel Tensorflow.
Deep Learning	TensorFlow	IntelTensorFlow Transformer Intel® AMX bfloat16 MixedPrecisiong	Run a transformer classification model with bfloat16 mixed precision.
Deep Learning	TensorFlow	IntelTensorFlow for LLMs	Finetune a GPT-J (LLM) model using the GLUE cola dataset with the Intel® Optimization for TensorFlow*.

*Other names and brands may be claimed as the property of others. Trademarks