Code Together

Hugging Face and Intel – Driving Towards Practical, Faster, Democratized and Ethical AI solutions.

Transformer models are the powerful neural networks that have become the standard for delivering advanced performance behind these innovations. But there is a challenge: Training these deep learning models at scale and doing inference on them requires a large amount of computing power. This can make the process time-consuming, complex, and costly.

Today we will talk about all kinds of issues around accessible, production level AI solutions. We also talk about ethical questions around AI usage and why open, democratized AI solutions are important.

Learn more:
Hugging Face
https://huggingface.co

Hugging Face Hub
https://huggingface.co/models

Fast Inference on Large Language Models: BLOOMZ on Habana Gaudi2 Accelerator
https://huggingface.co/blog/habana-gaudi-2-bloom

Accelerating Stable Diffusion Inference on Intel CPUs
https://huggingface.co/blog/stable-diffusion-inference-intel

Transformer Performance with Intel & Hugging Face Webinar
https://www.intel.com/content/www/us/en/developer/videos/optimize-end-to-end-transformer-model-performance.html#gs.pomt5k

Intel Explainable AI Tools
https://github.com/IntelAI/intel-xai-tools

Intel Distribution of OpenVINO Toolkit
https://www.intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html

Intel AI Analytics Toolkit (AI Kit)
https://www.intel.com/content/www/us/en/developer/tools/oneapi/ai-analytics-toolkit.html

Guests:
Julien Simon – Chief Evangelist @ Hugging Face
Ke Ding – Principal Engineer @ Intel

oneAPI in Practice – How Digital Cortex is leveraging oneAPI to provide scalable, on-demand access to xPU processors

As the world moves towards more specialized hardware like GPUs, Google TPUs, Habana Gaudi (HPU), FPGAs, etc, enabling developers to run their code on the most efficient hardware can be challenging. Intel oneAPI and xPUs are at the vanguard of this shift and Digital Cortex is leading the way forward with its comprehensive set of products built on these emerging technologies. By providing unprecedented access to compute across varying architectures and platforms, Digital Cortex is helping developers unlock new levels of performance while simplifying development processes.

We talk to Digital Cortex CEO Charlie Wardell to learn how Digital Cortex is building on top of the oneAPI vision to bring a marketplace of compute kernels to their platform that can run anywhere. Charlie also shares his thoughts on entrepreneurship and what made him make the leap from working in a company to founding a company.

Learn more:
Digital Cortex
digital-cortex.io

oneAPI
oneapi.io

Intel oneAPI toolkits
intel.com/content/www/us/en/developer/tools/oneapi/overview.html#gs.rahkwl

Guest:
Charlie Wardell – CEO of Digital Cortex

Ray Tracing, Path Tracing & Path Guiding – Finding the Light (efficiently) with Chaos and OpenPGL

Over the last couple of decades, the world of computer graphics has been growing at an amazing rate.  From animated movies to video games, consumers have reaped the benefits of these technological advances.  One of the latest algorithmic advances in rendering is path guiding.  Learn about path guiding and how you can take advantage of this cool technology using Chaos V-Ray and the Intel Path Guiding Library (OpenPGL)

Learn more:
Chaos V-Ray:
chaos.com

Intel Open Path Guiding Library (OpenPGL) Github
github.com/OpenPathGuidingLibrary/openpgl
Paper: A 5D Tree to Reduce the Variance of Monte Carlo Ray Tracing
Author: Eric Lafortune
researchgate.net/publication/2574746_A_5D_Tree_to_Reduce_the_Variance_of_Monte_Carlo_Ray_Tracing

Paper: Importance driven path tracing using the photon map.
Author: Henrik Jensen
graphics.stanford.edu/~henrik/papers/ewr6.html
 
Paper: Robust Fitting of Parallax-Aware Mixtures for Path Guiding
Author: Lukas Ruppert
dl.acm.org/doi/10.1145/3386569.3392421

Paper: Practical Path Guiding for Efficient Light-Transport Simulation (a.k.a. Practical Path Guiding)
Author: Thomas Müller
dl.acm.org/doi/10.1111/cgf.13227

Paper: Path Guiding in Production
Author: Jikra Vorba
cgg.mff.cuni.cz/~jirka/path-guiding-in-production/2019/index.htm

See also:
oneapi.com

Guests:
Dian Nikolov – Software Engineer @ Chaos
Sebastian Herholz – Software Engineer @ Intel

Quantum Computing, How Intel is Driving Towards a Probabilistic Future

Quantum computing technology is becoming more viable, which means programming models are going to have to be created to harness this potentially world changing technology. To many developers, understanding the possibilities of quantum computing and moving from a binary world to a world of quantum states is challenging.

Tony talks to Anne Matsuura, a physicist and Director of Quantum Applications and Architecture in Intel Labs about what quantum computing can do for society and how Intel is working on building hardware and software solutions to make that future a reality.

We also talk about what a quantum computer actually looks like today (hint: it’s not a tiny flat chip).

Learn more:
Intel Quantum Computing Homepage
intel.com/content/www/us/en/research/quantum-computing.html

oneAPI
oneapi.io
intel.com/content/www/us/en/developer/tools/oneapi/overview.html

Guests:
Anne Matsuura – Director of Quantum Applications and Architecture in Intel Labs

Impact from AI in 5 days – How High Schoolers Beat Professional Data Scientists

AI is the new hot thing in business. Everyone wants to talk about how they are harnessing AI to make their business better. However this is not a trivial process, and maybe companies are left wondering what went wrong. Aible is a company devoted to providing business impact in less than 30 days.

We talk to Arijit Sengupta, the CEO of Aible, about how Aible is able to make an impact quickly. He talks about how Aible can transform an AI solution into a business solution, using high schoolers and Aible versus data scientists to prove the point. We also discuss bias in AI, the future of AI, and how AI has the power to transform how we work and live.

Learn more:
Aible
aible.com

Aible/Intel blog
intel.com/content/www/us/en/developer/articles/technical/30-days-to-ai-value-intel-aible-solution.html#gs.krmfw7

Intel/Aible Performance Benchmark and Case Studies Report
enaible.aible.com/hubfs/Intel_Aible_Benchmark.pdf

Case Study Videos: How to guarantee impact from AI in 30 days
aible.wistia.com/medias/2dddd6pr8i

AI is a Waste of Money
aible.com/ai-book

Intel AI Analytics Toolkit
intel.com/content/www/us/en/developer/tools/oneapi/ai-analytics-toolkit.html

Intel Distribution of OpenVINO™ Toolkit
intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html

oneAPI
oneapi.io
intel.com/content/www/us/en/developer/tools/oneapi/overview.html

Guests:
Arijit Sengupta – Aible CEO

Chest-rAi, Enabling Better Patient Experiences through AI and Intel Acceleration

As AI becomes more prevelent in society, one of the biggest questions is how can we take AI and harness it for good? One area that is extremely active is healthcare. AI is being explored across a variety of disciplines in the medical field.

One way to use AI in healthcare is to make doctors more efficient, and that is precisely what Chest-rAi aims to do. Learn a little bit about how AI can be harnessed to make it easier for doctors to be more efficient and help more patients through use of Chest-rAi.

Learn more:
LTTS Chest-rAi and Intel AI Analytics and OpenVINO Toolkits blog
intel.com/content/www/us/en/developer/articles/technical/ltts-chest-rai-and-intel-tools-redefine-radiology.html

Chest-rAi
ltts.com/solutions/healthcare/AI-radiography/chest-rAi

Intel AI Analytics Toolkit
intel.com/content/www/us/en/developer/tools/oneapi/ai-analytics-toolkit.html

Intel Distribution of OpenVINO™ Toolkit
intel.com/content/www/us/en/developer/tools/openvino-toolkit/overview.html

oneAPI
oneapi.io
intel.com/content/www/us/en/developer/tools/oneapi/overview.html

C++, SYCL, Kokkos – How C++ and Collaborative, Accelerator Programming Models Enable the Aurora Supercomputer

The accelerator landscape has been rapidly changing over the past decade, and as super computers come online, they face the challenge of supporting the latest and greatest accelerators. Through use of C++. Kokkos and SYCL, the engineers working on the Aurora project at Argonne National Laboratory are demonstrating how to enable workloads that are performant now, while continuing to keep an eye on the future.

Guests:
Nevin Liber – Computer Scientist @ Argonne Leadership Computing Facility
alcf.anl.gov/about/people/nevin-liber

James Reinders – Technical Evangelist @ Intel
linkedin.com/in/jamesreinders

Learn more:
See what next-generation scientific problems are being slated to run on Aurora
intel.com/content/www/us/en/customer-spotlight/stories/argonne-aurora-customer-story.html

Argonne Leadership Computing Facility and Aurora
alcf.anl.gov
alcf.anl.gov/aurora

SYCL Tech
sycl.tech

oneAPI
oneapi.io
intel.com/content/www/us/en/developer/tools/oneapi/overview.html

Kokkos
github.com/kokkos/kokkos

Intel oneAPI 2023 Toolkits and Codeplay Software – New Plug-In Support for NVIDIA and AMD GPUs

Today, Codeplay Software announces expanding oneAPI for Nvidia and AMD GPUs, making multiarchitecture, multivendor programming much easier. This includes new plugins: oneAPI for Nvidia GPUs and oneAPI for AMD GPUs (beta).

Software developers are increasingly looking to move away from proprietary interfaces and use open standards that are defined by the industry. This can allow them to target a broad set of platforms and architectures. oneAPI aims to bring this to reality by supporting the widest set of processors and accelerators. As a cross-industry initiative, oneAPI offers an open, standards-based, multiarchitecture programming model and specification.

Having official plugins for Nvidia and AMD platforms is a major milestone for the oneAPI open community. The oneAPI Nvidia and AMD GPU plugins seamlessly work with the Intel oneAPI DPC++/C++ Compiler 2023 and many popular libraries, bringing open, standards-based programming to a range of processors from multiple hardware vendors. The oneAPI for Nvidia GPUs and oneAPI for AMD GPUs packages are available to download for free on the Codeplay website.

Learn more:
Intel oneAPI toolkits
intel.com/content/www/us/en/developer/tools/oneapi/toolkits.html

Codeplay
developer.codeplay.com/home/

oneAPI for NVIDIA GPUs
developer.codeplay.com/products/oneapi/nvidia/home/

oneAPI for AMD GPUs (beta)
developer.codeplay.com/products/oneapi/amd/home/

James’ blog on the Intel oneAPI 2023 Toolkit release
intel.com/content/www/us/en/developer/articles/news/oneapi-2023.html

Codeplay blog on the oneAPI for NVIDIA and AMD plugins
codeplay.com/portal/blogs/2022/12/16/bringing-nvidia-and-amd-support-to-oneapi.html
  
Guests:
Gordon Brown – Codeplay oneAPI Product Manager
James Reinders – Intel Evangelist