Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Microsoft

Run high-performance computing (HPC) applications on Azure

Microsoft via Microsoft Learn

Overview

Prepare for a new career with $100 off Coursera Plus
Gear up for jobs in high-demand fields: data analytics, digital marketing, and more.
  • Module 1: Discover the services available on Azure for your high-performance computing workloads.
  • In this module, you will:

    • Identify the HPC and batch solutions available on Azure
    • Identify the scenarios where HPC and batch technologies are a fit
  • Module 2: Azure Batch is a service that enables you to run large-scale parallel and high-performance computing (HPC) applications efficiently in the cloud. There's no need to manage or configure infrastructure. Just schedule the job, allocate the resources you need, and let Batch take care of the rest.
  • After you complete this module, you'll be able to:

    • Create an Azure Batch job by using the Azure portal
    • Run an Azure Batch job by using the Azure portal
  • Module 3: Find out about the Azure Batch capabilities designed to help you efficiently run large-scale parallel and high-performance computing applications in the cloud.
  • In this module, you will:

    • Create an Azure Batch job in the Azure CLI
    • Run an Azure Batch job in the Azure CLI
    • Check status and results of Batch job in Azure CLI
    • Monitor a Batch job with Batch Explorer
  • Module 4: Learn to use the Azure Batch platform to write a .NET Core console app that performs parallel, large-scale, high-performance video transcoding.
  • In this module, you will:

    • Build and run an Azure Batch job from a .NET app
    • Add an application package to a Batch account
    • Interact programmatically with Batch and Storage resources
    • Manage a Batch programmatically
  • Module 5: This module explains how to use Azure CycleCloud for high-performance computing. It explains how to install and configure Azure CycleCloud to work with your Azure subscription as well as how to integrate a third-party scheduler. Finally, it covers how to create and deploy a basic HPC cluster on Azure.
  • By the end of this module, you'll be able to:

    • Install and configure Azure CycleCloud to work with your Azure subscription.
    • Integrate a third-party scheduler.
    • Create and deploy a basic HPC cluster on Azure.
  • Module 6: Azure CycleCloud templates offer a declarative provisioning model that helps you minimize administrative overhead associated with deploying and maintaining custom HPC environments in Azure.
  • By the end of this module, you'll know more about how to:

    • Customize HPC cluster architecture.
    • Customize software and applications that you use with Azure CycleCloud clusters.
  • Module 7: We'll discuss various factors that influence high-performance computing (HPC) storage selection in Azure. We'll review NFS, file access, directory services, parallel file systems, and hybrid file-access considerations.
  • In this module, you will:

    • Document the file-access architecture for your HPC use case
    • Consider the implications of your architecture requirements
    • Compare several file-access architectures
  • Module 8: Choose the best service level of Azure NetApp Files based on your throughput requirements and including cost considerations.
  • By the end of this module, you'll be able to:

    • Describe the factors that determine throughput limits of Azure NetApp Files volume.
    • Choose the best service level of Azure NetApp Files for HPC applications.
  • Module 9: Learn how to improve Azure NetApp Files performance for your EDA and HPC applications by using best practices.
  • By the end of this module, you'll be able to:

    • List the best practices that improve Azure NetApp Files performance.
    • Describe the performance impact of the best practices on FIO and EDA benchmark suites.
  • Module 10: Evaluate whether Azure HPC Cache is appropriate for improving the productivity of your high-performance computing applications.
  • By the end of this module, you'll be able to:

    • Evaluate whether HPC Cache is appropriate for improving the productivity of your high-performance computing applications.
    • Describe how HPC Cache enables you to accelerate, scale, and manage your file-based high performance computing workloads in Azure.
  • Module 11: Accelerate NFS storage for HPC workloads by using Azure HPC Cache.
  • By the end of this module, you'll be able to:

    • Understand what Azure HPC Cache is.
    • List the pre-requisites for Azure HPC Cache.
    • Create an Azure HPC Cache instance.
    • Configure Azure HPC Cache to accelerate a Linux-based file system.
    • Attach virtual client machines to read from the cache.
  • Module 12: Learn how to build, run, and tune tightly coupled HPC applications in Azure.
  • In this module, you will:

    • Choose the best and most cost-efficient HPC SKU for each type of tightly coupled HPC application.
    • Optimally build and run each type of tightly coupled HPC application on Azure HPC SKUs.
  • Module 13: Troubleshoot tightly coupled HPC applications that are having runtime failures or are underperforming.
  • In this module, you'll learn how to:

    • Troubleshoot runtime failures for tightly coupled HPC applications.
    • Troubleshoot tightly coupled HPC applications that are underperforming.

Syllabus

  • Module 1: Introduction to high-performance computing (HPC) on Azure
    • Introduction
    • Azure Batch
    • Azure VM HPC instances
    • Microsoft HPC Pack
    • Scenarios for HPC and Batch technologies
    • Summary
  • Module 2: Create an Azure Batch account by using the Azure portal
    • Introduction
    • Create a Batch job by using the Azure portal
    • Exercise - Create an Azure Batch job and virtual network
    • Run tasks and add application packages
    • Exercise - Add a new application package to a Batch account in the Azure portal
    • Consider features for Azure Batch security
    • Knowledge check
    • Summary
  • Module 3: Run parallel tasks in Azure Batch with the Azure CLI
    • Introduction
    • What is Azure Batch?
    • Design an Azure Batch job to run your parallel task
    • Exercise - Create an Azure Batch job in the CLI to run your parallel task
    • Exercise - Monitor your Azure Batch job in the CLI
    • Visualize batch jobs with the Batch Explorer
    • Exercise - Monitor and visualize your batch job in Batch Explorer
    • Knowledge check
    • Summary
  • Module 4: Create an app to run parallel compute jobs in Azure Batch
    • Introduction
    • Manage Azure Batch workloads from a .NET app
    • Exercise - Setup Batch and Storage accounts in the Azure portal
    • Access your Batch account using the .NET client library
    • Exercise - Access your Batch account using the .NET client library
    • Exercise - Create a pool of compute nodes to run our jobs
    • Create and run a Batch job using the .NET client library
    • Exercise - Upload resources to be used by a Batch with the .NET storage library
    • Exercise - Manage and deploy applications on compute nodes
    • Exercise - Add code to monitor and log Azure Batch job progress in your app
    • Summary
  • Module 5: Create, customize and manage an HPC cluster in Azure with Azure CycleCloud
    • Introduction
    • Describe the basics of Azure CycleCloud
    • Describe Azure CycleCloud scheduler integration and autoscaling
    • Exercise - Install and configure Azure CycleCloud
    • Exercise - Create an HPC cluster from built-in templates
    • Knowledge check
    • Summary
  • Module 6: Customize high-performance computing clusters deployed with Azure CycleCloud
    • Introduction
    • Describe Azure CycleCloud cluster templates
    • Exercise - Add a disk to an HPC cluster's scheduler node
    • Exercise - Add a custom node array to an HPC cluster
    • Customize software installations
    • Exercise - Create a cloud-init script for use with Azure CycleCloud
    • Knowledge check
    • Summary
  • Module 7: Understand factors that influence HPC storage selection in Azure
    • Introduction
    • File access for HPC jobs
    • File-system performance considerations
    • File-system traffic considerations
    • File-system authentication and authorization
    • NFS overview
    • Parallel file systems
    • Hybrid file access requirements
    • Summary
  • Module 8: Choose the best service level of Azure NetApp Files for your HPC applications
    • Introduction
    • Identify the decision criteria
    • Choose your service level
    • Knowledge check
    • Summary
  • Module 9: Improve Azure NetApp Files performance for your EDA and HPC applications by using best practices
    • Introduction
    • Overall performance suggestions
    • Mount options and client VM configurations
    • Benchmark results
    • Knowledge check
    • Summary
  • Module 10: Introduction to Azure HPC Cache
    • Introduction
    • What is Azure HPC Cache?
    • How Azure HPC Cache works
    • When to use Azure HPC Cache
    • Knowledge check
    • Summary
  • Module 11: Accelerate high-performance computing storage by using Azure HPC Cache
    • Introduction
    • Identify the requirements for HPC Cache
    • Create an HPC Cache instance
    • Connect local storage to HPC Cache
    • Connect HPC clients to HPC Cache
    • Knowledge check
    • Summary
  • Module 12: Optimizing tightly coupled HPC applications on HBv2, HC, and HB series virtual machines
    • Introduction
    • Select the appropriate HPC SKU
    • Knowledge check - Select the appropriate HPC SKU
    • Process pinning considerations
    • Exercise - Find the correct NUMA mapping for an HPC SKU
    • Compilers and numerical libraries
    • Knowledge check - Select the right compiler and numerical libraries
    • Select the right MPI library
    • Knowledge check - Select the right MPI library
    • Summary
  • Module 13: Troubleshoot tightly coupled HPC applications on HBv2, HC, and HB series virtual machines
    • Introduction
    • Health checks for HPC virtual machines
    • Knowledge check
    • Debug performance bottlenecks
    • Knowledge check
    • Summary

Reviews

Start your review of Run high-performance computing (HPC) applications on Azure

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.