Using automation analytics
Evaluate the cost savings associated with automated processes
Abstract
Preface
This guide shows how to use the features of automation analytics to evaluate how automation is deployed across your environments and the savings associated with it.
Providing feedback on Red Hat documentation
If you have a suggestion to improve this documentation, or find an error, you can contact technical support at https://access.redhat.com to open a request.
Chapter 1. About Automation Calculator
The automation calculator provides graphs, metrics and calculations that help you determine the total savings on your investment in automated processes.
1.1. Automation savings overview
Automation savings is produced by an analysis of the time and cost of performing a task manually, such as deploying a server, compared to the time and cost associated with automating the same task. Automation savings calculations extend across all organizations, clusters, hosts, and templates in an environment. Include your own estimated costs to produce a more accurate calculation.
The initial total savings is based on default values for each variable.
1.2. Variables used in automation cost calculation
The following variables are used in evaluating costs:
- Manual cost of automation: the approximate cost for a mid-level resource to perform a task or series of tasks.
- Cost of automation: the costs associated with automating tasks as job templates.
- Automation time: the time required to run a job template.
- Number of hosts: the number of hosts in inventory the template runs on.
1.3. Automation savings formulas
Automation savings is calculated by using the following formulas:
- Manual cost per template = (time for a manual run on one host * (sum of all hosts across job runs)) * cost per hour.
- Automation cost per template = cost of automation per hour * sum of total elapsed hours for a template.
- Savings = sum of (manual cost - automation costs) across all templates.
1.4. Calculating your automation savings
The Automation Calculator produces its default total savings figure based on estimates for each variable.
You can tune this calculation by providing more specific organizational cost information and adjusting the time values for each of the top templates.
Automation savings calculations are not saved in Automation Analytics.
To calculate your automation savings:
Under Calculate your automation enter cost information for:
- Manual process cost
- Automated process cost
Under Top templates:
- Adjust time values for top templates to provide time to manually perform each task that the template automates.
Total savings updates based on the information you enter in each field.
1.5. Top templates
Top templates lists the 25 most frequently run templates across all hosts in your environment.
Templates are listed in descending order starting with the highest run count. You can enter the time it takes to perform tasks manually that are automated by templates in the field adjacent to the run totals to produce a more accurate total savings. The default value is set to 60 minutes.
1.5.1. Curating top templates
You can use the toggle switch for each template to show or hide it in the bar graph to compare performance and savings based on specific templates.
- Click the toggle switch for each template to display or hide it.
The bar graph on the Automation Calculator will update to display those top templates selected and Total savings will calculate based on those templates.
1.5.2. Viewing template details
View detailed information for each template in Top templates to learn more about the template’s context in the calculation of automation savings. For definitions of the data points, see Top template details and metrics.
Procedure
Click the Info icon for a job template to view template details.
Top template information includes the following:
- Total elapsed sum - Total run time of the template.
- Success elapsed sum - Total run time for successful template runs.
- Failed elapsed sum - Total run time for failed template runs.
- Automation percentage - The template accounts for this percentage of automation in your organization.
- Associated organizations - The template runs against these organizations.
- Associated clusters - Automation controller clusters the template runs on.
1.5.3. Top template details and metrics
The following table provides definitions for the data points associated with each template listed in the Top templates view of the Automation Calculator. This information is used to calculate automation savings.
Table 1.1. Top Template Metrics
| Metric | Description |
|---|---|
| Total elapsed sum | Total run time across all runs of the template. |
| Success elapsed sum | Total run time specifically for successful template runs. |
| Failed elapsed sum | Total run time specifically for failed template runs. |
| Automation percentage | The percentage of total organizational automation that this specific template accounts for. |
| Associated organizations | The organizations that this template runs against. |
| Associated clusters | The automation controller clusters that the template runs on. |
Chapter 2. About the automation savings planner
An automation savings plan gives you the ability to plan, track, and analyze the potential efficiency and cost savings of your automation initiatives. Use automation analytics to create an automation savings plan by defining a list of tasks needed to complete an automation job.
You can then link your automation savings plans to an Ansible job template to accurately measure the time and cost savings upon completion of an automation job.
To create an automation savings plan, you can use the automation savings planner to prioritize the various automation jobs throughout your organization and understand the potential time and cost savings for your automation initiatives.
2.1. Creating a new automation savings plan
Create an automation savings plan by defining the tasks needed to complete an automation job by using the automation savings planner.
Procedure
- From the navigation panel, select → .
- Click .
Provide some information about your automation job:
- Enter descriptive information, such as a name, description, and type of automation.
- Enter technical information, such as the number of hosts, the duration to manually complete this job, and how often you complete this job.
- Click .
In the tasks section, list the tasks needed to complete this plan:
- Enter each task in the field, then click .
- Rearrange tasks by dragging the item up/down the tasks list.
- Click .
Select a template to link to this plan, then click .
NoteThe task list is for your planning purposes only, and does not currently factor into your automation savings calculation.
Your new savings plan is now created and displayed on the automation savings planner list view.
2.2. Edit an existing savings plan
Edit any information about an existing savings plan by clicking on it from the savings planner list view.
Procedure
- From the navigation panel, select → .
- On the automation savings plan, click Click the icon ⋮, then click .
- Make any changes to the automation plan, then click .
2.3. Link a savings plan to a job template
You can associate a job template to a savings plan to allow automation analytics to provide a more accurate time and cost savings estimate for completing this savings plan.
Procedure
- From the navigation panel, select → .
- Click the icon ⋮ and select Link Template.
- Click .
2.4. Review savings calculations for your automation plans
The automation savings planner offers a calculation of how much time and money you can save by automating a job. Automation analytics takes data from the plan details and the associated job template to provide you with an accurate projection of your cost savings when you complete this savings plan.
To do so, navigate to your savings planner page, click the name of an existing plan, then navigate to the Statistics tab.
The statistics chart displays a projection of your monetary and time savings based on the information you provided when creating a savings plan. Primarily, the statistics chart subtracts the automated cost from the manual cost of executing the plan to provide the total resources saved upon automation. The chart then displays this data by year to show you the cumulative benefits for automating the plan over time.
Click between Money and Time to view the different types of savings for automating the plan.
2.5. Filter and sort plans on the list view page
Find specific types of automation savings plans by filtering or sorting your savings planner list view.
Procedure
- From the navigation panel, select → .
- To filter your saving plans based on type, or sort your savings plans by a certain order, select a filter option on the horizontal toolbar.
Chapter 3. Viewing your reports on Red Hat Ansible Automation Platform
The reports feature on the Red Hat Ansible Automation Platform provides users with a visual overview of their automation efforts across different teams by using Ansible.
Each report helps users to monitor the status of their automation environment, be it the frequency of playbook runs or the status of hosts affected by various job templates.
For example, you can use your reports to:
- View the number of hosts affected by a job template
- View the number changes made to hosts by a job template
- View the frequency of a job template run, and the rate of job templates that succeed or fail to run
3.1. Reviewing your reports
To view reports about your Ansible automation environment, proceed with the following steps:
Procedure
- Log in to This content is not included.console.redhat.com and navigate to the Ansible Automation Platform.
- Click on the side navigation panel.
Select a report from the results to view it.
Each report presents data to monitor your automation environment. Use the filter toolbar on each report to adjust your graph view.
NoteNew reports are regularly added to the system. If you have ideas for new reports that would be helpful for your team, contact your account representative or log a feature enhancement for automation analytics.
Chapter 4. About the Job Explorer
The Job Explorer provides a detailed view of jobs run on automation controller clusters across your organizations. You can access the Job Explorer by selecting → from the navigation panel or using the drill-down view available across each of the application’s charts.
Using the Job Explorer you can:
- Filter the types of jobs running in a cluster or organization;
- Directly link out to templates on automation controller for further assessment;
- Identify and review job failures;
- View more details for top templates running on a cluster;
- Filter out nested workflows and jobs.
You can review the features and details of the Job Explorer in the following sections.
4.1. Creating a filtered and sorted view of jobs
You can view a list of jobs, filtered by attributes you choose, using the Job Explorer.
Filter options include:
- Status
- Job
- Cluster
- Organization
- Inventory
- Template
You can sort results by any of the parameters from each column by using the directional arrows.
Procedure
- From the navigation panel, select → .
- In the filter toolbar, select Job from the Filter by list.
- In that same toolbar, select a time range. Job Explorer will now display jobs within that time range.
To further refine results, return to the filter toolbar and select a different attribute to filter results by, including job status, cluster, or organization.
The Job Explorer view updates and presents a list of jobs based on the attributes you selected.
4.2. Viewing more information about an individual job
You can view additional information about each individual job.
Procedure
- Navigate to the job Id/Name column.
- Click the arrow icon.
4.3. Reviewing job details on automation controller
You review job details on automation controller.
Procedure
Click the job in the Id/Name column to view the job itself on the automation controller job details page.
For more information on job settings for automation controller, see Jobs in automation controller in the Using automation execution.
4.4. Drilling down into cluster data
You can drill down into cluster data to review more detailed information about successful or failed jobs.
The detailed view, presented on the Job Explorer page, provides information on the cluster, organization, template, and job type. Filters you select on the Clusters view carry over to the Job Explorer page.
Details on those job templates will appear in the Job Explorer view, modified by any filters you select in the Clusters view.
For example, you can drill down to review details for failed jobs in a cluster.
4.4.1. Example: Reviewing failed jobs
You can view detailed information about failed jobs across your organization by drilling down on a graph in the Clusters view and using the Job Explorer to refine results. Clicking a segment on the graph opens that information in the Job Explorer, preserving filters applied in the Clusters view.
Procedure
- From the navigation panel, select → .
- Use the filter lists in the toolbar to apply filters for clusters and time range of your choosing.
Click a segment on the graph.
You are redirected to the Job Explorer view, which displays a list of jobs corresponding to that day on the graph.
To refine the list to show only failed jobs:
- Select Status from the Filter by list.
Select the Failed filter.
The Job Explorer view updates to show only failed jobs run within the selected time range.
Next steps
- Add additional context to the view by applying more filters and selecting attributes to sort results.
- Review more information for failed jobs on the automation controller job details page.
4.5. Viewing top templates job details for a specific cluster
You can view job instances for top templates in a cluster to learn more about individual job runs associated with that template or to apply filters to further drill down into the data.
Procedure
- From the navigation panel, select → .
- Click a template name in Top Templates.
Click in the modal that is displayed.
The Job Explorer page displays all jobs on the chosen cluster associated with that template.
The view presented will preserve the contextual information of the template based on the parameters selected in the Clusters view.
4.6. Ignoring nested workflows and jobs
Ignoring nested workflows and jobs filters out duplicate workflow and job template entries and excludes those items from overall totals.
Procedure
- Select the settings icon on the Job Explorer view.
Use the toggle switch to Ignore nested workflows and jobs.
NoteAbout nested workflows Nested workflows enable you to create workflow job templates that call other workflow job templates. Nested workflows promotes reuse, as modular components, of workflows that include existing business logic and organizational requirements in automating complex processes and operations. To learn more about nested workflows, see Workflows in automation controller in the Using automation execution.
Chapter 5. Automation Analytics Data Dictionary
Automation Analytics Data is sent to the Red Hat Hybrid Cloud Console (HCC) to provide detailed analytics on your automation.
The Ansible Automation Platform - Data Dictionary KIE base article outlines the data dictionary for the information collected by Automation Analytics from the Red Hat Ansible Automation Platform automation controller, also known as Automation Execution.