Integrated Digital Engineering on AWS
  • 🚀First Time Users
    • What is IDEA?
    • Install IDEA
      • Pre-Requisites
      • Standard Installation
    • Access your IDEA cluster
      • Web Interface
      • Virtual Desktops (Linux/Windows)
      • SSH
      • APIs
    • File Browser
    • Let's get started
    • Cluster operations
      • Update IDEA cluster
        • Patch IDEA module (idea-admin.sh patch)
        • Update IDEA configuration (idea-admin.sh config)
        • Update IDEA backend resource (idea-admin.sh deploy)
      • Uninstall IDEA
  • 🤖Modules
    • What is a module?
    • Virtual Desktop Interfaces
      • User Documentation
        • Create a virtual desktop (Linux/Windows)
        • Stop/Delete/Hibernate a virtual desktop
        • Modify a virtual desktop
        • Share a virtual desktop
        • Virtual desktop scheduling
      • Admin Documentation
        • Dashboard
        • Sessions
        • Virtual Desktop Images (Software Stacks)
        • Permissions management
      • Technical
        • APIs
    • HPC Workloads
      • User Documentation
        • Submit a job
        • Control my jobs
        • Supported EC2 parameters
        • Job Storage
        • Troubleshooting
          • My job is not starting
      • Admin Documentation
        • Queue Profiles
        • Create Web Based Job Submission Worfklows
        • Configure Floating License resources
    • Cluster Manager
      • Projects Management
      • Users Management
      • Groups Management
      • Cluster Status
      • Email Templates
      • APIs
    • Shared Storage
      • Storage Management
  • 👑Best Practices
    • Analytics
      • OpenSearch
        • Configure your OpenSearch
        • Create your own analytics visualizations
    • Budget
      • Review your AWS spend
      • Control your AWS spend
      • Set up budget per project
    • Security
      • Backup IDEA environment
  • 🧱Architecture
    • High Level Overview
  • 🛠️Developer Portal
    • IDEA CLI utility
    • Developer Onboarding
  • 🚨Help and Support
    • FAQ
    • Raise a bug
Powered by GitBook
On this page
  1. Best Practices
  2. Analytics
  3. OpenSearch

Create your own analytics visualizations

PreviousConfigure your OpenSearchNextBudget

Last updated 1 year ago

Make sure to have reviewed Configure your OpenSearch

Click the hamburger menu to reveal the left sidebar then click "Visualize" under "OpenSearch Dashboards" section.

Below are some example to help you get started:

(Scale-Out-Workloads) Money spent by instance type
  • Select "Vertical Bars"

  • Select the "scheduler_jobs" index

  • Y Axis (Metrics):

    • Aggregation: Sum

    • Field: estimated_bom_cost.line_items_total.amount

    • Custom Label: Cost

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: params.instance_types_raw

    • Order By: metric: Cost

    • Size (adjust as needed): 20

    • Custom Label: Instance Type

  • Split Series (Buckets):

    • Sub Aggregation: Terms

    • Field: params.instance_types_raw

    • Order By: metric: Sum of Cost

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Jobs per user
  • Select "Vertical Bars"

  • Select "scheduler_jobs*" index

  • Y Axis (Metrics)

    • Aggregation: count

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Size (adjust as needed): 20

  • Split Series (Buckets):

    • Sub Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Jobs per user grouped by instance type
  • Select "Vertical Bars"

  • Select "scheduler_jobs" index

  • Y Axis (Metrics):

    • Aggregation: count

  • X Axis (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Series (Buckets)

    • Sub Aggregation: Terms

    • Field: params.instance_types.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

Example (click to enlarge):

(Scale-Out-Workloads) Instance type launched by user
  • Select "Heat Map"

  • Select "scheduler_jobs" index

  • Value (Metrics):

    • Aggregation: Count

  • Y Axis (Buckets):

    • Aggregation: Term

    • Field: params.instance_types.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

  • X Axis (Buckets)

    • Sub Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed: 20

Example (click to enlarge):

(Scale-Out Workloads) Number of nodes in the cluster
  • Select "Lines"

  • Select "scheduler_nodes*" index

  • Y Axis (Metrics):

    • Aggregation: Unique Count

    • Field: instance_id

  • X Axis (Bucket)

    • Aggregation: Date Histogram

    • Field: provisioning_time

    • Interval: Minute

Example (click to enlarge):

(Scale-Out-Workloads) Detailed Information per user
  • Select "Datatables"

  • Select "scheduler_jobs" as index

  • Metric (Metrics):

    • Aggregation: Count

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: owner.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: params.instance_type.raw

    • Order By: metric: Count

    • Size (adjust as needed): 20

  • Split Rows (Buckets):

    • Aggregation: Term

    • Field: estimated_bom_cost_.total._amount

    • Order By: metric: Count

    • Size (adjust as needed): 20

Example (click to enlarge):

(VDI) Most active VDI users
  • Select "Pie"

  • Select "vdc_users_sessions*" index

  • Metrics:

    • Slice Size: Count

  • Split Slices (Buckets):

    • Aggregation: Terms

    • Field: owner.raw

    • Order By: metric: count

    • Size (adjust as needed): 20

Example (click to enlarge):

👑