Control your AWS spend
IDEA offers multiple ways to make sure you will stay within budget while running your Engineer & Design workloads on AWS
General Best Practices
Assuming you are on-boarding a new team, here are our recommend best practices:
1 - Create LDAP accounts for all users.
2 - Create LDAP group for the team. Add all users to the group.
3 - Create a Project and map the LDAP group.
4 - Create a new queue profile limit the queue ACLs to the project created step 3.
5 - Limit the type of EC2 instances your users can provision.
6 - If needed, configure restricted parameters.
7 - Create a Budget to make sure the new team won't spend more than what's authorized.
8 - Limit your job to only run on your Reserved Instances or limit the number of provisioned instances for your queue.
Limit who can submit jobs
Only allow specific individual users or/and LDAP groups to submit jobs or provision virtual desktops. Refer to this page for examples and documentation.
Limit what type of EC2 instance can be provisioned
Control what type of EC2 instances can be provisioned for any given queue. Refer to this page for examples and documentation
Accelerated Computing Instances
Unless required for your workloads, it's recommended to exclude "p2", "p3", "g2", "g3", "p3dn" or other GPU instances type.
Force jobs to run only on Reserved Instances
You can limit a your simulation jobs to only un on Reserved Instances if you specify force_ri=True (Documentation) flag at job submission or for the entire queue. Your job will stay in the queue if you do not have any Reserved Instance available.
Limit the number of concurrent jobs or provisioned instances
You can limit the number of concurrent running jobs or provisioned instances at the queue level.
These settings are independent so you can choose to either limit by # jobs, # instances, both or nones
Create a budget
Creating an AWS Budget will ensure jobs can't be submitted if the budget allocated to the team/queue/project has exceeded the authorized amount. Refer to this page for examples and documentation
Review your HPC cost in a central dashboard
Stay on top of your AWS costs in real time. Quickly visualize your overall usage and find answers to your most common questions:
Who are my top users?
How much money did we spend for Project A?
How much storage did we use for Queue B?
Where my money is going (storage, compute ...)
Etc ...
Last updated