Manage Learn to apply best practices and optimize your operations.

Hit a configuration sweet spot with AWS Spot Instances

Using AWS Spot Instances when testing server setups can help companies tinker with different configurations without affecting the budget.

Before the days of cloud computing, administrators had to guess on the required number of CPU cores and RAM for...

an application before investing in a server. Automatic provisioning can run large number of servers -- running up large bills. Using Spot Instances can help admins find the sweet spot in server configurations -- without souring the budget.

A company that has to run a large analysis job, for example, will run a mix of libraries and code others have written. Admins may not be sure about memory and CPU requirements. They could pick a high-memory, CPU-optimized instance with a high cost, but that's not always the right solution. This practice works for one or two jobs, but it shouldn't be a long-term strategy.

A better option is to test applications with AWS Spot Instances.

To do this, create an image with all the software needed and then create Elastic Block Storage with necessary data. Finally, start multiple Spot Instances with varying configurations.

Because admins must bid on Spot Instances, be sure to check the pricing history in the AWS Management Console beforehand. In addition, check different regions -- you might find lower costs in regions other than the ones you traditionally use.

Once Spot Instances are set up, run an application and check CPU and memory use . When running on Linux, use the "free -m" command to check free memory. Linux will use as much memory as possible, when it is needed. If you have excessive amounts of free memory, consider switching to an instance with less RAM.

Run the "top" command to monitor CPU use. If your usage is at 100%, then you’re using one core at 100%. If you have a 16-core instance, you likely will see 700% utilization. That means you are keeping seven cores busy while nine are idle. You can switch to a lower cost instance without adversely affecting performance.

Spot Instances can be suspended at any time, but because you're just testing these, it shouldn't be a problem. The savings can be substantial. For example, the r3.8xlarge costs $2.80 per hour on-demand; it recently went for about $0.30 in the US-West-2 region. At these prices, it's easy to cost-justify experimenting with different instances.

About the author:
Dan Sullivan holds a Master of Science degree and is an author, systems architect and consultant with more than 20 years of IT experience. He has had engagements in advanced analytics, systems architecture, database design, enterprise security and business intelligence. He has worked in a broad range of industries, including financial services, manufacturing, pharmaceuticals, software development, government, retail and education. Dan has written extensively about topics that range from data warehousing, cloud computing and advanced analytics to security management, collaboration and text mining.

Next Steps

Learn more about how companies are using AWS Spot Instances

Discover why Spot Instances have received a two-minute warning

This was last published in February 2015

Dig Deeper on AWS instances strategy and setup

Join the conversation

4 comments

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.

Has your enterprise used Spot Instances to test AWS apps?
Cancel
We primarily just use on-demand instances for short-term projects. 
Cancel
In the past, we have used spot instances to test AWS apps. Testing using spot instances has benefited the organization through cost savings and elasticity.  Spot instances enables our organization to bid on Amazon EC2 capacity depending on the price that customers prefer. We can spin up to 5-6 instances as long as there is a favorable bid on the spot price. Thanks to spot instances, we are able to test our applications' resiliency.
Cancel
Many companies actually use spot instances and they have become quite popular, I know of a number of companies that have used this software and have cut their budgets almost by half. Many companies can save their time, resources and avoid the guessing game that comes with Server configuration with the program. However, I have discovered that Spot Instances is quite expensive for small companies. I would only recommend it for the cooperation level companies.
Cancel

-ADS BY GOOGLE

SearchCloudApplications

TheServerSide.com

SearchSoftwareQuality

SearchCloudComputing

Close