How can I programmatically control AWS cloud and storage resources?
System administrators routinely write scripts to automate repetitive management tasks -- a functionality they don't have to give up in a move to public cloud. There are several ways to programmatically control Amazon Web Services (AWS) cloud resources.
AWS provides application programming interfaces (APIs) to its services along with software development kits for popular development platforms, which include Java, iOS, .NET, PHP, Python and Ruby. AWS also supports plug-ins for Eclipse and Visual Studio integrated development environments.
If you prefer scripting with command-line tools, they're available for many AWS services, such as Elastic Compute Cloud (EC2), Simple Storage Service (S3), CloudSearch, Relational Database Service (RDS), Elastic MapReduce (EMR) and Simple Queue Service (SQS). You can download these command-line tools from the Tools for Amazon Web Services page on the AWS website. With command-line tools, you can work with shell scripts or scripting languages, such as Python, Perl or Ruby.
Apache Libcloud is a cloud management package that abstracts common functions across clouds, removing differences among multiple cloud providers' APIs and allowing developers to build products that can work across clouds. It works with Amazon EC2 for computing resources and S3 for storage. Libcloud is a Python package and requires some familiarity with Python.
The Boto package is applicable if you're primarily concerned with the Amazon cloud. It's a Python package with support for EC2, Elastic MapReduce, CloudFront, SimpleDB, Dynamo, CloudSearch and other popular services.
About the author:
Dan Sullivan, M.Sc., is an author, systems architect and consultant with more than 20 years of IT experience. He has had engagements in advanced analytics, systems architecture, database design, enterprise security and business intelligence. He has worked in a broad range of industries, including financial services, manufacturing, pharmaceuticals, software development, government, retail and education. Dan has written extensively about topics that range from data warehousing, cloud computing and advanced analytics to security management, collaboration and text mining.
Related Q&A from Dan Sullivan
Interest in hybrid cloud data storage is growing, but is it safe? Expert Dan Sullivan outlines the risks and rewards for enterprises.continue reading
When enterprises look to migrate a proprietary database to the AWS cloud, there are a number of security considerations to keep in mind. Expert Dan ...continue reading
Want to learn how to monitor a Windows application in Amazon Web Services? Dan Sullivan reviews the two ways to do this whether users are running a ...continue reading
Have a question for an expert?
Please add a title for your question
Get answers from a TechTarget expert on whatever's puzzling you.