AWS Data Pipeline (Amazon Web Services Data Pipeline)

This definition is part of our Essential Guide: An insider's look at AWS re:Invent 2014

AWS Data Pipeline is a web service that moves data between compute and storage services offered by Amazon Web Services (AWS). 

AWS Data Pipeline helps customers to manage and streamline any workflow that’s data-driven. The service is useful for customers who have data spread across many AWS services and want to harness it all into a single location for configuration and management. For example, a data scientist could assign a job to Data Pipeline so that it accesses log data from the storage service every hour and then transfers it to a relational database for future analysis. While the service is particularly suited to workflows already optimized for AWS, Data Pipeline can also connect with the customer's proprietary data source in house, as well as third-party data sources.

Customers can access information from a data source, process it and then automatically transfer the result to another system or service simply by using a Data Pipeline template. Developers can access Data Pipeline through the AWS Management Console, the command line interface, or the service APIs. Pricing depends on usage and can be free for low frequency activities. 



This was last updated in May 2014

Continue Reading About AWS Data Pipeline (Amazon Web Services Data Pipeline)



Find more PRO+ content and other member only offers, here.

Start the conversation

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.


File Extensions and File Formats