iQueue: a pervasive data composition framework

There will soon be a huge number of data sources accessible to applications across the Internet. These include Web services, personal devices such as cellular phones and cars, and sensors measuring physical phenomena. New classes of data-composition applications can exploit this data. However, the data is diverse, voluminous, and often rapidly changing. The sources of data can be mobile, distributed, and failure-prone. Without system support, applications that use this kind of data are difficult to write. The iQueue data composition framework provides system support for data composition, thereby making the task of writing applications easier.

1. Introduction

There is an explosion in the number of data sources accessible across the Internet. They include millions of files, databases, and online data feeds; billions of personal devices such as cellular phones, wireless PDAs, and networked cars; and trillions of physical data sources, such as traffic and temperature sensors. The data is voluminous, diverse, and often dynamic, with rapidly changing values. Novel responsive applications can be built by efficiently composing data from these diverse sources. Examples of the kinds of applications we envision are: •

Let me know when the stock value of PQR Inc. is $14 and my friend has wired the$1000 that he owed me.

•

Let me know if DVD players are on sale in an electronics store I will be driving by soon.

•

Based on current taxi locations and activities, assign the next passenger pickup to a particular taxi.

•

Continuously suggest driving routes, based on data from traffic sensors and traffic data feeds.