Network-aware Data Management

NDM workshops:


















NDM 2015
Today’s data centric environment both in industry and scientific domains depends on the underlying network infrastructure and its performance, to deliver highly distributed extreme- scale application workloads. As current technology enables faster storage devices and larger interconnect bandwidth, there is a substantial need for novel system design and middleware architecture to address increasing latency and scalability requirements. Furthermore, limitations in end-system architecture and system software design play an important role in many-core platforms. Traditional network and data management techniques are unlikely to scale to meet the needs of future data-intensive systems. We require new collaborations between data management and networking communities to develop intelligent networking middleware and efficient data management infrastructure. This workshop seeks contributions from academia, government, and industry to discuss future design principles of network- aware data management. We focus on emerging trends in resource coordination, data-aware scheduling, storage technologies, end-to-end performance, network-aware workflow management, high-performance networking, and network virtualization.

NDM 2014
Data sharing and resource coordination among distributed teams are becoming significant challenges every passing year. Networking is one of the most crucial components in the overall system architecture of a data centric environment. Many of the current solutions both in industry and scientific domains depend on the underlying network infrastructure and its performance. There is a need for efficient use of the networking middleware to address increasing data and compute requirements. Main scope of this workshop is to promote new collaborations between data management and networking communities to evaluate emerging trends and current technological developments, and to discuss future design principles of network-aware data management. We will seek contribution from academia, government, and industry to address current research and development efforts in remote data access mechanisms, end-to-end resource coordination, network virtualization, analysis and management frameworks, practical experiences, data-center networking, and performance problems in high-bandwidth networks.


NDM 2013
In addition to increasing data volumes, future scientific collaborations require cooperative work at the extreme scale. As the number of multidisciplinary teams and experimental facilities increase, data sharing and resource coordination among distributed centers are becoming significant challenges every passing year.  In the age of extraordinary advances in communication technologies, there is a need for efficient use of the network infrastructure to address increasing data requirements of today’s applications.  Traditional network and data management techniques are unlikely to scale to meet the needs of future collaborative data-intensive systems. We require novel data access mechanisms and intelligent network middleware to enable future design principles of network-aware data management.  This workshop will seek contributions from academia, government, and industry to discuss emerging trends and new technological developments in dynamic resource provisioning, intelligent data-flow and resource coordination, end-to-end processing of data, network-aware application design issues, and cutting-edge network performance problems.

NDM 2012
Scientific applications and experimental facilities generate large amounts of data. In addition to increasing data volumes and computational requirements, today’s major science requires cooperative work in globally distributed multidisciplinary teams. In the age of extraordinary advances in communication technologies, there is a need for efficient use of the network infrastructure to address increasing data and compute requirements of large-scale applications. Since the amount of data and the size of scientific projects are continuously growing, traditional data management techniques are unlikely to support future collaboration systems at the extreme scale. Network-aware data management services for dynamic resource provisioning, end-to-end processing of data, intelligent data-flow and resource coordination are highly desirable. This workshop will seek contribution from academia, government, and industry to discuss emerging trends in use of networking for data management, novel techniques for data representation, simplification of end-to-end data flow, resource coordination, and network-aware tools for the scientific applications.

NDM 2011
Accessing and managing large amounts of data is a great challenge in a collaborative environment where resources/scientists are geographically distributed. There is a need for efficient use of the network infrastructure in order to address the increasing data and compute requirements of large-scale applications. Since the amount of data is continuously growing, traditional techniques of leaving the burden on the user of moving/storing data is not a viable option in many cases.  In order to deliver true exascale performance to the application layer, network-aware data management services for resource provisioning, intelligent data-flow and coordination between the host systems is highly desirable. This workshop will seek contribution from academia, government, and industry to discuss emerging trends in use of networking for data management, novel abstraction techniques for data representation, simplification of end-to-end data flow by providing transparent data services, end-to-end resource coordination, and network-aware tools for the scientific community.