skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · colloquia · 2007-2008 · 

Colloquium - Maltzahn

ECCR 155

End-to-End Quality of Service for Large Distributed Storage
University of California, Santa Cruz

Storage systems for large and distributed clusters of compute servers are themselves large and distributed. Their complexity and scale makes it hard to manage these systems, and in particular they make it hard to ensure that applications using them get good, predictable performance. At the same time, shared access to the system from multiple applications, users, and competition from internal system activities leads to a need for predictable performance.

Carlos Maltzahn photo

This project investigates mechanisms for improving storage system performance in large distributed storage systems through mechanisms that integrate the performance aspects of the path that I/O operations take through the system, from the application interface on the compute server, through the network, to the storage servers: I/O scheduling at the storage server, storage server cache management, client-to-server network flow control, client-to-server connection management, and client cache management.

In this talk I will give an overview of the project and then focus on the first piece, the I/O scheduling at the storage server, and present Fahrrad, our universal real-time disk scheduler. A universal real-time disk scheduler manages the execution of disk requests to provide performance guarantees for a range of applications with a mixture of different performance requirements and behaviors. Existing systems handle mixed workloads by over-provisioning resources, by partitioning (separating the workloads by resource or by time), or by hierarchically combining separate schedulers for each class of work. Our Fahrrad scheduler, on the other hand, is a unified disk scheduler, based on proven real-time scheduling principles, that provides efficient utilization of disk resources while supporting mixtures of applications with hard and soft real-time performance requirements. Fahrrad supports (nearly) arbitrarily hard performance guarantees, with and without timing constraints, which allows mixing a backup application, hard real-time sensor data recording, and soft real-time video playback in a single system. Our results show that Fahrrad manages disk performance well and that it can use its knowledge of timing requirements to yield higher throughput for some workloads than current non-real-time schedulers can provide.

Hosted by Dirk Grunwald.

The Department holds colloquia throughout the Fall and Spring semesters. These colloquia, open to the public, are typically held on Thursday afternoons, but sometimes occur at other times as well. If you would like to receive email notification of upcoming colloquia, subscribe to our Colloquia Mailing List. If you would like to schedule a colloquium, see Colloquium Scheduling.

Sign language interpreters are available upon request. Please contact Stephanie Morris at least five days prior to the colloquium.

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:29)