Bridge: a high performance file system for parallel processors
Peter Dibble, Michael Lee Scott, Carla S. Ellis · 2003
A parallel file system called Bridge that distributes each file across multiple storage devices and processors has been designed and prototyped. The approach is based on the notion of an interleaved file, in which consecutive logical blocks are assigned to different physical nodes. Naive programs are able to access files just as they would with a conventional file system, while more sophisticated programs can export pieces of their code to the processors managing the data, for optimum performance. Early analytical and experimental results indicate that Bridge will deliver good parallel speedup for configurations in excess of 32 nodes with disks. High performance is achieved by exporting the I/O-related portions of an application into the processors closest to the data. A pair of applications that illustrate this technology is presented. General issues in the design of algorithms for Bridge are discussed.>
Cited by 64 works. doi:10.1109/dcs.1988.12513
Authors
References
- A trace-driven analysis of the UNIX 4.2 BSD file system
- A trace-driven analysis of the UNIX 4.2 BSD file system
- Disk striping
- GAMMA—a high performance dataflow database machine
- Database Machines: An Idea Whose Time has Passed? A Critique of the Future of Database Machines
- Short-Term File Reference Patterns in a UNIX Environment
- Database Machines: An Idea Whose Time Passed? A Critique of the Future of Database Machines.
- File migration in distributed computer systems
- Programming Support in the Cronus Distributed Operating System.
- The Architecture of IBM's Early Computers