Active disks for large-scale data processing
Erik Riedel, Christos Faloutsos, Garth A. Gibson et al. · Computer · 2001
As processor performance increases and memory cost decreases, system intelligence continues to move away from the CPU and into peripherals. Storage system designers use this trend toward excess computing power to perform more complex processing and optimizations inside storage devices. To date, such optimizations take place at relatively low levels of the storage protocol. Trends in storage density, mechanics, and electronics eliminate the hardware bottleneck and put pressure on interconnects and hosts to move data more efficiently. We propose using an active disk storage device that combines on-drive processing and memory with software downloadability to allow disks to execute application-level functions directly at the device. Moving portions of an application's processing to a storage device significantly reduces data traffic and leverages the parallelism already present in large systems, dramatically reducing the execution time for many basic data mining tasks.
Cited by 224 works. doi:10.1109/2.928624
Authors
References
- Fast Algorithms for Mining Association Rules in Large Databases
- Fast algorithms for mining association rules
- A cost-effective, high-bandwidth storage architecture
- A cost-effective, high-bandwidth storage architecture
- Searching Multimedia Databases by Content
- Active disks
- A case for intelligent disks (IDISKs)
- Active disks
- Active Disks - Remote Execution for Network-Attached Storage,
- Active Disks