WO2001093106A3 - High performance efficient subsystem for data object storage - Google Patents

High performance efficient subsystem for data object storage Download PDF

Info

Publication number
WO2001093106A3
WO2001093106A3 PCT/US2001/017230 US0117230W WO0193106A3 WO 2001093106 A3 WO2001093106 A3 WO 2001093106A3 US 0117230 W US0117230 W US 0117230W WO 0193106 A3 WO0193106 A3 WO 0193106A3
Authority
WO
WIPO (PCT)
Prior art keywords
segments
disk
segment
directory structure
high performance
Prior art date
Application number
PCT/US2001/017230
Other languages
French (fr)
Other versions
WO2001093106A2 (en
Inventor
Faramarz Rabii
Richard J Morris
Original Assignee
Infolibria Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Infolibria Inc filed Critical Infolibria Inc
Priority to AU2001265075A priority Critical patent/AU2001265075A1/en
Priority to EP01939572A priority patent/EP1358575A2/en
Publication of WO2001093106A2 publication Critical patent/WO2001093106A2/en
Publication of WO2001093106A3 publication Critical patent/WO2001093106A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers

Abstract

A non-hierarchical or linear directory structure for a mass storage unit such as a disk. The directory structure can be kept in an auxiliary semiconductor memory. The disk is partitioned into segments of equal size. The directory structure presumes that data objects reside wholly and contiguously within a given area of the disk segments. While a variable number of objects may be stored within each segment, a given object is not allowed to occupy more than one segment. During a storage operation, objects are assigned to segments in a round-robin fashion, to equalize segment utilization.
PCT/US2001/017230 2000-05-26 2001-05-25 High performance efficient subsystem for data object storage WO2001093106A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2001265075A AU2001265075A1 (en) 2000-05-26 2001-05-25 High performance efficient subsystem for data object storage
EP01939572A EP1358575A2 (en) 2000-05-26 2001-05-25 High performance efficient subsystem for data object storage

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US20799500P 2000-05-26 2000-05-26
US60/207,995 2000-05-26
US09/866,383 US20020032691A1 (en) 2000-05-26 2001-05-25 High performance efficient subsystem for data object storage
US09/866,383 2001-05-25

Publications (2)

Publication Number Publication Date
WO2001093106A2 WO2001093106A2 (en) 2001-12-06
WO2001093106A3 true WO2001093106A3 (en) 2003-08-14

Family

ID=26902797

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/017230 WO2001093106A2 (en) 2000-05-26 2001-05-25 High performance efficient subsystem for data object storage

Country Status (4)

Country Link
US (1) US20020032691A1 (en)
EP (1) EP1358575A2 (en)
AU (1) AU2001265075A1 (en)
WO (1) WO2001093106A2 (en)

Families Citing this family (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001075877A1 (en) * 2000-03-31 2001-10-11 Doug Carson & Associates, Inc. Sequencing data blocks to provide hidden data on a recording medium
US7197513B2 (en) * 2000-12-08 2007-03-27 Aol Llc Distributed image storage architecture
US7779117B2 (en) * 2002-05-31 2010-08-17 Aol Inc. Monitoring digital images
US7428636B1 (en) * 2001-04-26 2008-09-23 Vmware, Inc. Selective encryption system and method for I/O operations
US7260820B1 (en) 2001-04-26 2007-08-21 Vm Ware, Inc. Undefeatable transformation for virtual machine I/O operations
JP2003016763A (en) * 2001-06-29 2003-01-17 Toshiba Corp Device and method for accessing disk
DE10200351A1 (en) * 2002-01-08 2003-07-17 Hoetker Andreas Data security algorithm uses 64 bit processing for 28 bit words.
US7058642B2 (en) * 2002-03-20 2006-06-06 Intel Corporation Method and data structure for a low memory overhead database
CA2391717A1 (en) * 2002-06-26 2003-12-26 Ibm Canada Limited-Ibm Canada Limitee Transferring data and storing metadata across a network
FI114948B (en) * 2002-09-20 2005-01-31 Nokia Corp Instructions for control objects
US7546319B1 (en) * 2003-04-28 2009-06-09 Ibrix, Inc. File system consistency checking in a distributed segmented file system
FI116958B (en) * 2003-07-01 2006-04-13 Nokia Corp Determination of management nodes in a device management system
US7246211B1 (en) * 2003-07-22 2007-07-17 Swsoft Holdings, Ltd. System and method for using file system snapshots for online data backup
US7836248B2 (en) * 2003-07-29 2010-11-16 International Business Machines Corporation Methods and systems for managing persistent storage of small data objects
US7523171B2 (en) 2003-09-09 2009-04-21 International Business Machines Corporation Multidimensional hashed tree based URL matching engine using progressive hashing
US9213609B2 (en) * 2003-12-16 2015-12-15 Hewlett-Packard Development Company, L.P. Persistent memory device for backup process checkpoint states
US8112400B2 (en) * 2003-12-23 2012-02-07 Texas Instruments Incorporated Method for collecting data from semiconductor equipment
US7100008B2 (en) 2004-03-15 2006-08-29 Hitachi, Ltd. Long term data protection system and method
US20050216552A1 (en) * 2004-03-24 2005-09-29 Samuel Fineberg Communication-link-attached persistent memory system
US8131674B2 (en) * 2004-06-25 2012-03-06 Apple Inc. Methods and systems for managing data
US7401102B2 (en) * 2004-10-19 2008-07-15 International Business Machines Corporation Management of global counters in transactions
US20060206507A1 (en) * 2005-02-16 2006-09-14 Dahbour Ziyad M Hierarchal data management
JP4758429B2 (en) * 2005-08-15 2011-08-31 株式会社ターボデータラボラトリー Shared memory multiprocessor system and information processing method thereof
US7996366B1 (en) * 2005-10-13 2011-08-09 Cadence Design Systems, Inc. Method and system for identifying stale directories
US8949555B1 (en) * 2007-08-30 2015-02-03 Virident Systems, Inc. Methods for sustained read and write performance with non-volatile memory
US9411976B2 (en) * 2006-12-01 2016-08-09 Maidsafe Foundation Communication system and method
GB2446199A (en) * 2006-12-01 2008-08-06 David Irvine Secure, decentralised and anonymous peer-to-peer network
US8234327B2 (en) * 2007-03-30 2012-07-31 Netapp, Inc. System and method for bandwidth optimization in a network storage environment
KR100977159B1 (en) * 2007-12-14 2010-08-20 한국전자통신연구원 Method And System Of File Metadata Management Transparent About Address Changing Of Data Servers And Their Disk Movements
US20100235386A1 (en) * 2009-03-13 2010-09-16 Cox Communications, Inc. Multi-user file system for multi-room digital video recording
US20100262797A1 (en) * 2009-04-10 2010-10-14 PHD Virtual Technologies Virtual machine data backup
US8392403B2 (en) * 2009-09-18 2013-03-05 Microsoft Corporation Management of data and computation in data centers
US8527496B2 (en) * 2010-02-11 2013-09-03 Facebook, Inc. Real time content searching in social network
CN102012873B (en) * 2010-11-24 2012-09-05 清华大学 Cache system of Not AND (NAND) flash memory and cache method
US8538926B2 (en) * 2011-03-08 2013-09-17 Rackspace Us, Inc. Massively scalable object storage system for storing object replicas
US8832375B2 (en) 2012-05-24 2014-09-09 International Business Machines Corporation Object type aware byte caching
US8856445B2 (en) 2012-05-24 2014-10-07 International Business Machines Corporation Byte caching with chunk sizes based on data type
KR101979715B1 (en) 2012-09-28 2019-05-17 삼성전자 주식회사 Computing system and data management method thereof
US9081672B1 (en) * 2013-05-30 2015-07-14 Richard Michael Nemes Methods and apparatus for information storage and retrieval using a caching technique with external-chain hashing and dynamic resource-dependent data shedding
US9678979B1 (en) 2013-07-31 2017-06-13 EMC IP Holding Company LLC Common backup format and log based virtual full construction
US9110910B1 (en) * 2013-07-31 2015-08-18 Emc Corporation Common backup format and log based virtual full construction
CN105320776B (en) * 2015-11-12 2019-02-05 广州优识科技资讯股份有限公司 A kind of data processing method and system based on WebApp
IT201700057287A1 (en) * 2017-05-26 2018-11-26 St Microelectronics Srl PROCEDURE FOR MANAGING INTEGRATED CIRCUIT CARDS, CARD AND CORRESPONDING EQUIPMENT
US10540323B2 (en) 2017-05-30 2020-01-21 Western Digital Technologies, Inc. Managing I/O operations in a storage network

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5339398A (en) * 1989-07-31 1994-08-16 North American Philips Corporation Memory architecture and method of data organization optimized for hashing
US5297249A (en) * 1990-10-31 1994-03-22 International Business Machines Corporation Hypermedia link marker abstract and search services
US5276840A (en) * 1991-03-22 1994-01-04 Acer Incorporated Disk caching method for writing data from computer memory including a step of writing a plurality of physically adjacent blocks in a single I/O operation
US5806079A (en) * 1993-11-19 1998-09-08 Smartpatents, Inc. System, method, and computer program product for using intelligent notes to organize, link, and manipulate disparate data objects
US5745749A (en) * 1994-06-27 1998-04-28 International Business Machines Corp. Method and system of file version clustering of object blocks using a compiler and database and having a predetermined value
US5764852A (en) * 1994-08-16 1998-06-09 International Business Machines Corporation Method and apparatus for speech recognition for distinguishing non-speech audio input events from speech audio input events
JP3212238B2 (en) * 1995-08-10 2001-09-25 株式会社日立製作所 Mobile communication system and mobile terminal device
US5809494A (en) * 1995-11-16 1998-09-15 Applied Language Technologies, Inc. Method for rapidly and efficiently hashing records of large databases
US5896506A (en) * 1996-05-31 1999-04-20 International Business Machines Corporation Distributed storage management system having a cache server and method therefor
US5864863A (en) * 1996-08-09 1999-01-26 Digital Equipment Corporation Method for parsing, indexing and searching world-wide-web pages
US5787435A (en) * 1996-08-09 1998-07-28 Digital Equipment Corporation Method for mapping an index of a database into an array of files
US5822759A (en) * 1996-11-22 1998-10-13 Versant Object Technology Cache system
US6084855A (en) * 1997-02-18 2000-07-04 Nokia Telecommunications, Oy Method and apparatus for providing fair traffic scheduling among aggregated internet protocol flows
US5897637A (en) * 1997-03-07 1999-04-27 Apple Computer, Inc. System and method for rapidly identifying the existence and location of an item in a file
US6278992B1 (en) * 1997-03-19 2001-08-21 John Andrew Curtis Search engine using indexing method for storing and retrieving data
US5895463A (en) * 1997-05-20 1999-04-20 Franklin Electronic Publishers, Incorporated Compression of grouped data
US6167438A (en) * 1997-05-22 2000-12-26 Trustees Of Boston University Method and system for distributed caching, prefetching and replication
US5892919A (en) * 1997-06-23 1999-04-06 Sun Microsystems, Inc. Spell checking universal resource locator (URL) by comparing the URL against a cache containing entries relating incorrect URLs submitted by users to corresponding correct URLs
US5960434A (en) * 1997-09-26 1999-09-28 Silicon Graphics, Inc. System method and computer program product for dynamically sizing hash tables
US6327242B1 (en) * 1998-03-17 2001-12-04 Infolibria, Inc. Message redirector with cut-through switch for highly reliable and efficient network traffic processor deployment
US6205481B1 (en) * 1998-03-17 2001-03-20 Infolibria, Inc. Protocol for distributing fresh content among networked cache servers
US6128623A (en) * 1998-04-15 2000-10-03 Inktomi Corporation High performance object cache
US6292880B1 (en) * 1998-04-15 2001-09-18 Inktomi Corporation Alias-free content-indexed object cache
US6389460B1 (en) * 1998-05-13 2002-05-14 Compaq Computer Corporation Method and apparatus for efficient storage and retrieval of objects in and from an object storage device
US6438652B1 (en) * 1998-10-09 2002-08-20 International Business Machines Corporation Load balancing cooperating cache servers by shifting forwarded request
US6275919B1 (en) * 1998-10-15 2001-08-14 Creative Technology Ltd. Memory storage and retrieval with multiple hashing functions
US6317778B1 (en) * 1998-11-23 2001-11-13 International Business Machines Corporation System and method for replacement and duplication of objects in a cache
US6405252B1 (en) * 1999-11-22 2002-06-11 Speedera Networks, Inc. Integrated point of presence server network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JONATHAN LEDLIE AND MATTHEW MCCORMICK: "A Fast File System for Caching Web Objects", RESEARCH REPORT, May 2000 (2000-05-01), University of Wisconsin - Madison, pages 1 - 12, XP002234461 *
MALTZAHN C ET AL: "Reducing the disk I/O of Web proxy server caches", PROCEEDINGS OF THE 1999 USENIX ANNUAL TECHNICAL CONFERENCE, PROCEEDINGS OF 1999 USENIX ANNUAL CONFERENCE, MONTEREY, CA, USA, 6-11 JUNE 1999, 1999, Berkeley, CA, USA, USENIX Assoc, USA, pages 225 - 238, XP002234460, ISBN: 1-880446-33-2 *

Also Published As

Publication number Publication date
EP1358575A2 (en) 2003-11-05
AU2001265075A1 (en) 2001-12-11
WO2001093106A2 (en) 2001-12-06
US20020032691A1 (en) 2002-03-14

Similar Documents

Publication Publication Date Title
WO2001093106A3 (en) High performance efficient subsystem for data object storage
Hutflesz et al. Globally order preserving multidimensional linear hashing
Marmol et al. {NVMKV}: A Scalable and Lightweight Flash Aware {Key-Value} Store
WO2002029539A3 (en) A data storage subsystem including a storage disk array employing dynamic data striping
MY122440A (en) Dynamic allocation for efficient management of variable sized data within a nonvolatile memory
EP0712067A3 (en) Flash disk card
TW530304B (en) Techniques for operating non-volatile memory systems with data sectors having different sizes than the sizes of the pages and/or blocks of the memory
WO2003067787A3 (en) Redirecting local disk traffic to network attached storage
TW345660B (en) Stabilization circuits and techniques for storage and retrieval of single or multiple digital bits per memory cell
JP2000293314A5 (en)
EP1308833A3 (en) Disk array controller
CN105005617A (en) Storage method and device of time sequence data
WO1999044113A3 (en) Increasing the memory performance of flash memory devices by writing sectors simultaneously to multiple flash memory devices
CN107562644B (en) Compression method of solid state disk mapping table
WO2009000186A1 (en) Control method for logical strips based on multi-channel solid-state non-volatile storage device
WO2005069148A3 (en) Memory management method and related system
WO2002023867A3 (en) Key caching system
US20160364176A1 (en) Method for Storing Data and Device Thereof
CN101751993A (en) Apparatus and method for cache control
US20180364938A1 (en) Extent-based data location table management
CN110134650B (en) File loading method, device, equipment and storage medium
CN101777061A (en) JAVA card object management method and JAVA card
WO2003052577A3 (en) Cache storage system and method
CN105824613A (en) Electronic device and dormancy operation method
Martin Spiral storage: Incrementally augmentable hash addressed storage

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2001939572

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 2001939572

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2001939572

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP