Methods for accessing data in a compressed file system and devices thereof
IPC분류정보
국가/구분
United States(US) Patent
등록
국제특허분류(IPC7판)
G06F-017/30
H04L-012/46
G06F-012/10
출원번호
US-0400202
(2012-02-20)
등록번호
US-9020912
(2015-04-28)
발명자
/ 주소
Majee, Sumandra
Hansen, David
출원인 / 주소
F5 Networks, Inc.
대리인 / 주소
LeClairRyan, a Professional Corporation
인용정보
피인용 횟수 :
10인용 특허 :
268
초록▼
A method, computer readable medium, and network traffic management apparatus that accesses data in a compressed file system includes obtaining an original write request from a client computing device including at least object data. The object data is compressed into a plurality of compressed blocks.
A method, computer readable medium, and network traffic management apparatus that accesses data in a compressed file system includes obtaining an original write request from a client computing device including at least object data. The object data is compressed into a plurality of compressed blocks. A mapping of each compressed block to a portion of the object data compressed therein is generated, wherein the portion of the object data compressed therein is represented in the mapping by a unique object identifier, a start offset, and a length. The compressed blocks and the mapping are stored in at least one data storage device. At least one data access request for at least a portion of the object data is serviced based on the mapping.
대표청구항▼
1. A method for accessing data in a compressed file system, comprising: obtaining, by a network traffic management apparatus, at least one original write request from a client computing device comprising object data;compressing, by the network traffic management apparatus, the object data into a plu
1. A method for accessing data in a compressed file system, comprising: obtaining, by a network traffic management apparatus, at least one original write request from a client computing device comprising object data;compressing, by the network traffic management apparatus, the object data into a plurality of compressed blocks;generating, by the network traffic management apparatus, a mapping of each of the plurality of compressed blocks to a corresponding portion of the object data, wherein every corresponding portion of the object data is represented in the mapping by a corresponding unique object identifier, a start offset, and a length; andservicing, by the network traffic management apparatus, at least one subsequent data access request for at least a portion of the object data, the servicing comprising obtaining at least the requested portion of the object data from the mapped one of the plurality of compressed blocks based on the unique object identifier, the start offset and the length. 2. The method as set forth in claim 1 wherein the servicing further comprises: obtaining, by the network traffic management apparatus, the data access request from the client computing device, wherein the data access request comprises a value for a plurality of parameters comprising the object identifier, the start offset, and the length;identifying, by the network traffic management apparatus, the mapped at least one compressed block based at least in part on the mapping and one or more of the data access request parameter values;retrieving, by the network traffic management apparatus, the identified compressed block;obtaining, by the network traffic management apparatus, at least a portion of the object data identified by the data access request parameter values; anddecompressing, by the network traffic management apparatus, the retrieved compressed block. 3. The method as set forth in claim 2 wherein the data access request is a read request, the method further comprising: sending, by the network traffic management apparatus, the obtained object data to the requesting client computing device. 4. The method as set forth in claim 2 wherein the data access request is a write request, the write request further comprises object data, and wherein the compressing, with the network traffic management apparatus, the object data into a plurality of compressed blocks further comprises: compressing, by the network traffic management apparatus, the object data into a plurality of compressed blocks each including compressed object data and an empty portion, the method further comprising replacing, by the network traffic management apparatus, the retrieved compressed block with a modified compressed block comprising, compressed write request object data when a size of the modified compressed block is not greater than a size of the retrieved compressed block. 5. The method as set forth in claim 4 further comprising: modifying, by the network traffic management apparatus, the object data to include at least a portion of the object data included in the write request;generating, by the network traffic management apparatus, the modified compressed block; andcompressing, by the network traffic management apparatus, the modified object data. 6. The method as set forth in claim 2 wherein the data access request is based on a protocol comprising a common Internet file system (CIFS) protocol, a network file system (NFS) protocol, or a file transfer protocol (FTP). 7. The method as set forth in claim 1 further comprising; storing, by the network traffic management apparatus, the compressed blocks and the mapping in at least one data storage device. 8. The method as set forth in claim 7, wherein the at least one data storage device comprises tiered storage, a memory of a network traffic management apparatus, or a file server device. 9. A non-transitory computer readable medium having stored thereon instructions for accessing data in a compressed file system comprising machine executable code which when executed by at least one processor, causes the processor to perform steps comprising: obtaining at least one original write request from a client computing device comprising object data;compressing the object data into a plurality of compressed blocks;generating a mapping of each of the plurality of compressed blocks to a portion of the object data, wherein every corresponding portion of the object data is represented in the mapping by a corresponding unique object identifier, a start offset, and a length; andservicing at least one subsequent data access request for one of the portions of the object data, wherein the servicing comprises obtaining at least the requested portion of the object data from the mapped one of the plurality of compressed blocks based on the unique object identifier, the start offset and the length. 10. The medium as set forth in claim 9 wherein the servicing further comprises: obtaining the data access request from the client computing device, wherein the data access request comprises a value for a plurality of parameters comprising the object identifier, the start offset, and the length;identifying the mapped at least one compressed block based at least in part on the mapping and one or more of the data access request parameter values;retrieving the identified compressed block;obtaining at least a portion of the object data identified by the data access request parameter values; anddecompressing the retrieved compressed block. 11. The medium as set forth in claim 10 wherein the data access request is a read request, the medium further having stored thereon instructions that when executed by the at least one processor cause the processor to perform steps further comprising: sending the obtained object data to the requesting client computing device. 12. The medium as set forth in claim 10 wherein the data access request is a write request, the write request further comprises object data, and the compressing the object data into a plurality of compressed blocks further comprises: compressing the object data into a plurality of compressed blocks each comprising compressed object data and an empty portion, the medium further comprising replacing the retrieved compressed block with a modified compressed block comprising compressed write request object data when a size of the modified compressed block is not greater than a size of the retrieved compressed block. 13. The medium as set forth in claim 12 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising: modifying the object data to include at least a portion of the object data included in the write request; andgenerating the modified compressed block; andcompressing the modified object data. 14. The medium as set forth in claim 10 wherein the data access request is based on a protocol comprising a common Internet file system (CIFS) protocol, a network file system (NFS) protocol, or a file transfer protocol (FTP). 15. The medium as set forth in claim 9 further having stored thereon instructions that when executed by the processor cause the processor to perform steps further comprising: storing, the compressed blocks and the mapping in at least one data storage device. 16. The medium as set forth in claim 15, wherein the at least one data storage device comprises tiered storage, a memory of a network traffic management apparatus, or a file server device. 17. A network traffic management apparatus comprising: a memory;configurable logic; anda processor coupled to the memory and the configurable logic, at least one of the configurable logic configured to implement or the processor configured to execute programmed instructions stored in the memory comprising: obtaining at least one original write request from a client computing device comprising object data;compressing the object data into a plurality of compressed blocks;generating a mapping of each of the plurality of compressed blocks to a portion of the object data, wherein every corresponding portion of the object data is represented in the mapping by a corresponding unique object identifier, a start offset, and a length; andservicing at least one subsequent data access request for one of the portions of the object data, wherein the servicing comprises at least the requested portion of the object data from the mapped one of the plurality of compressed blocks based on the unique object identifier, the start offset and the length. 18. The apparatus as set forth in claim 17 wherein the servicing further comprises: obtaining, the data access request from the client computing device, wherein the data access request comprises a value for a plurality of parameters comprising the object identifier, the start offset, and the length;identifying, the mapped at least one compressed block based at least in part on the mapping and one or more of the data access request parameter values;retrieving, the identified compressed block;obtaining, at least a portion of the object data identified by the data access request parameter values: anddecompressing the retrieved compressed block. 19. The apparatus as set forth in claim 18 wherein the data access request is a read request and wherein at least one of the configurable logic is configured to implement or the processor is further configured to execute, programmed instructions stored in the memory further comprising: sending the obtained object data to the requesting client computing device. 20. The apparatus as set forth in claim 18 wherein the data access request is a write request, the write request further includes object data, wherein the compressing the object data into a plurality of compressed blocks further comprises: compressing the object data into a plurality of compressed blocks each including compressed object data and an empty portion, and wherein at least one of the configurable logic configured to implement or the processor are further configured to execute programmed instructions stored in the memory further comprising:replacing the retrieved compressed block with a modified compressed block including compressed write request object data when a size of the modified compressed block is not greater than a size of the retrieved compressed block. 21. The apparatus as set forth in claim 20 wherein at least one of the configurable logic is configured to implement or the processor is further configured to execute, programmed instructions stored in the memory further comprising: modifying the object data to include at least a portion of the object data included in the write request; andgenerating the modified compressed block; andcompressing the modified object data. 22. The apparatus as set forth in claim 18 wherein the data access request is based on a protocol comprising a common Internet file system (CIFS) protocol, a network file system (NFS) protocol, or a file transfer protocol (FTP). 23. The apparatus as set forth in claim 17 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising: storing, the compressed blocks and the mapping in at least one data storage device. 24. The apparatus as set forth in claim 23, wherein the at least one data storage device comprises tiered storage, a memory of a network traffic management apparatus, or a file server device.
연구과제 타임라인
LOADING...
LOADING...
LOADING...
LOADING...
LOADING...
이 특허에 인용된 특허 (268)
Carpentier,Paul R. M.; Forret,Peter; Willems,Maarten J. P. A., Additional hash functions in content-based addressing.
Agarwalla,Rajesh S.; Doyle,Ronald P.; Jiang,Tianyu; Niranjan,Thirumale; Ramamurthy,Srikanth, Addressing the name space mismatch between content servers and content caching systems.
Miloushev, Vladimir I.; Nickolov, Peter A., Aggregated opportunistic lock and aggregated implicit lock management for locking aggregated files in a switched file system.
Gardner Alan S. (Potomac MD) McElrath Rodney D. (Fairfax VA) Harvey Stephen L. (Port Haywood VA), Apparatus and method for data storage and retrieval using bandwidth allocation.
Ackaouy,Emmanuel; Amdur,Matthew; Ayyar,Kartik; Grunwald,David; Prakash,Ashish; Quirion,Brian, Apparatus and method for storing data in a proxy cache in a network.
Yuval Ofek ; Zoran Cakeljic ; Samuel Krikler IL; Sharon Galtzur IL; Michael Hirsch IL; Dan Arnon ; Peter Kamvysselis, Apparatus and methods for copying, backing up, and restoring data using a backup segment size larger than the storage block size.
McCann,Peter John; Martin,Brian James; Clark,Roy, Apparatus, method and system for writing data to network accessible file system while minimizing risk of cache data loss/ data corruption.
Bahar, Cameron; Hopfield, Joseph; Nalam, Naveen; Zafman, David B.; Oskouy, Rasoul M., Asynchronous file replication and migration in a storage network.
Golding, Richard Andrew; Wong, Theodore Ming-Tao; Zaki, Omer Ahmed, Computer program and method for managing resources in a distributed storage system.
Eric C. Peters ; Stanley Rabinowitz ; Herbert R. Jacobs ; Richard Baker Gillett, Jr. ; Peter J. Fasciano, Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner.
Peters,Eric C.; Rabinowitz,Stanley; Jacobs,Herbert R., Computer system and process for transferring multiple high bandwidth streams of data between multiple storage units and multiple applications in a scalable and reliable manner.
Landis, John A.; Powderly, Terrence V.; Subrahmanian, Rajagopalan; Puthiyaparambil, Aravindh; Hunter, Jr., James R., Computer system para-virtualization using a hypervisor that is implemented in a partition of the host system.
Reed Drummond Shattuck ; Heymann Peter Earnshaw ; Mushero Steven Mark ; Jones Kevin Benard ; Oberlander Jeffrey Todd ; Banay Dan, Computer-based communication system and method using metadata defining a control structure.
Bober, Paul M.; Vahalia, Uresh; John, Aju; Alexander, Jeffrey L.; Gupta, Uday K., Concurrent file across at a target file server during migration of file systems between file servers using a network file system access protocol.
Blickenstaff Ronald L. (Boulder CO) Brant Catherine I. (Boulder CO) Dodd Paul D. (Niwot CO) Kirchner Anton H. (Boulder CO) Montez Jennifer K. (Thornton CO) Trede Brian E. (Boulder CO) Winter Richard , Data storage management for network interconnected processors.
Blickenstaff Ronald L. ; Brant Catherine Irlam ; Dodd Paul David ; Kirchner Anton H. ; Montez Jennifer Kay ; Trede Brian Eldred ; Winter Richard Allen, Data storage management for network interconnected processors.
Chiu Sheng-Yang ; Menon Sathis N. ; Hollar Jeffrey D., Database-independent, scalable, object-oriented architecture and API for managing digital multimedia assets.
Hagerstrom, Carl F.; Hutchinson, Thomas Dixon; Bharthulwar, Shridhar; Tinius, Paul E., Detecting and managing orphan files between primary and secondary data stores.
Leblang David B. (Wayland MA) Allen Larry W. (Cambridge MA) Chase ; Jr. Robert P. (Newton MA) Douros Bryan P. (Framingham MA) Jabs David E. (Sudbury MA) McLean ; Jr. Gordon D. (Brookline MA) Minard D, Dynamic rule-based version control system.
Akizawa Mitsuru (Hachioji JPX) Yamashita Hirofumi (Yokohama JPX) Kawaguchi Hisamitsu (Sagamihara JPX) Tada Katsumi (Yokohama JPX) Kato Kanji (Yokohama JPX) Kito Akira (Ebina JPX) Yamada Hidenori (Had, File server system and file access control method of the same.
Vahalia, Uresh K.; Tzelnic, Percy, File server system providing direct data sharing between clients with a server acting as an arbiter and coordinator.
Xu Yikang ; Vahalia Uresh K. ; Jiang Xiaoye ; Gupta Uday ; Tzelnic Percy, File server system using file system storage, data movers, and an exchange of meta data among data movers for file locking and direct access to shared file systems.
Driscoll, Alan Stuart; Corbett, Peter Frank; Smith, Toby; Shah, Devang K.; Simharajan, Srishylam; Arner, Keith Allen; Dukes, Jr., Joe Warren, File system agnostic replication.
Krakauer Arno S. (San Jose CA) Gawlick Dieter (Palo Alto CA) Colgrove John A. (Mountain View CA) Wilmot ; II Richard B. (Lafayette CA), File system for a plurality of storage classes.
Vertes, Marc; Dufour, Laurent; Richard, Francois; Kurz, Gregory, Functional continuity by replicating a software application in a multi-computer architecture.
Steven R. Soltis ; Matthew T. O'Keefe ; Thomas M. Ruwart ; Gerald A. Houlder ; James A. Coomes ; Michael H. Miller ; Edward A. Soltis ; Raymond W. Gilson ; Kenneth W. Preslan, Global file system and data storage device locks.
Akutsu, Hiroaki; Iwamura, Takashige; Ninose, Kenta; Watanabe, Yasuo; Yamamoto, Yasutomo; Eguchi, Yoshiaki; Homma, Hisao, Information system, data transfer method and data protection method.
Meijer Ronald ; Hebenthal Douglas C. ; Dillingham Lara N. ; Stebbens Kim A. ; Jacoby James D. ; Romano Anthony C., Integration of physical and virtual namespace.
Mahalingam, Mallik; Zhang, Zheng; Karamanolis, Christos; Muntz, Daniel A., Logical volume-level migration in a partition-based distributed file system.
Berger, Michael A.; Curley, Robert T.; Dietterich, Daniel J.; Ferguson, JC; Homberg, Michael J.; McCann, Benjamin E.; Nicklin, Jonathan C.; Porter, David; Raman, Suchi; Rasmussen, Craig S.; Soha, Michael J.; Teixeira, Thomas J.; Whitmore, Bryan T.; Wisniewski, Leonard F.; Wu, Chin-Cheng, Method and apparatus for adaptive services networking.
Savitzky Stephen R. ; Wolff Gregory J., Method and apparatus for document processing using agents to process transactions created based on document content.
Cabrera Luis Felipe ; Long Darrell Don Earl, Method and apparatus for establishing and maintaining the status of membership sets used in mirrored read and write inpu.
Tamer Philip E. ; Hoffman Jane E. ; Chen Charlotte C. ; Torrey ; Jr. James H., Method and apparatus for graphically displaying mapping of a logical object.
Harrison Joel N. ; Rege Satish L. ; Carlson ; Jr. Frederick R., Method and apparatus for storage application programming interface for digital mass storage and retrieval based upon data object type or size and characteristics of the data storage device.
Kee,Thomas E.; Kearny,Ryan C.; DeCaprio,Donald Joseph; Saether,Christian D., Method and system for automatically updating content stored on servers connected by a network.
Dan Asit ; Kienzle Martin Gerhard ; Sitaram Dinkar ; Yu Philip Shi-lung, Method and system for load balancing by replicating a portion of a file being read by a first stream onto second device and reading portion with a second stream capable of accessing.
Sim,Siew Young; Chan,Desmond Cho Hung; Huang,Tsan Fung; Chai,Wencheng; Isaacson,Trygve; Flood, Jr.,James C.; Mills,George Harlow; Orzen,Matthew, Method and system for managing distributed content and related metadata.
Gabbe John D. (Little Silver NJ) Ginsberg Allen (Jackson NJ) Robinson Bethany S. (Colts Neck NJ), Method and system for operating a data processor to index primary data in real time with iconic table of contents.
Havewala, Sarosh Cyrus; Thind, Ravinder S.; Christiansen, Neal R.; Kalach, Ran; Benton, James R., Method and system of detecting file system namespace changes and restoring consistency.
Taylor, Clement G.; Chin, Danny; Lerman, Jesse S.; Goode, Christopher W. B., Method of data management for efficiently storing and retrieving data to respond to user access requests.
Nakano,Takahiro; Sonoda,Koji; Eguchi,Yoshiaki; Horiuchi,Takashi; Hirezaki,Katsumi, Method of maintaining a plurality of snapshots, server apparatus and storage apparatus.
Quatrano, Stephen R.; Cummings, Charles D.; Cleasby, Andrew R.; Gladstein, Brian S.; Anuszczyk, Jeffrey J., Methods and apparatus for providing shared access to an application.
Kadyk, Donald J.; Fishman, Neil S.; Damour, Kevin T.; Kramer, Michael, Methods and systems for authentication through multiple proxy servers that require different authentication data.
Arrouye,Yan; Giampaolo,Dominic; Ording,Bas; Christie,Gregory; Lemay,Stephen Olivier; van Os,Marcel; Chaudhri,Imran; Tiene,Kevin; Cisler,Pavel, Methods and systems for managing data.
Lownsbrough,Derek Leigh, Methods, apparatuses and systems for transparently intermediating network traffic over connection-based authentication protocols.
Ulrich,Thomas R.; Schweitzer,James R.; Bolstad,Gregory D.; Randall,Jay G.; Staub,John R.; Priester,George W., Replacing file system processors by hot swapping.
Amegadzie, Augustine; Compton, James T.; Gross, Jerald W.; Rago, Stephen A; Stacey, Christopher H.; Zimran, Eyal, Selection of migration methods including partial read restore in distributed storage management.
William J. Bolosky ; John R. Douceur ; Scott M. Cutshall ; Richard F. Rashid ; Nathan P. Myhrvold ; David A. Goebel, Single instance store for file systems.
Maeda,Seiji; Yano,Hirokuni; Shirakihara,Toshio; Sato,Kiyoko; Sakiyama,Nobuo; Hayashi,Takuya, Storage device, backup method and computer program code of this storage device.
Ericson, George M.; Solomon, Robert C.; Brown, Jeffrey A.; Haynes, Jr., John E., Switch-based acceleration of computer data storage employing aggregations of disk arrays.
Cox, Benjamin T. H.; Kazar, Michael; Nydick, Daniel S.; Sanzi, Jr., Richard N.; Eisler, Michael, System and method for a sidecar authentication mechanism.
Newland, Richard, System and method for archival of messages in size-limited containers and separate archival of attachments in content addressable storage.
Federwisch, Michael L.; Owara, Shane S.; Manley, Stephen L.; Kleiman, Steven R., System and method for determining changes in two snapshots and for transmitting changes to a destination snapshot.
Beal David Grant ; Milillo Michael Steven ; West Christopher James, System and method for enabling pair-pair remote copy storage volumes to mirror data in another storage volume.
Anand Tejwansh S. ; Wikle Glenn K. ; Lindsay Marshall P. ; Schubert Richard N. ; Lettington Drew T. ; Ludwig Jeffrey P., System and method for performing intelligent analysis of a computer database.
Marce, Jean-Pierre; Thubert, Pascal; Esteve, Denis; Denecheau, Lionel, System and method for providing an adaptive streaming flow control mechanism between the TCP and IP layers of the TCP/IP suite of protocols.
Panchbudhe, Ankur P.; Colgrove, John A.; Kekre, Anand A., System and method for providing data protection by using sparse files to represent images of data stored in block devices.
Ma,Xiaonan; Hsu,Windsor Wee Sun, System and method for reliably storing data and providing efficient incremental backup and asynchronous mirroring by preferentially handling new data.
Basu, Sujoy; Kumar, Rajendra, System and method for supervising use of shared storage by multiple caching servers physically connected through a switching router to said shared storage via a robust high speed connection.
Yasuda, Yoshiko; Higuchi, Tatsuo; Kawamoto, Shinichi; Ebata, Atsushi; Okitsu, Jun, System and method for virtualizing network storages into a single file system view.
Karmarkar, Kedar M.; Tawri, Deepak; Krishnamurthy, Raghu, System and method of applying incremental changes prior to initialization of a point-in-time copy.
Patel, Sujal M.; Mikesell, Paul A., System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system.
Craig J. Bunger ; Latha S. Colby ; Richard L. Cole ; Galt Johnson ; William J. McKenna ; Gopal B. Mulagund ; David G. Wilhite, Jr., System for maintaining precomputed views.
Mahoney James V. ; Blomberg Jeanette L. ; Trigg Randall H. ; Shin Christian K., System for searching a corpus of document images by user specified document layout components.
Becker Szendy,Ralph Attila; Sivan Zimet,Miriam, System, method, and service for federating and optionally migrating a local file system into a distributed file system while preserving local access to existing data.
Anderson, Robert J.; Fachan, Neal T.; Husted, Justin M.; Lemar, Eric M.; Passey, Aaron J.; Schack, Darren P., Systems and methods for a snapshot of data.
Manadhata, Pratyusa; Griffin, Kent; Ramzan, Zulfikar, Systems and methods for classifying unknown files/spam based on a user actions, a file's prevalence within a user community, and a predetermined prevalence threshold.
Patel,Sujal M.; Mikesell,Paul A.; Schack,Darren P.; Passey,Aaron J., Systems and methods for providing a distributed file system incorporating a virtual hot spare.
Mikesell, Paul A.; Anderson, Rob; Passey, Aaron James; Godman, Peter John; Khan, Hassan F.; Schack, Darren P., Systems and methods for restriping files in a distributed file system.
Agarwal, Mugdha; Suganthi, Josephine; Annamalaisami, Saravana; Kurma, Jyotheesh Rao; Goel, Deepak; Shetty, Anil, Transparent layer 2 redirection of request to single sign in service based on applying policy to content of request.
Miller Arnold (Bellevue WA) Neeman Yuval (Bellevue WA) Contorer Aaron M. (Kirkland WA) Misra Pradyumna K. (Issaquah WA) Seaman Michael R. C. (Kirkland WA) Rubin Darryl E. (Redmond WA), Unification of directory service with file system services.
Mahalingam, Mallik; Zhang, Zheng; Karamanolis, Christos; Muntz, Daniel A., Updating references to a migrated object in a partition-based distributed file system.
Bainbridge Andrew John,GBX ; Cocks Stephen James,GBX ; Ferguson Donald Francis ; Freund Thomas,GBX ; Leff Avraham ; Normington Glyn,GBX ; Rayfield James Thomas ; Storey Robert Anthony,GBX, Updating server-related data at a client.
Fitzgerald Robert P. (Redmond WA) Barrera ; III Joseph S. (Issaquah WA) Bolosky William J. (Issaquah WA) Draves ; Jr. Richard P. (Kirkland WA) Jones Michael B. (Redmond WA) Levi Steven P. (Redmond WA, Video on demand system comprising stripped data across plural storable devices with time multiplex scheduling.
Cai, Hao; Michels, Timothy S.; Szabo, Paul I., Hardware assisted flow acceleration and L2 SMAC management in a heterogeneous distributed multi-tenant virtualized clustered system.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.