FSWalk - File System Indexer and Query tool

Introduction

Performing metadata queries on large filesystems (with 10^9) is an intensive task which usually requires long periods of time. This is since the layout of metadata in filesystem is targeted for supporting file operations and not metadata global queries. For example, scanning a large filesystem for producing a histogram of file sizes require iterating over all files and obtaining their sizes. On a filesystem with large number of files such operation can take hours to complete.

fswalker is a filesystem indexer (walker) and query system. Its main purpose is to provides means to perform fast metadata queries on large filesystems (with 10^9 files) in reasonable time. fswalker perform a scan of the filesystem and build a database with an entry about each file. Using the database, metadata global queries can be performed in a much faster speed, allowing the user to obtain results in matter of seconds.

Topics:

• Download
• Install
• Run fswalk
• Run fsq
• Python Interface

Have fun!