Index of values

Access the perm file referenced by the file descriptor

Access the hindex file referenced by the file descriptor

Access the kvseq file referenced by the file descriptor.

Adds a new entry at the end of the permutation array

Add another value to the file, and return the new entry.

Add another value to the file, and return the new entry.

AENTRIES is the number of active (non-deleted) entries in the file.

ALIGN enforces the alignment of the Kvseq entries so entries can only start at multiples of ALIGN.

let ch = append arch entry_name entry_timestamp entry_gzip data_gzip comment: Appends data to the archive.

Return the directory

blit_from_string s s_pose e_pos len: Copies the substring of length len at position s_pos from s to e's value at position e_pos.

blit_to_string e e_pos s s_pos len: Copies the substring of length len at position e_pos from e's value to s at position s_pos.

CELLSZ is the size of the Hindex elements in the number of 8 byte words.

Do a filesystem check if we can get the global lock exclusively

Performs a filesys check, and if necessary rolls it back

Checkpoints and disposes all filesystems of the base that have been used by this program

Closes the file (and if locks are held, they are released)

Create new .data and .idx files with the given params.

Sets some (non-persistent) parameters: flush_every: The superblock is written every this number of adds, deletes, replaces. (Default: 1), auto_fadvise: Advises to remove the file from the page cache after every sync (automatic syncs & explicit syncs). The superblock is not removed. (Default: false)

Sets some (non-persistent) parameters: flush_every: The superblock is written every this number of adds, replaces, deletes. (Default: 1), auto_fadvise: Advises to remove the file from the page cache after every sync (automatic syncs & explicit syncs). The superblock is not removed. (Default: false), random_fadvise: Whether to advise the OS to assume fully random accesses (Default: false)

Sets some (non-persistent) parameters: flush_every: The superblock is written every this number of adds, deletes, replaces. (Default: 1), auto_sync: If non-None, every auto_sync seconds the whole file is synced to disk. This also sets the superblock variables SYNCSIZE and SYNCTIME. A value of 0 means: sync after every modification. (Default: Some 0 - you want to change this), auto_fadvise: Advises to remove the file from the page cache after every sync (automatic syncs & explicit syncs). The superblock is not removed from the cache. (Default: false), onsync: This function is called before an automatic or explicit sync is done. For example, one can sync the attached Hindex at that time. (Default: do nothing)

- read_only_mode: If true, the fsys can only be read - writes will fail.

Changes runtime parameters: hindex_caching: whether to allow page-caching of the idx file. (true after create/get_filesys), data_caching: whether to allow page-caching of the data file. (true after create/get_filesys), sync_every: after how many seconds files are synced to disk. A negative value disables syncs. (600 after create/get_filesys), fully_buffered_index: The buffer for the index is made so large that it can hold the whole index (false after create/get_filesys)

Return the contents

Write an empty perm structure into the file referenced by the file descriptor.

Write an empty hindex structure into the file referenced by the file descriptor.

Write an empty kvseq structure into the file referenced by the file descriptor.

Create an ao file system

Creates a new file system in the base.

Creates a new empty superblock with the passed parameters

The pointer values marking free and deleted hash table cells

The pointer values marking free and deleted hash table cells

Marks the entry as deleted

Same as replacing the entry with a deleted entry

Disposes all filesystems of the base

DTOTSZ is the estimated total size of all active (non-deleted) files in bytes.

ENTRIES is the total number of entries in the file (deleted and active entries).

Tell the page cache that we are iterating over the file, and it is a good idea to read ahead pages.

Advise to load the size bytes at pointer

Tell the page cache that we won't need this file any more.

Tell the page cache that we won't need this file any more.

Tell the page cache that we won't need this file any more.

FILEINCR is the increment by which the file is extended when the file is full.

Return the logical file size: The FILESIZE variable if existent, or else the real file size of the descriptor.

FILESIZE is the logical length of the file.

Get the special ao parameters

Get the parameters of the filesystem

Returns the first entry, or raises End_of_file

Returns the first entry, or raises End_of_file

If KEYREPR/VALREPR is a value n between fixed_repr_min and fixed_repr_max, the length of the keys/values is fixed to n - fixed_repr_min.

Ensure that everything is written out (but a sync is not forced).

Ensure that everything is written out (but a sync is not forced).

Ensure that everything is written out (but a sync is not forced).

FORMAT says which format the file has: One of Seqdb_containers.Sb_consts.kvseq_format, Seqdb_containers.Sb_consts.hindex_format, or Seqdb_containers.Sb_consts.perm_format.

Starts iterating at the first file whose mtime is greater or equal to at_mtime (or the beginning of the filesys if at_mtime is omitted).

Get the contents of an entry

Get the contents of an entry (or Not_found if it is deleted)

Get the contents of an entry

Get only the delflag of the entry

Get the filesystem

Get an iterator for the filesystem.

Get the index of an entry, 0 <= index < size

Get an iterator for the filesystem.

Get the key of the entry

Get only the key of the entry

Get the pointer of an entry

Get the pointer to the container entry (or Not_found if it is deleted)

Get the pointer of an entry

Read the statistics

Get the total length (used space) of the entry

Get only the value of the entry

Get the length of the value

Sorts the entries by first their hash value, and then by their keys.

Checks whether the entry has the key.

Checks whether the entry has the key

The hash value of a key must fit in a positive int64 number

Query features of the file

HAVEDUPS is used in the superblocks of the data files of file systems.

HTALGO sets the hash algorithm.

Convert from/to HTALGO superblock values

Query features of the file

HTSIZE is the size of the Hindex table as number of elements

Get the most likely index position (in cell numbers) of the key

Return toc information about the entry

Initialize Seqdb_fsys_ht in a special way so the ao variant is known there

input_string rw n: read exactly n bytes from rw

The length of keys/values is stored in 2 bytes.

The length of keys/values is stored in 4 bytes.

The length of keys/values is stored in 8 bytes.

The length of keys/values is stored in 1 byte.

ISZ is the default size for new inodes (existing inodes are allowed to have a different size).

ITOTSZ is the total size of all active (non-deleted) inodes in bytes This variable occurs in the data file of file systems.

Remove all cached pages for t from the page cache.

KEYREPR says how the keys in a Kvseq file are represented.

KVDELFL says whether there is a delete flag in every entry of a Kvseq file.

LASTMT is the mtime timestamp of the last appended file

If KEYREPR/VALREPR is a value n between lim8_repr_min and lim8_repr_max, a fixed space of n - lim8_repr_min + 1 is reserved for the key/value string, and the string can have a variable size from 0 to n - lim8_repr_min + 1.

Obtains a shared global lock.

Get an entry by looking up a pointer, or raise Not_found

Get an entry by looking up an index, 0 <= index < size

Get an entry by looking up a key, or raise Not_found

Get an entry by looking up a pointer

The superblock is marked as dirty, and will be written out at the next good opportunity

The superblock is marked as dirty, and will be written out at the next good opportunity

The superblock is marked as dirty, and will be written out at the next good opportunity

Based on MD5

Looks into the base directory and returns the names of all filesystems (i.e.

Creates a base.

Returns the next entry of a given entry, or raises End_of_file

Returns the next entry of a given entry, or raises End_of_file

Get statistics.

Get statistics.

Open the file.

Open the file.

Open the archive given as string (always `Rdonly)

Another hash value computed from the key

output_string rw s: write s to rw

PERMSIZE is the size of the Perm array in number of elements

Get the most likely position of the key in the container.

Convert pointer to/from strings.

Convert pointer to/from string, and int64.

PURPOSE is a string of 8 bytes that gives a hint for what the file is used.

Read the contents of the entry.

Reads the superblock from the file.

Reads the superblock from the reader/writer.

This is a recovery function for reading damaged files.

Create a new .idx file with the given params.

Rename the entry.

Replace the value stored inside an entry with a new version.

Replace the value stored inside an entry with a new version.

After opening the kvseq with access, this flag is true if a rollback to the last synchronized file size is to be done.

Return the superblock size

SBSIZE is the size of the superblock in bytes

Set a superblock variable.

The size of the permutation array in number of entries

Get the suggested hash algorithm, if any

Query features of the file

Get the superblock

Get the superblock

Get the superblock.

Ensure that everything is physically written to disk (implies flush)

Ensure that everything is physically written to disk (implies flush)

Ensure that everything is physically written to disk (implies flush).

SYNCSIZE is the logical length of the file at the time of the last checkpoint.

SYNCTIME is the timestamp (as seconds since the epoch) of the last checkpoint.

TIMEMARK is the value of the last written time mark.

TIMEMN is the number of appended files since the last time mark was written.

TIMEMP says after how many seconds a new time mark is written.

Checks whether the pointer is in the valid range.

See POINTABLE

VALREPR says how the values in a Kvseq file are represented.

Get a superblock variable (or Not_found)

Get all superblock variables

Load as much as reasonable into the page cache

Load as much as reasonable into the page cache

This is the "#!WINKME" magic at the beginning of the superblock

Writes the superblock to the file.

Writes the superblock to the reader/writer.