Cockatrice/libcockatrice_card/libcockatrice/card/lazy_properties_hash.h
BruebachL ad4320cd7b
[CardDB] Stream card properties from blobs (#7608)
* [CardDB] Stream card properties from blobs

Parsed and cached cards used to keep a materialized QHash<QString,
QString> for their properties: LazyPropertiesHash only deferred building
that hash until the first query, and the cache writer re-serialized it on
save.

- LazyPropertiesHash answers value(), contains(), size(), isEmpty() and
  keys() straight out of the serialized blob, so a property query no
  longer builds a hash.
- serialize() is public, and the cache writer passes the stored blob
  through instead of serializing a hash it just rebuilt.
- CardInfo and PrintingInfo expose getPropertiesBlob() and
  getPropertyCount(); PrintingInfo::operator== compares key by key
  without materializing either side.
- The XML parsers build cards via newInstanceFromPropertiesBlob(), which
  derives the simple name and the alternate names that the parser used
  to keep next to the hash.

The reload cycle fix stays out of this change; it depends on changing
the CardInfo self pointer and is reviewed separately.

* [CardDB] Address review comments on streaming properties

* [CardDB] Address final review nits on property streaming

Move BlobReader and the blob accessors into LazyPropertiesHash as private
members so the parsing helper is declared with the class instead of hiding
in the translation unit.

Add LazyPropertiesHash::serializedFrom() and use it where a PrintingInfo is
built from a fresh property hash, replacing the nested
LazyPropertiesHash(LazyPropertiesHash::serialize(props)) construction.

The pre-materialized QHash constructor stays: CardInfo's non-blob factory
still uses it for the oracle import path, and the tests cover it directly.

---------

Co-authored-by: Lukas Brübach <Bruebach.Lukas@bdosecurity.de>
2026-10-24 00:17:31 +02:00

193 lines
6.6 KiB
C++

#ifndef COCKATRICE_LAZY_PROPERTIES_HASH_H
#define COCKATRICE_LAZY_PROPERTIES_HASH_H
#include <QByteArray>
#include <QHash>
#include <QMutex>
#include <QMutexLocker>
#include <QString>
#include <QStringList>
#include <atomic>
/**
* @brief A property map that can lazily deserialize blobs to avoid loading overhead.
*
* Properties are stored as a pre-serialized blob (cheap to load), and individual values are read straight out of that
* blob, so the database load and ordinary queries avoid constructing thousands of QString per card.
*
* A full QHash<QString, QString> is only built on the first insert() or getProperties() call. Once materialized, it
* cannot be unmaterialized; create a new LazyPropertiesHash to return to the blob form.
*/
class LazyPropertiesHash
{
/**
* @brief Iterates over the key/value pairs of a serialized QHash blob without materializing it.
*
* The blob layout is the one produced by QDataStream for QHash: a quint32 entry count followed by each entry's
* serialized key and value.
*/
class BlobReader
{
public:
explicit BlobReader(const QByteArray &_blob);
/**
* @brief Reads the next pair's offsets.
* @return False when there are no more pairs or the blob is malformed.
*/
bool next(int &keyPos, quint32 &keyLength, int &valuePos, quint32 &valueLength);
[[nodiscard]] quint32 entryCount() const;
private:
const QByteArray &blob;
int pos = 4;
quint32 remaining = 0;
bool valid = false;
};
/**
* @brief Looks up @p key in a serialized blob without materializing it.
*/
static QString blobValue(const QByteArray &blob, const QString &key);
/**
* @brief Checks whether @p key is present in a serialized blob without materializing it.
*/
static bool blobContains(const QByteArray &blob, const QString &key);
/**
* @brief Lists the keys of a serialized blob without materializing it.
*/
static QStringList blobKeys(const QByteArray &blob);
mutable QByteArray blob; ///< Serialized properties (load form).
mutable QHash<QString, QString> properties; ///< Materialized properties (query form).
mutable QMutex propertiesMutex; ///< Guards lazy materialization.
mutable std::atomic<bool> isMaterialized{false}; ///< Whether properties is valid.
/**
* @brief Materializes properties from blob if not already done. Clears blob afterward.
* Safe to call from const getters (members are mutable).
*/
void ensureMaterialized() const;
/**
* @brief Runs the accessor for the current storage form.
*
* The common case skips the mutex once the properties are materialized. While they are
* still in blob form, the mutex is taken and @p onBlob reads the values straight out of
* the blob without building the hash, so ordinary queries stay allocation-light.
*
* @param onMaterialized Called with the materialized hash when it is available.
* @param onBlob Called with the blob when it is still the source of truth.
* @return Whatever the invoked accessor returns; both accessors must return the same type.
*/
template <typename MaterializedFn, typename BlobFn>
auto read(MaterializedFn &&onMaterialized, BlobFn &&onBlob) const
{
if (isMaterialized.load(std::memory_order_acquire)) {
return onMaterialized(properties);
}
QMutexLocker lock(&propertiesMutex);
if (isMaterialized.load(std::memory_order_relaxed)) {
return onMaterialized(properties);
}
return onBlob(blob);
}
public:
/**
* @brief Default constructor.
*/
LazyPropertiesHash();
/**
* @brief Creates an unmaterialized LazyPropertiesHash
* @param blob The pre-serialized blob
*/
explicit LazyPropertiesHash(const QByteArray &blob);
/**
* @brief Creates an already-materialized LazyPropertiesHash
* @param properties The properties
*/
explicit LazyPropertiesHash(const QHash<QString, QString> &properties);
// Override copy constructor and copy-assignment because mutex isn't copiable
LazyPropertiesHash(const LazyPropertiesHash &other);
LazyPropertiesHash &operator=(const LazyPropertiesHash &other);
/**
* @brief Serializes a property map into the blob form understood by this class.
* @param properties The properties to serialize
* @return The serialized blob
*/
static QByteArray serialize(const QHash<QString, QString> &properties);
/**
* @brief Creates an unmaterialized LazyPropertiesHash from a property map.
*
* Serializes @p properties once so queries read them from the blob form instead of first materializing a second
* copy of the hash.
*
* @param properties The properties to serialize
* @return An unmaterialized LazyPropertiesHash holding the serialized properties
*/
static LazyPropertiesHash serializedFrom(const QHash<QString, QString> &properties);
/**
* @brief Gets the value for a key, reading it from the blob when possible.
* @param key The key
* @return The value, or an empty string if the key is not present
*/
QString value(const QString &key) const;
/**
* @brief Checks whether a key is present, reading the blob when possible.
* @param key The key
* @return True if the key is present
*/
bool contains(const QString &key) const;
/**
* @brief Returns the number of properties.
*/
int size() const;
/**
* @brief Returns whether there are no properties.
*/
bool isEmpty() const;
/**
* @brief Returns the property names, reading them from the blob when possible.
*/
QStringList keys() const;
/**
* @brief Returns the properties in serialized blob form.
*
* While the object is unmaterialized this is a cheap copy of the stored blob; after materialization the hash is
* serialized on demand.
*/
QByteArray serialized() const;
/**
* @brief Inserts a value into the materialized properties hash
* @param key The key
* @param value The value to insert
* @return True if a new value was inserted; false if the new value is the same as the existing value
*/
bool insert(const QString &key, const QString &value);
/**
* @brief Gets a view of the materialized properties hash, materializing it if needed.
* @return The properties hash
*/
const QHash<QString, QString> &getProperties() const;
};
#endif // COCKATRICE_LAZY_PROPERTIES_HASH_H