Protocol buffer trie packing and streaming updates

Abstract

Systems and techniques for protocol buffer trie packing and streaming updates are described herein. Data entities are identified in a received update query. An index value is assigned to each unique data entity to generate an index of unique data entities. A frequency of occurrence value is determined for each unique data entity. The index of unique data entities is sorted by data entity type in descending order by the frequency of occurrence value of each unique data entity. A trie is generated with a root node assigned as a first unique data entity from the index of unique data entities that has a frequency of occurrence value with the largest numerical value. An update payload is created for the trie by conversion of the trie into a protocol buffer format through serialization of the trie into a binary string.