Message logging using two-stage message logging mechanisms

Abstract

Systems, methods, and computer-readable media are provided for logging message data with reduced the latency and decreased overhead in multi-tenant systems. A message server may implement a two-stage process for logging the message data. In the first stage, the message server may create job-specific and write-optimized staging tables for each message processing job, and may store the message data for each job in a corresponding staging table. This may be done as the message server is building and sending the messages for each job. Additionally, the message server may partition or shard the staging tables so that the write operations are spread to multiple storage disks to avoid creating a storage server hotspot or bottleneck. In the second stage, the message server may move the accumulated message data from the individual staging tables to a corresponding tenant space at regular intervals. Other embodiments may be described and/or claimed.