Data Limit and Parallel Factor

Data Limit and Parallel Factor

Data Display Limit (no unit)

How many records will be displayed in the UI of the Data Browser. After this limit is hit, all data coming from the backend for the same request will be ignored.

Parallelism Factor (Kafka only) (no unit)

How many concurrent requests are made to poll data from the broker. This is broken down by partition. If a topic has 3 partitions and we set the parallelism factor to 3 then 3 concurrent requests are issued, one per partition and the data shipped to the front end concurrently, ie, the records will show up interleaved in the UI. If the topic has only 1 partition then the parallel factor has no effect since data from the same partition is fetched in order.

Data Poll Max Record (no unit)

This is number of records the client will try to retrieve on each poll, ie, poll batch size.
In Kinesis, there's a hard limit of 10.000 records per poll, therefore, saving this setting with a number higher than 10.000 will always return at maximum 10.000 records.

    • Related Articles

    • Data Protection Policies and Data Masking

      Data protection is a crucial aspect of business operations, especially when dealing with sensitive information. Kadeck Teams Enterprise is equipped with a Data Protection Policy module that helps you define data protection policies through the ...

    • Introduction to the Quick Processor

      The Quick Processor allows you to create filters and modify records using JavaScript. In this article, we show how to create a Quick Processor and how to access, filter, and modify records. A Quick Processor is always linked to a view. This means ...

    • Release 4.3

      This article describes the changes of the version 4.3.x update. New image tag: xeotek/kadeck:4.3.7 Kadeck Teams is no longer run as root as of version 4.3.5. Instead, a separate user kadeck is used. Depending on the container service, this requires ...

    • Requirements

      Hardware requirements The requirements can vary to a large extent depending on the number of users, connections in Kadeck and usage (e.g., how many users use it in parallel). Minimum Single Core CPU 4GB Memory 2 GB disk space Recommended 2+ Core CPU ...

    • Getting Started

      The Kadeck Team says: Thank you! Kadeck is the result of experienced developers, operations, architects and project managers from the IT field, who were looking for an easier and better way to implement, communicate and operate data streaming ...