thank you very much.
Thank you for writing to us.
We assume the problem you are facing is due to the fact that the server is not able to handle the processing of such a large data set. As an alternative, we suggest using Flexmonster Data Server. The Data Server is a special server-side tool responsible for fetching data from a data source, processing, and aggregating it. Then the data is passed to Flexmonster Pivot in a ready-to-show format. The Data Server significantly reduces the time of data loading and enables analyzing large datasets.
Flexmonster Data Server supports connection to popular databases and CSV/JSON files.
The main advantage of the Data Server for your case is the fact that instead of the whole data set, only the data needed to be displayed will be serialized and passed to the client-side. It allows significantly reducing the load both on the server-side (no need to serialize the whole data set each time the client requests the data) and on the client-side (only required data is loaded and stored in the RAM instead of the whole data set).
We suggest referring to our documentation dedicated to the Data Server. You will find detailed information about the tool and the step-by-step guide on installation and using Flexmonster Data Server.
Also, we want to notice that the Data Server is available as a DLL that may be the most suitable option for your case.
In case more flexible logic of the server-side tool is required, we suggest taking a look into our custom data source API feature. The custom data source API is a communication protocol that serves as a core of the Data Server mentioned earlier. It means it is possible to implement your own realization of the custom data source API that would be developed especially for your needs.
To provide you with illustrative examples, we developed two ready-to-check Node.js and .NET Core servers.
Note that these are only the samples, and the implemented logic of data processing may differ from what you need. You can use them as a core for building a custom connector.
Please let us know if it works for you.
Do not hesitate to contact us in case further assistance is needed.